Service management method and system, and configuration server and edge … — Boe Technology Group Co., Ltd. (US20260156193A1)

ABSTRACT

Abstract

Disclosed are a service management method and system, and a configuration server and an edge computing device. The system comprises: a configuration server, an edge computing device, a terminal device and a display device; the configuration server provides a front-end configuration page and receives configuration information by means of the front-end configuration page, the configuration information comprises the edge computing device, the terminal device and a required AI service, and the AI service comprises one or more edge applications; the configuration server performs edge application deployment on the edge computing device according to the configuration information, and receives a reasoning result from the edge computing device; the edge computing device acquires a multimedia data stream of the terminal device according to a deployed edge application, and performs application reasoning to obtain the reasoning result; and the display device performs display according to the reasoning result.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a U.S. National Phase Entry of International Application No. PCT/CN2023/092262 having an international filing date of May 5, 2023, which claims priority to Chinese patent application No. 202210546081.X, filed to the CNIPA on May 18, 2022 and entitled “Service Management Method and System, and Configuration Server and Edge Computing Device”, contents of the above-identified applications should be regarded as being incorporated herein by reference.

TECHNICAL FIELD

Embodiments of the present disclosure relates to, but is not limited to, the technical field of intelligent systems, in particular to a service management method, a system, a configuration server, and an edge computing device.

BACKGROUND

Edge computing refers to an edge device platform, which integrates network, computing, storage, and application core capabilities on a side close to a source of objects or data, provides a nearest end service nearby. Its application programs are initiated on an edge side, which produces a faster network service response and meets basic requirements of the industry in real-time service, application intelligence, security and privacy protection, etc. Cloud computing may receive or access historical data of the edge computing in real time.

SUMMARY

An embodiment of the present disclosure provides a service management system including a configuration server, an edge computing device, a terminal device, and a display device, wherein the edge computing device, the terminal device, and the display device are all local devices, and the configuration server is a cloud device, wherein the configuration server is configured to provide a front-end configuration page and receive configuration information through the front-end configuration page, the configuration information includes the edge computing device, the terminal device, and a required Artificial Intelligence (AI) service, wherein the AI service includes one or more edge applications; perform edge application deployment on the edge computing device according to the configuration information; and receive an inference result of the edge computing device; the edge computing device is configured to acquire a multimedia data stream of the terminal device according to a deployed edge application, and perform application inference according to the acquired multimedia data stream to obtain the inference result; and the display device is configured to display according to the inference result.

An embodiment of the present disclosure also provides a service management method, including: a configuration server receives configuration information through a front-end configuration page, wherein the configuration information includes an edge computing device, a terminal device, and a required AI service, wherein the AI service includes one or more edge applications; the configuration server performs edge application deployment on the edge computing device according to the configuration information; and the configuration server receives an inference result of the edge computing device.

An embodiment of the present disclosure also provides a configuration server, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above based on instructions stored in the memory.

An embodiment of the present disclosure also provides a service management method, including: an edge computing device receives a container mirror image file, wherein the container mirror image file includes a configuration file, an executable file, a dynamic library, and an algorithm model; the edge computing device performs edge application deployment according to the container mirror image file; and the edge computing device acquires a multimedia data stream of the terminal device according to a deployed edge application, and performs application inference according to the acquired multimedia data stream to obtain an inference result.

An embodiment of the present disclosure also provides an edge computing device, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above based on instructions stored in the memory.

An embodiment of the present disclosure also provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the service management method according to any one of the above is implemented.

Other features and advantages of the present disclosure will be set forth in following specification, and moreover, partially become apparent from the specification, or are understood by implementing the present disclosure. Other advantages of the present disclosure may be achieved and obtained through solutions described in the specification and drawings.

BRIEF DESCRIPTION OF DRAWINGS

Accompany drawings are used for providing further understanding of technical solutions of the present disclosure, and constitute a part of the specification. The accompany drawings, together with the embodiments of the present disclosure, are used for explaining the technical solutions of the present disclosure, and do not constitute limitations on the technical solutions of the present disclosure.

FIG. 1 is a schematic architecture diagram of a service management system according to an exemplary embodiment of the present disclosure.

FIG. 2 is a schematic flowchart of a service management method according to an exemplary embodiment of the present disclosure.

FIG. 3 is a schematic flowchart of another service management method according to an exemplary embodiment of the present disclosure.

FIG. 4 is a schematic flowchart of yet another service management method according to an exemplary embodiment of the present disclosure.

FIG. 5 is a schematic diagram of a service inference flow of an edge computing device according to an exemplary embodiment of the present disclosure.

FIG. 6 is a schematic architecture diagram of another service management system according to an exemplary embodiment of the present disclosure.

FIG. 7 is a schematic diagram of a cloud service and an edge service according to an exemplary embodiment of the present disclosure.

FIG. 8 is a schematic diagram of another cloud service and edge service according to an exemplary embodiment of the present disclosure.

FIG. 9 is a schematic diagram of a Kubernetes (K8S) service framework.

FIG. 10 is a schematic diagram of an Internet of Things edge service according to an exemplary embodiment of the present disclosure.

FIG. 11 is a schematic diagram of a structure of a service management system according to an exemplary embodiment of the present disclosure.

FIG. 12 is a schematic diagram of a structure of an edge gateway according to an exemplary embodiment of the present disclosure.

FIG. 13 is a schematic diagram of an edge node management flow according to an exemplary embodiment of the present disclosure.

DETAILED DESCRIPTION

To make objectives, the technical solutions, and advantages of the present disclosure clearer, the embodiments of the present disclosure will be described in detail below in combination with the accompany drawings. It is to be noted that the embodiments in the present disclosure and features in the embodiments may be randomly combined with each other if there is no conflict.

Unless otherwise defined, technical terms or scientific terms used in the embodiments of the present disclosure should have usual meanings understood by those of ordinary skills in the art to which the present disclosure belongs. “First”, “second”, and similar terms used in the embodiments of the present disclosure do not represent any order, quantity, or importance, but are only used for distinguishing different components. “Include”, “contain”, or a similar term means that an element or article appearing before the term covers an element or article and equivalent thereof listed after the term, and other elements or articles are not excluded.

As shown in FIG. 1 , an embodiment of the present disclosure provides a service management system including a configuration server, an edge computing device, a terminal device, and a display device, wherein the edge computing device, the terminal device, and the display device are all local devices, and the configuration server is a cloud device, wherein the configuration server is configured to provide a front-end configuration page and receive configuration information through the front-end configuration page, wherein the configuration information includes an edge computing device, a terminal device, and a required Artificial Intelligence (AI) service, and the AI service includes one or more edge applications; deploy an edge application to the edge computing device according to the configuration information; and receive an inference result of the edge computing device.

The edge computing device is configured to acquire a multimedia data stream of the terminal device according to the deployed edge application, and perform application inference according to the acquired multimedia data stream to obtain an inference result.

The display device is configured to display according to the inference result.

The service management system of the embodiment of the present disclosure undertakes all core computing power through the edge computing device, and the cloud configuration server only associates the edge computing device with the terminal device according to the user demand, distributes the edge application, and displays monitoring information of the bonded edge computing device in real time, and does not participate in a calculation operation process of the edge application. That is, the edge application operation process of the embodiment of the present disclosure is all at an edge end. This kind of architecture design may avoid frequently requesting data from a cloud end, thereby reducing insecurity of the data, reducing network delay, and improving a data processing efficiency and speed. The service management system is not only suitable for a scenario where a public cloud is allowed to participate, but also suitable for a scenario of building a private cloud with only an intranet, such as banks, transportation systems, and public security systems.

In some exemplary implementation modes, deploying the edge application to the edge computing device according to the configuration information includes: generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; generating an edge application resource package, wherein the edge application resource package includes a configuration file, an executable file, a dynamic library, and an algorithm model; and transmitting the edge application resource package to the edge computing device through a network or a storage device.

In an exemplary embodiment, the generated edge application resource package may be transmitted to the edge computing device through a network such as Wireless Fidelity (WiFi), Bluetooth, and a local area network, or may be directly transmitted to the edge computing device through a storage device such as a Universal Serial Bus (USB) flash disk.

In other exemplary implementation modes, deploying the edge application to the edge computing device according to the configuration information includes: generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; forming a container mirror image file according to the configuration file, the executable file, the dynamic library, and the algorithm model; and distributing the container mirror image file to the edge computing device through Kubegde (an open platform that enables edge computing).

In an exemplary embodiment, for the whole service management system, a KubeEdge architecture may be adopted, edge nodes, devices, and workloads are managed in the cloud end through a Kubernetes (K8S for short) standard Application Programming Interface (API), and system upgrades and application updates of edge nodes may be directly distributed from the cloud end, thus improving an efficiency of edge operation and maintenance. The edge computing device may be pre-installed with an edge part at the time of delivery and become a K8S node. The edge application may be distributed through Kubernetes. K8S is a brand-new distributed architecture solution based on a container technology, and is an open source container cluster management system.

In some exemplary implementation modes, one edge computing device may deploy multiple AI services, and each AI service may be implemented through one independent container, thereby achieving addition, monitoring, and maintenance of new services without affecting another service.

In some exemplary implementation modes, the configuration server is further configured to: compile and generate a new dynamic library and/or an executable file when updating the edge application; form a container mirror image file according to the new dynamic library and/or the executable file; and distribute the container mirror image file to the edge computing device to replace the dynamic library and/or the executable file of the current edge applicat

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a U.S. National Phase Entry of International Application No. PCT/CN2023/092262 having an international filing date of May 5, 2023, which claims priority to Chinese patent application No. 202210546081.X, filed to the CNIPA on May 18, 2022 and entitled “Service Management Method and System, and Configuration Server and Edge Computing Device”, contents of the above-identified applications should be regarded as being incorporated herein by reference.

TECHNICAL FIELD

Embodiments of the present disclosure relates to, but is not limited to, the technical field of intelligent systems, in particular to a service management method, a system, a configuration server, and an edge computing device.

BACKGROUND

Edge computing refers to an edge device platform, which integrates network, computing, storage, and application core capabilities on a side close to a source of objects or data, provides a nearest end service nearby. Its application programs are initiated on an edge side, which produces a faster network service response and meets basic requirements of the industry in real-time service, application intelligence, security and privacy protection, etc. Cloud computing may receive or access historical data of the edge computing in real time.

SUMMARY

An embodiment of the present disclosure provides a service management system including a configuration server, an edge computing device, a terminal device, and a display device, wherein the edge computing device, the terminal device, and the display device are all local devices, and the configuration server is a cloud device, wherein the configuration server is configured to provide a front-end configuration page and receive configuration information through the front-end configuration page, the configuration information includes the edge computing device, the terminal device, and a required Artificial Intelligence (AI) service, wherein the AI service includes one or more edge applications; perform edge application deployment on the edge computing device according to the configuration information; and receive an inference result of the edge computing device; the edge computing device is configured to acquire a multimedia data stream of the terminal device according to a deployed edge application, and perform application inference according to the acquired multimedia data stream to obtain the inference result; and the display device is configured to display according to the inference result.

An embodiment of the present disclosure also provides a service management method, including: a configuration server receives configuration information through a front-end configuration page, wherein the configuration information includes an edge computing device, a terminal device, and a required AI service, wherein the AI service includes one or more edge applications; the configuration server performs edge application deployment on the edge computing device according to the configuration information; and the configuration server receives an inference result of the edge computing device.

An embodiment of the present disclosure also provides a configuration server, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above based on instructions stored in the memory.

An embodiment of the present disclosure also provides a service management method, including: an edge computing device receives a container mirror image file, wherein the container mirror image file includes a configuration file, an executable file, a dynamic library, and an algorithm model; the edge computing device performs edge application deployment according to the container mirror image file; and the edge computing device acquires a multimedia data stream of the terminal device according to a deployed edge application, and performs application inference according to the acquired multimedia data stream to obtain an inference result.

An embodiment of the present disclosure also provides an edge computing device, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above based on instructions stored in the memory.

An embodiment of the present disclosure also provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the service management method according to any one of the above is implemented.

Other features and advantages of the present disclosure will be set forth in following specification, and moreover, partially become apparent from the specification, or are understood by implementing the present disclosure. Other advantages of the present disclosure may be achieved and obtained through solutions described in the specification and drawings.

BRIEF DESCRIPTION OF DRAWINGS

Accompany drawings are used for providing further understanding of technical solutions of the present disclosure, and constitute a part of the specification. The accompany drawings, together with the embodiments of the present disclosure, are used for explaining the technical solutions of the present disclosure, and do not constitute limitations on the technical solutions of the present disclosure.

FIG. 1 is a schematic architecture diagram of a service management system according to an exemplary embodiment of the present disclosure.

FIG. 2 is a schematic flowchart of a service management method according to an exemplary embodiment of the present disclosure.

FIG. 3 is a schematic flowchart of another service management method according to an exemplary embodiment of the present disclosure.

FIG. 4 is a schematic flowchart of yet another service management method according to an exemplary embodiment of the present disclosure.

FIG. 5 is a schematic diagram of a service inference flow of an edge computing device according to an exemplary embodiment of the present disclosure.

FIG. 6 is a schematic architecture diagram of another service management system according to an exemplary embodiment of the present disclosure.

FIG. 7 is a schematic diagram of a cloud service and an edge service according to an exemplary embodiment of the present disclosure.

FIG. 8 is a schematic diagram of another cloud service and edge service according to an exemplary embodiment of the present disclosure.

FIG. 9 is a schematic diagram of a Kubernetes (K8S) service framework.

FIG. 10 is a schematic diagram of an Internet of Things edge service according to an exemplary embodiment of the present disclosure.

FIG. 11 is a schematic diagram of a structure of a service management system according to an exemplary embodiment of the present disclosure.

FIG. 12 is a schematic diagram of a structure of an edge gateway according to an exemplary embodiment of the present disclosure.

FIG. 13 is a schematic diagram of an edge node management flow according to an exemplary embodiment of the present disclosure.

DETAILED DESCRIPTION

To make objectives, the technical solutions, and advantages of the present disclosure clearer, the embodiments of the present disclosure will be described in detail below in combination with the accompany drawings. It is to be noted that the embodiments in the present disclosure and features in the embodiments may be randomly combined with each other if there is no conflict.

Unless otherwise defined, technical terms or scientific terms used in the embodiments of the present disclosure should have usual meanings understood by those of ordinary skills in the art to which the present disclosure belongs. “First”, “second”, and similar terms used in the embodiments of the present disclosure do not represent any order, quantity, or importance, but are only used for distinguishing different components. “Include”, “contain”, or a similar term means that an element or article appearing before the term covers an element or article and equivalent thereof listed after the term, and other elements or articles are not excluded.

As shown in FIG. 1 , an embodiment of the present disclosure provides a service management system including a configuration server, an edge computing device, a terminal device, and a display device, wherein the edge computing device, the terminal device, and the display device are all local devices, and the configuration server is a cloud device, wherein the configuration server is configured to provide a front-end configuration page and receive configuration information through the front-end configuration page, wherein the configuration information includes an edge computing device, a terminal device, and a required Artificial Intelligence (AI) service, and the AI service includes one or more edge applications; deploy an edge application to the edge computing device according to the configuration information; and receive an inference result of the edge computing device.

The edge computing device is configured to acquire a multimedia data stream of the terminal device according to the deployed edge application, and perform application inference according to the acquired multimedia data stream to obtain an inference result.

The display device is configured to display according to the inference result.

The service management system of the embodiment of the present disclosure undertakes all core computing power through the edge computing device, and the cloud configuration server only associates the edge computing device with the terminal device according to the user demand, distributes the edge application, and displays monitoring information of the bonded edge computing device in real time, and does not participate in a calculation operation process of the edge application. That is, the edge application operation process of the embodiment of the present disclosure is all at an edge end. This kind of architecture design may avoid frequently requesting data from a cloud end, thereby reducing insecurity of the data, reducing network delay, and improving a data processing efficiency and speed. The service management system is not only suitable for a scenario where a public cloud is allowed to participate, but also suitable for a scenario of building a private cloud with only an intranet, such as banks, transportation systems, and public security systems.

In some exemplary implementation modes, deploying the edge application to the edge computing device according to the configuration information includes: generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; generating an edge application resource package, wherein the edge application resource package includes a configuration file, an executable file, a dynamic library, and an algorithm model; and transmitting the edge application resource package to the edge computing device through a network or a storage device.

In an exemplary embodiment, the generated edge application resource package may be transmitted to the edge computing device through a network such as Wireless Fidelity (WiFi), Bluetooth, and a local area network, or may be directly transmitted to the edge computing device through a storage device such as a Universal Serial Bus (USB) flash disk.

In other exemplary implementation modes, deploying the edge application to the edge computing device according to the configuration information includes: generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; forming a container mirror image file according to the configuration file, the executable file, the dynamic library, and the algorithm model; and distributing the container mirror image file to the edge computing device through Kubegde (an open platform that enables edge computing).

In an exemplary embodiment, for the whole service management system, a KubeEdge architecture may be adopted, edge nodes, devices, and workloads are managed in the cloud end through a Kubernetes (K8S for short) standard Application Programming Interface (API), and system upgrades and application updates of edge nodes may be directly distributed from the cloud end, thus improving an efficiency of edge operation and maintenance. The edge computing device may be pre-installed with an edge part at the time of delivery and become a K8S node. The edge application may be distributed through Kubernetes. K8S is a brand-new distributed architecture solution based on a container technology, and is an open source container cluster management system.

In some exemplary implementation modes, one edge computing device may deploy multiple AI services, and each AI service may be implemented through one independent container, thereby achieving addition, monitoring, and maintenance of new services without affecting another service.

In some exemplary implementation modes, the configuration server is further configured to: compile and generate a new dynamic library and/or an executable file when updating the edge application; form a container mirror image file according to the new dynamic library and/or the executable file; and distribute the container mirror image file to the edge computing device to replace the dynamic library and/or the executable file of the current edge application.

A container mirror image file is a hierarchical file system that contains programs and corresponding data that may be run in a Linux kernel. In the embodiment, the container mirror image file includes a dynamic library and an executable file. Therefore, when the dynamic library and/or the executable file are updated, a container mirror image file may be formed according to a new dynamic library and/or executable file. The container mirror image file is distributed to the edge computing device to replace the dynamic library and/or the executable file of the current edge application, which takes less time for distributing and controls update of the program better.

In some exemplary implementation modes, the AI service includes an application layer, a detection and tracking layer, and a personalized service layer, wherein the application layer includes one or more application layer modules, the detection and tracking layer includes one or more detection and tracking modules, and the personalized service layer includes one or more personalized service modules, each module is connected to a main thread in a form of plug-in (different modules may be replaced by plug-in according to different requirements of customers after regular development of a unified interface).

For example, taking a Very Important Person (VIP) recognition service as an example, as shown in FIG. 1 , the main thread of edge computing device includes: continuously pulling a corresponding camera video stream, decoding the video stream, retaining a single frame image, pulling image information, acquiring detection information through a detection module, transmitting detection information to a tracking module to obtain tracking information, then acquiring all face tracking information of this frame, determining whether there is a face, if so, detecting a key point of the face, performing face correction, detecting a face quality value, extracting a face feature vector, acquiring VIP information corresponding to the face, structuring tracking frame coordinates, a face ID, a tracking ID, and other information, and returning to an application layer module. The application layer module receives structural information to form a JavaScript Object Notation (Json) message string, which is output to a display device and a cloud configuration server through message middleware. In actual use, the personalized service layer may provide different personalized services according to different AI services, which is not limited in the embodiment of the present disclosure.

In the main thread, the application layer, the detection and tracking layer, and the personalized service layer are relatively separated, and each module of each layer is developed through plug-in structure. For example, a stream pulling module and a decoding module, etc. of the application layer, a detection module and a tracking module of the detection and tracking layer, a face detection module, a face key point algorithm module, a face correction module, a face quality algorithm module, and a face feature extraction algorithm module, etc. of the personalized service layer may all be designed in a form of plug-in, and each plug-in may be replaced with a same layer plug-in with different functions, thus reducing repeated development of services, keeping clarity of a function of each layer, and making maintenance of the function simpler and clearer.

In some exemplary implementation modes, the AI service includes multiple dynamic libraries compiled according to hardware data packages of different hardware platforms. By including multiple dynamic libraries compiled according to hardware data packages of different hardware platforms in the AI service, hardware of different manufacturers may be directly adapted and reasoned after being processed by the system, thus achieving purposes of rapid development, rapid deployment, and rapid delivery.

In some exemplary implementation modes, the AI service in the configuration information includes: a service name, a quantity of instances of container application, a mirror image name, a mirror image version, a container name, a container specification, and a container network type, wherein the container specification includes Central Processing Unit (CPU) quota, memory quota, whether to use an AI accelerator card, and an AI accelerator card type, and the container network type includes port mapping and host network.

Exemplarily, the AI accelerator card type may include: an Advanced Reduced Instruction Set Computing (RISC) Machines (ARM) mobile terminal or terminal, an Intel Central Processing Unit (CPU), an NVIDIA (which is an artificial intelligence computing company) Graphics Processing Unit (GPU), and an Artificial Intelligence (AI) chip, etc.

When the AI accelerator card type is the ARM mobile terminal or terminal, the system may select a Mobile Neural Network (MNN) and/or a Tensor Virtual Machine (TVM) for model acceleration. When the AI accelerator card type is the Intel CPU, the system may select Open Visual Inference & Neural Network Optimization (Open VINO) and/or TVM for model acceleration. When the AI accelerator card type is the NVIDIA GPU, the system may select TensorRT or TVM for model acceleration. When an AI chip of a specific AI chip manufacturer is used for the AI accelerator card type, an acceleration library of the specific AI chip manufacturer may be selected for model acceleration.

Exemplarily, the acceleration library of the AI chip manufacturer may include: RKNN, Questcore, the Ingenic acceleration library, and BitMain Neural Network SDk (BMNNSDK), etc. Among them, RKNN is specially used for a Rockchip (which is a digital audio and video processing chip company) embedded Neural-network Processing Unit (NPU) chip; Questcore is specially used for an AI chip of the Yitu Technology (which is a network technology Ltd.); the Ingenic Acceleration Library is specially used for an intelligent video chip of Ingenic Semiconductor Co., Ltd. (which is an integrated circuit Co., Ltd.); the BitMain Neural Network SDk (BMNNSDK) is specially used for an AI chip of Computing Energy Technology (which is a science and technology Ltd.). In actual use, the acceleration library of the AI chip manufacturer is not limited to these types listed above, and the present disclosure is not limited thereto.

In an embodiment of the present disclosure, the container network type supports two modes: port mapping and host network.

Among them, in the port mapping mode, a container network is virtualized and isolated, and a container has a separate virtual network, so communication between the container and the outside needs port mapping with a host. When the port mapping is configured, traffic flowing to a host port is mapped to a corresponding container port. For example, if a container port 80 is mapped to a host port 8080 , traffic from the host port 8080 will flow to the container port 80 .

In the host network mode, the container uses a network of a host (edge node), that is, the container and the host use a same Internet Protocol (IP) without network isolation.

In some exemplary implementation modes, the service management system may further include an edge gateway, wherein the edge computing device and the terminal device are connected with each other through the edge gateway; the edge gateway includes multiple pluggable hardware communication protocol plug-ins, and the hardware communication protocol includes at least two of following: 5G, 4G, WIFI, Ethernet, wireless 433 MHz frequency band communication, Bluetooth (BT), infrared, and ZigBee.

As shown in FIG. 2 , a service management method is provided in an embodiment of the present disclosure. The method includes following acts.

Act 201 : a configuration server receives configuration information through a front-end configuration page, wherein the configuration information includes an edge computing device, a terminal device, and a required AI service, wherein the AI service includes one or more edge applications.

Act 202 : the configuration server performs edge application deployment on the edge computing device according to the configuration information.

Act 203 : the configuration server receives an inference result of the edge computing device.

According to the service management method of the embodiment of the present disclosure, the corresponding edge computing device and the terminal device are configured according to the configuration information, and a corresponding edge application is distributed, so that an intelligent application is deployed from a cloud end to an edge in a lightweight manner, and a service demand of users for edge cloud cooperation of the intelligent application is met.

In some exemplary implementation modes, the service management method further includes: the configuration server acquires device monitoring information of the edge computing device, and stores or displays the device monitoring information.

In the embodiment, the configuration server may monitor a hardware usage situation of the edge computing device, and may display an application usage situation of the edge computing device through the configuration page.

In some exemplary implementation modes, the configuration server is located in a central cloud or a private cloud.

According to the service management method of the embodiment of the present disclosure, the edge computing device takes on all core computing power, and the cloud end (exemplarily, the cloud end may be a central cloud end, or a server or a host located in the private cloud) only associates the edge computing device with the terminal device according to a user demand, distributes an edge application and displays monitoring information of the bonded edge computing device in real time, and does not participate in a computing operation process of the edge application. That is, an edge application operation process of the embodiment of the present disclosure is all at an edge end. Under a design of this architecture, the service management method is not only applicable to a scene where a public cloud is allowed to participate, but also suitable for a scene of building a private cloud with only an intranet, such as a bank, a traffic system, and a public security system.

An embodiment of the present disclosure also provides a configuration server, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above embodiments based on instructions stored in the memory.

An embodiment of the present disclosure also provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the service management method according to any one of the above embodiments is implemented.

As shown in FIG. 3 , an embodiment of the present disclosure also provides a service management method. The method includes following acts.

Act 301 : an edge computing device receives a container mirror image file, wherein the container mirror image file includes a configuration file, an executable file, a dynamic library, and an algorithm model.

Act 302 : the edge computing device performs edge application deployment according to the container mirror image file.

Act 303 : the edge computing device acquires a multimedia data stream of a terminal device according to a deployed edge application, and performs application inference according to the acquired multimedia data stream to obtain an inference result.

In some exemplary implementation modes, the service management method further includes: act 304 : the edge computing device sends the inference result to an information publish system to push advertisement information or alarm information corresponding to the inference result through the information publish system.

In the embodiment of the present disclosure, the edge computing device may send the inference result to the information publish system, and the information publish system pushes the advertisement information or alarm information corresponding to the inference result to a display device, and may also directly display the inference result through the display device.

In some exemplary implementation modes, one or more of edge applications constitute an AI service, wherein the AI service includes an application layer, a detection and tracking layer, and a personalized service layer, wherein the application layer includes a stream pulling module, a decoding module, a daemon module, and a device monitoring module, wherein the detection and tracking layer includes a detection module and a tracking module, and the edge computing device performing application inference according to the deployed edge applications includes: the edge computing device pulls a video stream of the terminal device through the stream pulling module, decodes the video stream through the decoding module, outputs a single frame image to the detection and tracking module, obtains device monitoring information through the device monitoring module, and monitors whether the stream pulling module runs normally through the daemon module; the edge computing device performs target detection on the single frame image through the detection module, and tracks a detected target through the tracking module; and the edge computing device receives target detection information and tracking information through a module of the personalized service layer, and performs personalized service inference.

In some exemplary implementation modes, the service management method further includes: the edge computing device selects a target detection model selected by the detection module and a tracking algorithm selected by the tracking module according to a hardware type or user requirements.

In some exemplary implementation modes, the edge computing device may be an edge computing device loaded with an ARM architecture CPU. A computing energy consumption ratio of an ARM CPU device is far lower than that of an X86 architecture CPU. Therefore, the edge computing device equipped with an ARM CPU, even if computing power is slightly lower, has better environmental adaptability because of its characteristics of low power consumption and low calorific value, and does not need to be specially installed in a computer room when deployed in the field. While ab X86 architecture computing device must be equipped with a high-power cooling fan as a compromise of its high power, and because of a great noise of the high-power cooling fan, it must be put into a computer room to ensure a necessary working environment. For different hardware, platforms built by an upper layer will be different.

In some exemplary implementation modes, an algorithm model of the edge computing device is encapsulated in a form of plug-in, and the edge computing device supports heterogeneous hardware such as X86, ARM, Network Processing Unit (NPU), and GPU.

In the embodiment, algorithm models suitable for edge computing devices of different manufacturers are encapsulated through a development form of plug-in to be compatible with edge computing devices of different manufacturers, and the edge computing devices support accelerated inference deployment of various hardware platforms, thus reducing scenarios limited by hardware when in use. After hardware of different manufacturers is processed in the embodiment of the present disclosure, they may be directly adapted and reasoned, thus achieving purposes of rapid development, rapid deployment, and rapid delivery. The service management method of the embodiment of the present disclosure summarizes a set of transplant flows and codes which give consideration to both a development efficiency and inference accuracy through continuous trial and error.

Exemplarily, when the service management method of the embodiment of the present disclosure is applied to an intelligent advertisement recommendation system, the intelligent advertisement recommendation system may include a configuration server, an edge computing device, a terminal device, and an information publish system. As shown in FIG. 4 , a service management process of the intelligent advertisement recommendation system includes: a user inputs configuration information through the configuration server; the configuration server distributes a configuration file and an edge application of a corresponding function according to the configuration information input by the user; the edge computing device receives the configuration file and an installation file, configures a corresponding edge computing device and the terminal device (the information publish system device, a camera, etc.) according to the configuration file, the edge computing device deploys the edge application by using the installation file, performs application inference according to the deployed edge application, obtains an inference result, and sends inference result information to the information publish system, for example, the inference result is information such as gender and age; after continuously receiving the inference result information of the edge computing device for a period of time, the information publish system plays advertisements interested by viewers according to the inference result information, so as to maximize an advertising benefit.

A whole application program is circulated to form the intelligent advertisement recommendation system.

In some exemplary implementation modes, as shown in FIG. 5 , an inference flow of the edge computing device includes: the user configures the edge computing device, the terminal device, and a required Artificial Intelligence (AI) application (i.e., edge application) through a front-end configuration page; the configuration server analyzes user configuration information, associates a corresponding edge computing device and terminal device, acquires monitoring information of the edge computing device and the terminal device, generates a configuration file, acquires an executable file and a dependent dynamic library required by a corresponding AI application in an AI Container management platform, and packages files and distributes them to the edge computing device; the edge computing device receives the packaged files and completes configuration and AI application installation; the application layer continuously pulls a video stream, decodes the pulled video stream, starts a corresponding service process according to the configuration file and sends corresponding structural information, wherein the structural information includes a decoded single frame image; the detection and tracking layer extracts the single frame image, acquires a multi-objective detection frame and corresponding information through a multi-objective detection model, and transmits the detection frame to a tracking algorithm to obtain a tracking ID, a tracking frame, and other tracking information; the personalized service layer acquires all face tracking information of the frame, including the tracking ID, tracking frame coordinates, and an original picture of the frame, determines whether there is a face in a detection result, if not, the process returns to a detection tracking module, if yes, cyclically uses the corresponding tracking frame coordinates and the original picture to dig out the face according to a quantity of detected faces, sends a face matting into a face key point model to obtain face key points, performs face correction according to the face key points, transmits a corrected face image into a face quality model to obtain a face quality value, determines whether the face is a highest quality face in the frame, if not, the process returns to dig out a next face matting until the highest quality face in the frame is obtained; determines whether the highest quality face in the frame exceeds a lowest quality threshold, if not, the process returns to the detection and tracking module, if yes, determines a next service process according to a service selected by a customer, for example, assuming that the service selected by the customer is a gender and age detection service, transmits the face matting to a face attribute model to obtain a gender and an age; assuming that the service selected by the customer is a Very Important Person (VIP) detection service, the face matting is transmitted into a face feature extraction model to obtain face feature information, and extracted feature information is compared with a VIP feature library to get whether it is VIP information; forms a service inference result information into a structure and transmits it back to the application layer; the application layer receives the service inference result to form a Json message string, and sends out a message through message middleware. Herein, the Json message string is a kind of storage format of message information, which facilitates unification of information formats, and the message middleware is a module supporting various message sending protocols, such as Message Queue Telemetry Transmission (MQTT) or Kafka; the edge computing device run a device monitoring executable file, acquires information such as Central Processing Unit (CPU), Graphics Processing Unit (GPU), A running memory, hard disk storage, and a device temperature, forms a Json message string, and sends out a message through the message middleware.

The message sent through the message middleware may be displayed through a web page or sent to the information publish system, and the information publish system is a terminal control system that receives information and issues commands. According to the inference result, the information publish system pushes advertisement information or alarm information corresponding to the inference result.

In order to ensure real-time performance of multi-objective detection and tracking and face recognition in a service, for the multi-objective detection model and other face-related models, TensorRT (an inference accelerator) or a bit continent network model compression tool is used to carry out operator fusion, Kernel function optimization, weight quantization processing, etc. on a model, and a throughput performance is optimized under a condition of acceptable precision loss, so as to ensure a real-time prediction ability when deployed and run on the edge end and a small computing device.

The edge computing device sends a final inference result to the information publish system through the message middleware. After continuously receiving a stable inference result sent by the edge computing device, the information publish system puts a corresponding advertisement picture or video on an advertisement screen or the financial screen according to the inference result, so as to maximize an advertisement benefit. The embodiment of the present disclosure combines an edge computing platform with artificial intelligence as a core with an information publish system to form an intelligent advertisement recommendation system which may be widely used.

The embodiment of the present disclosure abstracts development of edge end services into an edge computing platform, a core of the edge computing platform is AI applications, and each AI application includes three layers in structure: an application layer, a detection and tracking layer, and a personalized service layer, and the three layers are kept relatively separated to form a plug-in structure. Each plug-in in the platform may be replaced with a plug-in of a same layer with different functions, which reduces repeated development of a service, keeps functions of each layer clear, makes maintenance of functions simpler and clearer, improves a development efficiency, and reduces a difficulty of troubleshooting programs (debug) after development.

The embodiment of the present disclosure unifies detection (integrating detection of head, face, human body, motor vehicle, non-motor vehicle, etc.) and tracking (integrating tracking algorithms such as Sort and DeepSort) into the detection and tracking layer, which is used as a basic service of machine vision applied to video stream processing to uniformly output a detection and tracking result, which is convenient for program management and logic clarity. Business developers do not need to worry about content of detection and tracking when developing a new service. All video stream detection and tracking results will be directly output through the detection and tracking layer, and developers only need to obtain required content from them and complete an identification or classification task. In addition, the detection and tracking layer also performs a plug-in processing, and different detection algorithms and tracking algorithms are regularly developed through a unified interface, a plug-in may be replaced according to different hardware performances and customer requirements. For example, when computing power of the edge computing device is relatively small, a model with a relatively small parameter in a YOLOv5 target detection algorithm may be selected as a plug-in for unified detection, and Sort with less computing resource consumption may be used as a tracking algorithm. If the computing power of edge computing device is relatively large, an m or s model in YOLOv5 may be selected as a target detection model, and DeepSort, which consumes more computing resources but has good accuracy, may be used as a tracking algorithm, which may reduce a development cost and speed up a development progress.

According to the embodiment of the present disclosure, after receiving a user request through the cloud end, corresponding three levels of modules are selected according to the user request, and the three levels of modules (a source code is not distributed, only a compiled executable file and a dynamic library are distributed) are distributed to each edge computing device, all applications and services are completed in the edge computing device, that is, all modules for completing core calculation are completed at the edge end, and the cloud end is only used as a user configuration interface. A central cloud manages edge computing devices and devolves core computing to the edge computing devices, thus sharing a computing burden of the central cloud and improve real-time performance of an overall application which may greatly reduce a deployment cost and a development cost.

Each AI application of the embodiment of the present disclosure includes three layers in structure: an application layer, a detection and tracking layer, and a personalized service layer. Each layer includes multiple modules, which are connected into a data Pipeline (i.e., main thread) in a form of plug-in. According to different scenarios and service requirements, different modules are selected to be connected and compiled to form AI applications matching requirements, and new plug-ins are continuously added to adapt to more service scenarios and make the platform more efficient and stable.

The application layer may include a decoding module, an encoding module, a stream pulling module, a stream pushing module, a device monitoring module, a configuration management module, a data processing module, and a daemon module, etc.

The AI service provided by the present disclosure may include a VIP identification service, a gender identification service, a forbidden zone intrusion service, a bird eviction service, a hot zone statistics service, and the like.

The personalized service layer may include multiple basic algorithm modules. Exemplarily, the basic algorithm modules may include a face key point algorithm module, a face quality algorithm module, a face attribute algorithm module, a face feature extraction algorithm module, a vehicle brand recognition algorithm module, a vehicle color recognition algorithm module, an Optical Character Recognition (OCR) algorithm module, and the like.

An embodiment of the present disclosure also provides an edge computing device, which includes a memory; and a processor coupled to the memory, wherein the processor is configured to perform acts of the service management method as described in any of the above embodiments based on instructions stored in the memory.

An embodiment of the present disclosure also provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the service management method according to any one of the above embodiments is implemented. A method of driving service management of an edge computing device by executing executable instructions is basically the same as the service management method provided by the above embodiments of the present disclosure, and will not be described again here. An embodiment of the present disclosure provides a service management system based on an edge cloud, which relies on a cloud native technology to construct an edge cloud collaboration system, may run on various edge computing devices, and deploys rich intelligent applications such as AI, Internet of Things (IOT), and data analysis from a cloud end to an edge in a lightweight manner, thus meeting service demands of users for edge cloud collaboration of intelligent applications.

Users configure edge devices, AI functions, cameras, and other parameters in the cloud end, and send them to edge devices in a form of containers after editing and confirmation.

The edge computing device supports heterogeneous hardware access such as X86, ARM, NPU, and GPU, extends a capability of the central cloud to the edge, completes video intelligent analysis, text recognition, image recognition, big data stream processing, and other capabilities, and provides real-time intelligent analysis services nearby.

As an edge node, the edge computing device is safely connected to the cloud end, and application data is safely connected to the cloud.

The central cloud performs management, monitoring, and operation in a unified way, is compatible with native Kubernetes and Docker ecology, and supports management in forms of containers and function applications.

An embodiment of the present disclosure may provide three cloud computing service modes: Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software-as-a-Service (Saas). By designing rich intelligent edge applications, the embodiment of the present disclosure provides more than 50 AI models such as stream processing, video analysis, text recognition, image recognition, etc. to be deployed to edge nodes for operation, and provides collaborative capabilities of edge applications and services on the cloud. Application details may be viewed in an edge application center and applications are deployed to edge nodes, thus providing users with a low-cost, out-of-the-box, and centralized operation and maintenance solution on the cloud.

As shown in FIG. 6 , an embodiment of the present disclosure may provide a complete set of end-to-end application solutions, and an input end may be terminal devices such as images, audio and video, sensors, content production, etc., and access an edge computing device through a connection technology such as 5G, 4G, WIFI, Ethernet, wireless 433 MHz band communication, Bluetooth, infrared, and ZigBee. An edge cloud is expansion of a cloud capability at an edge, which is divided into an edge application, an edge platform, and an edge infrastructure. The edge application includes more than 50 AI services such as face control and forbidden zone alarm. The edge platform provides services such as algorithm inference, application management, Internet of Things (IOT) management, configuration management, and device management to support service applications. The edge infrastructure supports a mainstream AI chip architecture such as ARM, NPU, X86, and RISC-V, as well as storage and network, and may be deployed in smart devices and computing nodes of different orders of magnitude.

The service management system of the embodiment of the present disclosure mainly includes three parts: a terminal device, an edge computing device, and a cloud device.

1. Terminal Device

The terminal device is connected to an Internet of Things (IOT) application development platform, and a non-standard device is converted into a standard object model, and connected to a gateway nearby, so as to achieve management and control of a device.

2. Edge Computing Device

After the terminal device is connected to an edge gateway, the edge gateway may achieve collection, circulation, storage, analysis, and reporting of device data to a cloud end. At the same time, the gateway provides a rule engine and a function calculation engine, which is convenient for scene arrangement and service expansion.

3. Cloud Device

After the device data is uploaded to the cloud end, it may combine with functions of a central cloud, such as big data and AI learning, and achieve more functions and applications through a standard API interface.

As shown in FIG. 7 , the terminal device accesses the edge computing device through a variety of device access protocols, the terminal device includes, but are not limited to, a camera, a Network Video Recorder (NVR), a sensor, and the like. The edge computing device (i.e., an edge node, an edge cloud) supports edge access, device management, data cleaning, scene linkage, edge console, container management, function management, and video stream processing capabilities, while the cloud end (central cloud) supports services such as edge node management, application deployment management, configuration management, data security, data synchronization, and cloud console. The system manages gateways and sub-devices related to the edge end by instance, and may also manage scene linkage, function calculation, stream data analysis, and message routing content. Resources in an edge instance are deployed to the gateways by deploying the instance.

The system provides a variety of device access protocols, so that the terminal device may easily acces

CLAIMS

Claims ( 20 )

1 . A service management system, comprising a configuration server, an edge computing device, a terminal device, and a display device, wherein the edge computing device, the terminal device, and the display device are all local devices, and the configuration server is a cloud device, wherein:

the configuration server is configured to provide a front-end configuration page and receive configuration information through the front-end configuration page, the configuration information comprises the edge computing device, the terminal device, and a required Artificial Intelligence (AI) service, wherein the AI service comprises one or more edge applications; perform edge application deployment on the edge computing device according to the configuration information; and receive an inference result of the edge computing device; the edge computing device is configured to acquire a multimedia data stream of the terminal device according to a deployed edge application, and perform application inference according to the acquired multimedia data stream to obtain the inference result; and the display device is configured to display according to the inference result.

2 . The service management system according to claim 1 , wherein performing edge application deployment on the edge computing device according to the configuration information comprises:

generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; generating an edge application resource package, wherein the edge application resource package comprises a configuration file, an executable file, a dynamic library, and an algorithm model; and transmitting the edge application resource package to the edge computing device through a network or a storage device.

3 . The service management system according to claim 1 , wherein performing edge application deployment on the edge computing device according to the configuration information comprises:

generating a configuration file according to the configuration information; acquiring an executable file, a dynamic library, and an algorithm model corresponding to the AI service in the configuration information; forming a container mirror image file according to the configuration file, the executable file, the dynamic library, and the algorithm model; and distributing the container mirror image file to the edge computing device through Kubegde.

4 . The service management system according to claim 3 , wherein one edge computing device deploys a plurality of AI services, each of the AI services is implemented through one independent container.

5 . The service management system according to claim 3 , wherein the configuration server is further configured to

compile and generate a new dynamic library and/or executable file when updating the edge application; form a container mirror image file according to the new dynamic library and/or executable file; and distribute the container mirror image file to the edge computing device to replace the dynamic library and/or executable file of the current edge application.

6 . The service management system according to claim 1 , wherein the AI service comprises an application layer, a detection and tracking layer, and a personalized service layer, wherein the application layer comprises one or more application layer modules, the detection and tracking layer comprises one or more detection and tracking modules, and the personalized service layer comprises one or more personalized service modules, each module is connected to a main thread in a form of plug-in.

7 . The service management system according to claim 1 , wherein the AI service comprises a plurality of dynamic libraries compiled according to hardware data packages of different hardware platforms.

8 . The service management system according to claim 1 , wherein the AI service in the configuration information comprises: a service name, a quantity of instances of a container application, a mirror image name, a mirror image version, a container name, a container specification, and a container network type, wherein the container specification comprises Central Processing Unit (CPU) quota, memory quota, whether an AI accelerator card is used, an AI accelerator card type, and the container network type comprises port mapping and host network.

9 . The service management system according to claim 1 , further comprising an edge gateway, wherein:

the edge computing device and the terminal device are connected with each other through the edge gateway; the edge gateway comprises a plurality of pluggable hardware communication protocol plug-ins, and a hardware communication protocol comprises at least two of following: 5G, 4G, Wireless Fidelity (WiFi), Ethernet, wireless 433 MHz frequency band communication, Bluetooth, infrared, and ZigBee.

10 . A service management method, comprising:

receiving, by a configuration server, configuration information through a front-end configuration page, wherein the configuration information comprises an edge computing device, a terminal device, and a required Artificial Intelligence (AI) service, wherein the AI service comprises one or more edge applications; performing, by the configuration server, edge application deployment on the edge computing device according to the configuration information; and receiving, by the configuration server, an inference result of the edge computing device.

11 . The service management method according to claim 10 , further comprising:

acquiring, by the configuration server, device monitoring information of the edge computing device, and storing or displaying the device monitoring information.

12 . The service management method according to claim 10 , wherein the configuration server is located in a central cloud end or a private cloud end.

13 . A configuration server, comprising a memory and a processor coupled to the memory, wherein the processor is configured to perform acts of a service management method according to claim 10 based on instructions stored in the memory.

14 . A non-transitory computer storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, a service management method according to claim 10 is implemented.

15 . A service management method, comprising:

receiving, by an edge computing device, a container mirror image file, wherein the container mirror image file comprises a configuration file, an executable file, a dynamic library, and an algorithm model; performing, by the edge computing device, edge application deployment according to the container mirror image file; and acquiring, by the edge computing device, a multimedia data stream of the terminal device according to a deployed edge application, and performing application inference according to the acquired multimedia data stream to obtain an inference result.

16 . The service management method according to claim 15 , further comprising:

sending, by the edge computing device, the inference result to an information publish system to push advertisement information or alarm information corresponding to the inference result through the information publish system.

17 . The service management method according to claim 15 , wherein one or more of edge applications constitute an Artificial Intelligence (AI) service, wherein the AI service comprises an application layer, a detection and tracking layer, and a personalized service layer, wherein the application layer comprises a stream pulling module, a decoding module, a daemon module, and a device monitoring module, wherein the detection and tracking layer comprises a detection module and a tracking module, and performing by the edge computing device application inference according to the deployed edge applications comprises:

pulling, by the edge computing device, a video stream of the terminal device through the stream pulling module, decoding the video stream through the decoding module, outputting a single frame image to the detection and tracking module, obtaining device monitoring information through the device monitoring module, and monitoring whether the stream pulling module runs normally through the daemon module; performing, by the edge computing device, target detection on the single frame image through the detection module, and tracking a detected target through the tracking module; and receiving, by the edge computing device, target detection information and tracking information through a module of the personalized service layer, and performing personalized service inference.

18 . An edging computing device, comprising a memory and a processor coupled to the memory, wherein the processor is configured to perform acts of a service management method according to claim 15 based on instructions stored in the memory.

19 . A non-transitory computer storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, a service management method according to claim 15 is implemented.

20 . A configuration server, comprising a memory and a processor coupled to the memory, wherein the processor is configured to perform acts of a service management method according to claim 11 based on instructions stored in the memory.

US18/705,535

2022-05-18

2023-05-05

Service management method and system, and configuration server and edge computing device

Pending

US20260156193A1

( en )

Applications Claiming Priority (3)

Application Number

Priority Date

Filing Date

Title

CN202210546081.XA

CN114979246B

( en )

2022-05-18

2022-05-18

Service management method, system, configuration server and edge computing device

CN202210546081.X

2022-05-18

PCT/CN2023/092262

WO2023221781A1

( en )

2022-05-18

2023-05-05

Service management method and system, and configuration server and edge computing device

Publications (1)

Publication Number

Publication Date

US20260156193A1

true

US20260156193A1 ( en )

2026-06-04

Family

ID=82985883

Family Applications (1)

Application Number

Title

Priority Date

Filing Date

US18/705,535

Pending

US20260156193A1

( en )

2022-05-18

2023-05-05

Service management method and system, and configuration server and edge computing device

Country Status (3)

Country

Link

US

( 1 )

US20260156193A1

( en )

CN

( 1 )

CN114979246B

( en )

WO

( 1 )

WO2023221781A1

( en )

Families Citing this family (42)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

CN114979246B

( en )

*

2022-05-18

2024-08-16

京东方科技集团股份有限公司

Service management method, system, configuration server and edge computing device

CN115525409A

( en )

*

2022-08-31

2022-12-27

武汉光庭信息技术股份有限公司

Big data batch processing process control system and method

CN116310929A

( en )

*

2022-09-09

2023-06-23

北京安信科创软件有限公司

A method for intelligent identification of gas station monitoring video

CN115527213A

( en )

*

2022-09-20

2022-12-27

上海弘玑信息技术有限公司

Document character recognition method and electronic equipment

CN115658229A

( en )

*

2022-10-28

2023-01-31

杭州半云科技有限公司

An artificial intelligence algorithm application management method based on cloud-edge-device architecture

CN115761794A

( en )

*

2022-10-28

2023-03-07

杭州谐云科技有限公司

A method and system for deduplication of personnel based on cloud-edge collaboration

CN116132488B

( en )

*

2022-12-08

2025-05-23

南方电网数字平台科技(广东)有限公司

Physical terminal control method and system based on edge technology

CN116016467B

( en )

*

2022-12-14

2025-10-24

苏州华启智能科技有限公司

Train network optimization method, system and storage medium based on streaming media application

CN116048541B

( en )

*

2023-01-18

2025-10-17

京东方科技集团股份有限公司

Model deployment method, device, electronic equipment and readable storage medium

CN116309394A

( en )

*

2023-02-28

2023-06-23

联合汽车电子有限公司

Defect detection edge system, defect detection cloud system and defect detection method

CN120981792A

( en )

*

2023-04-28

2025-11-18

西门子股份公司

Methods, systems, devices and media for deploying artificial intelligence models in edge devices

CN116661944A

( en )

*

2023-05-15

2023-08-29

桂林电子科技大学

Enterprise sewage monitoring system and method based on the combination of cloud-native edge computing and AI

CN121039616A

( en )

*

2023-05-19

2025-11-28

索尼集团公司

Information processing apparatus, information processing method and program

CN116781476B

( en )

*

2023-06-30

2024-03-22

索提斯云智控科技(上海)有限公司

Node type edge computing system

CN116800752B

( en )

*

2023-07-11

2024-01-30

无锡隆云数字技术有限公司

Distributed public cloud deployment system and method

CN116743845B

( en )

*

2023-08-15

2023-11-03

中移(苏州)软件技术有限公司

Edge service discovery method, device, node equipment and readable storage medium

CN116866356B

( en )

*

2023-08-25

2024-11-22

山东智拓大数据有限公司

A cloud server service scheduling method and device

CN117041049A

( en )

*

2023-08-31

2023-11-10

湖南大学

A device management platform integrating edge and cloud

CN117372929B

( en )

*

2023-10-23

2026-08-04

山东交通学院

Multi-channel video big data real-time analysis method and system based on cloud edge end cooperation

CN117596246B

( en )

*

2024-01-12

2024-09-03

山东省计算中心（国家超级计算济南中心）

Computing network workflow scheduling method and system based on heterogeneous resource measurement characteristics

CN117826694A

( en )

*

2024-03-06

2024-04-05

北京和利时系统集成有限公司

Intelligent electromechanical system

CN118337781B

( en )

*

2024-03-14

2024-11-05

山东爱特云翔信息技术有限公司

Method and system for scheduling distributed heterogeneous computing power of urban brain AI computing center

CN118509488A

( en )

*

2024-03-28

2024-08-16

浪潮通信技术有限公司

Terminal calculation power nano-tube method, platform, electronic equipment and storage medium

CN118233461B

( en )

*

2024-04-17

2024-08-30

安徽大学

Data set placement method based on edge cloud collaborative computing

CN118642685A

( en )

*

2024-06-21

2024-09-13

中国科学院空天信息创新研究院

A method for constructing a big earth data analysis and decision support system

CN118939412B

( en )

*

2024-07-11

2025-07-25

中国司法大数据研究院有限公司

Cloud edge collaborative optimization balanced deployment method with delay assurance

CN118784727A

( en )

*

2024-07-16

2024-10-15

中国电信股份有限公司技术创新中心

Service node scheduling method, device, computer equipment, storage medium and program product

CN119048457A

( en )

*

2024-08-15

2024-11-29

浪潮智能终端有限公司

Pulmonary CT image processing system and method based on end-edge cloud architecture

CN119271393B

( en )

*

2024-08-30

2026-01-30

四川瑞霆智汇科技有限公司

An architectural approach based on video edge AI inference clusters

CN119168706B

( en )

*

2024-09-06

2026-03-17

杭州萤石软件有限公司

Advertising delivery systems, methods, devices, electronic equipment, storage media and products

CN119149059B

( en )

*

2024-10-31

2025-03-21

杭州海康威视数字技术股份有限公司

Model deployment method, model operation method

CN119179579A

( en )

*

2024-11-15

2024-12-24

中国人民财产保险股份有限公司

Model calling method and related equipment

CN119788689B

( en )

*

2024-11-27

2026-05-15

天翼云科技有限公司

Edge cluster node tag synchronization methods, devices, electronic devices, storage media, and software products

CN119646076B

( en )

*

2024-12-02

2026-01-09

天翼云科技有限公司

Database access method, apparatus, device, storage medium, and program product

CN119814787B

( en )

*

2025-01-10

2025-06-20

安徽新华学院

System integration architecture and collaborative computing method for cloud computing and edge computing collaboration

CN119781803B

( en )

*

2025-03-07

2025-05-30

宁波数益工联科技有限公司

Operation and maintenance system, method, equipment and medium of industrial Internet of things platform

CN120255906B

( en )

*

2025-06-09

2025-08-15

浙江海控南科华铁数智科技股份有限公司

Quick deployment-oriented large-model soft and hard all-in-one machine optimization method and device

CN120342877B

( en )

*

2025-06-19

2025-08-26

三峡高科信息技术有限责任公司

Method, device and equipment for hybrid orchestration of AI services and microservices in cloud-edge collaboration

CN121255215B

( en )

*

2025-09-23

2026-06-05

同方知网数字科技有限公司

A tool deployment method, system, and device based on a model context protocol.

CN120915798B

( en )

*

2025-09-25

2026-04-07

中移(苏州)软件技术有限公司

Server information collection and updating methods, devices, systems, media, products and equipment

CN121239813A

( en )

*

2025-09-26

2025-12-30

武汉市公安局视频侦查支队

Yun Bianduan cooperatively executed video monitoring system, method, equipment and medium

CN121968142A

( en )

*

2025-12-08

2026-05-01

华能内蒙古东部能源有限公司

Edge computing node deployment method and system suitable for 5G industrial private network

Citations (11)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20130339928A1

( en )

*

2012-06-18

2013-12-19

Microsoft Corporation

Adaptive portable libraries

US20160343145A1

( en )

*

2009-02-02

2016-11-24

Eyesight Mobile Technologies Ltd.

System and method for object recognition and tracking in a video stream

US20200356415A1

( en )

*

2019-05-07

2020-11-12

Nutanix, Inc.

Apparatus and method for depoying a machine learning inference as a service at edge systems

US20210042217A1

( en )

*

2019-08-09

2021-02-11

International Business Machines Corporation

Dynamic Automation of DevOps Pipeline Vulnerability Detecting and Testing

US20210081219A1

( en )

*

2016-12-05

2021-03-18

Tencent Technology (Shenzhen) Company Limited

Plugin loading method and apparatus, terminal, and storage medium

US20220303176A1

( en )

*

2021-03-12

2022-09-22

Cypress Semiconductor Corporation

Efficient optimization for neural network deployment and execution

US20220342649A1

( en )

*

2021-04-21

2022-10-27

Hewlett Packard Enterprise Development Lp

Deployment and configuration of an edge site based on declarative intents indicative of a use case

US20230091915A1

( en )

*

2021-09-22

2023-03-23

International Business Machines Corporation

Automatic Application of Software Updates to Container Images Based on Dependencies

US20230300195A1

( en )

*

2019-04-09

2023-09-21

Johnson Controls Tyco IP Holdings LLP

Intelligent edge computing platform with machine learning capability

US20230359926A1

( en )

*

2022-05-09

2023-11-09

Dell Products L.P.

Domain adaptation of event detection models: from simulation to large scale logistics environments

US11936757B1

( en )

*

2022-04-29

2024-03-19

Rafay Systems, Inc.

Pull-based on-demand application deployment to edge node

Family Cites Families (11)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

ES2886868T3

( en )

*

2015-08-27

2021-12-21

Foghorn Systems Inc

Edge intelligence platform, and sensor flow system of the internet of things

US10659526B2

( en )

*

2018-01-03

2020-05-19

Verizon Patent And Licensing Inc.

Edge compute systems and methods

CN111459605A

( en )

*

2020-02-26

2020-07-28

浙江工业大学

A Docker-based edge computing gateway virtualization method

CN112188164A

( en )

*

2020-09-29

2021-01-05

爱动超越人工智能科技（北京）有限责任公司

AI vision-based violation real-time monitoring system and method

CN112272234B

( en )

*

2020-10-23

2023-02-21

杭州卷积云科技有限公司

Platform management system and method for realizing edge cloud cooperation intelligent service

CN113420603A

( en )

*

2021-05-27

2021-09-21

南京四维向量科技有限公司

Employee efficiency tracking system based on Atlas edge computing equipment

CN113708974A

( en )

*

2021-09-03

2021-11-26

南方电网数字电网研究院有限公司

Edge cloud network system based on self-adaptive networking and cooperation method

CN114093505B

( en )

*

2021-11-17

2022-06-17

山东省计算中心（国家超级计算济南中心）

Cloud-edge-end-architecture-based pathological detection system and method

CN114490063B

( en )

*

2022-01-25

2025-07-25

京东方科技集团股份有限公司

Service management method, platform, service delivery system and computer storage medium

CN114138501B

( en )

*

2022-02-07

2022-06-14

杭州智现科技有限公司

Processing method and device for edge intelligent service for field safety monitoring

CN114979246B

( en )

*

2022-05-18

2024-08-16

京东方科技集团股份有限公司

Service management method, system, configuration server and edge computing device

2022

2022-05-18

CN

CN202210546081.XA

patent/CN114979246B/en

active

Active

2023

2023-05-05

US

US18/705,535

patent/US20260156193A1/en

active

Pending

2023-05-05

WO

PCT/CN2023/092262

patent/WO2023221781A1/en

not_active

Ceased

Patent Citations (11)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20160343145A1

( en )

*

2009-02-02

2016-11-24

Eyesight Mobile Technologies Ltd.

System and method for object recognition and tracking in a video stream

US20130339928A1

( en )

*

2012-06-18

2013-12-19

Microsoft Corporation

Adaptive portable libraries

US20210081219A1

( en )

*

2016-12-05

2021-03-18

Tencent Technology (Shenzhen) Company Limited

Plugin loading method and apparatus, terminal, and storage medium

US20230300195A1

( en )

*

2019-04-09

2023-09-21

Johnson Controls Tyco IP Holdings LLP

Intelligent edge computing platform with machine learning capability

US20200356415A1

( en )

*

2019-05-07

2020-11-12

Nutanix, Inc.

Apparatus and method for depoying a machine learning inference as a service at edge systems

US20210042217A1

( en )

*

2019-08-09

2021-02-11

International Business Machines Corporation

Dynamic Automation of DevOps Pipeline Vulnerability Detecting and Testing

US20220303176A1

( en )

*

2021-03-12

2022-09-22

Cypress Semiconductor Corporation

Efficient optimization for neural network deployment and execution

US20220342649A1

( en )

*

2021-04-21

2022-10-27

Hewlett Packard Enterprise Development Lp

Deployment and configuration of an edge site based on declarative intents indicative of a use case

US20230091915A1

( en )

*

2021-09-22

2023-03-23

International Business Machines Corporation

Automatic Application of Software Updates to Container Images Based on Dependencies

US11936757B1

( en )

*

2022-04-29

2024-03-19

Rafay Systems, Inc.

Pull-based on-demand application deployment to edge node

US20230359926A1

( en )

*

2022-05-09

2023-11-09

Dell Products L.P.

Domain adaptation of event detection models: from simulation to large scale logistics environments

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party

Title

Kubernetes, T. (2019). Kubernetes. Kubernetes. Retrieved May, 24, 2019 (Year: 2019)

*

Also Published As

Publication number

Publication date

CN114979246A

( en )

2022-08-30

WO2023221781A1

( en )

2023-11-23

CN114979246B

( en )

2024-08-16

Legal Events

Date

Code

Title

Description

2026-03-25

STPP

Information on status: patent application and granting procedure in general

Free format text : NON FINAL ACTION MAILED

2026-06-08

STPP

Information on status: patent application and granting procedure in general

Free format text : RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

Related documents

• Untitled ItServiceNow IT Operations Management (ITOM) Implementation and Consulting Servicesem#311464
• Transparent Interconnection of Lots of Links (TRILL) Operations, Administration, and Maintenance (OAM) MIB#502043
• Desarrollo de una aplicación Web libre en un entorno RIA para el diseño y emulación de redes LAN construidas con topologías en estrella y estrella extendida#1167935
• Artificial intelligence based system and method for managing heterogeneous … — Newspace Research And Technologies Pvt. Ltd. (US12638863B2)#1329533
• Final text of DIS 8473, Protocol for Providing the Connectionless-mode Network Service#502784