Google Patentsopen access

Cloud-based fleet and asset management for edge computing of machine learning … — Armada Systems Inc. (US11876858B1)

ABSTRACT

Abstract

A process can include receiving monitoring information associated with a machine learning (ML) or artificial intelligence (AI) workload implemented by an edge compute unit of a plurality of edge compute units. Status information corresponding to a plurality of connected edge assets can be received, the plurality of edge compute units and connected edge assets included in a fleet of edge devices. A remote fleet management graphical user interface (GUI) can display a portion of the monitoring or status information for a subset of the fleet of edge devices, based on a user selection input, and can receive a user configuration input indicative of an updated configuration for at least one workload corresponding to a pre-trained ML or AI model deployed on the at least one edge compute unit. A cloud computing environment can transmit control information corresponding to the updated configuration to the at least one edge compute unit.

Description

TECHNICAL FIELD

The present disclosure pertains to edge computing, and more specifically pertains to systems and techniques for high-performance edge computing and management thereof.

BACKGROUND

Edge computing is a distributed computing paradigm that can be used to decentralize data processing and other computational operations by bringing compute capability and data storage closer to the edge (e.g., the location where the compute and/or data storage is needed, often at the “edge” of a network such as the internet). Edge computing systems are often provided in the same location where input data is generated and/or in the same location where an output result of the computational operations is needed. The use of edge computing systems can reduce latency and bandwidth usage, as data is ingested and processed locally at the edge and rather than being transmitted to a more centralized location for processing.

In many existing cloud computing architectures, data generated at endpoints (e.g., mobile devices, Internet of Things (IoT) sensors, robots, industrial automation systems, security cameras, etc., among various other edge devices and sensors) is transmitted to centralized data centers for processing. The processed results are then transmitted from the centralized data centers to the endpoints requesting the processed results. The centralized processing approach may present challenges for growing use cases, such as for real-time applications and/or artificial intelligence (AI) and machine learning (ML) workloads. For instance, centralized processing models and conventional cloud computing architectures can face constraints in the areas of latency, availability, bandwidth usage, data privacy, network security, and the capacity to process large volumes of data in a timely manner.

In the context of edge computing, the “edge” refers to the edge of the network, close to the endpoint devices and the sources of data. In an edge computing architecture, computation and data storage are distributed across a network of edge nodes that are near the endpoint devices and sources of data. The edge nodes can be configured to perform various tasks relating to data processing, storage, analysis, etc. Based on using the edge nodes to process data locally, the amount of data that is transferred from the edge to the cloud (or other centralized data center) can be significantly reduced. Accordingly, the use of edge computing has become increasingly popular for implementing a diverse range of AI and ML applications, as well as for serving other use cases that demand real-time processing, minimal latency, high availability, and high reliability. In general, such applications and use cases may rely on high-bandwidth sensors that have the ability to generate data at massive rates (e.g., on the order of 50 Gbit/sec or 22 TB/hr).

BRIEF SUMMARY

In some examples, systems and techniques are described for implementing fleet management (e.g., a fleet of edge compute units) and/or asset management (e.g., connected sensors and other assets at the edge) for high-performance edge computing, including edge computing for machine learning (ML) and/or artificial intelligence (AI) deployments and/or workloads.

According to at least one illustrative example, a method is provided, the method comprising: receiving monitoring information from each respective edge compute unit of a plurality of edge compute units, wherein the monitoring information includes information associated with one or more machine learning (ML) or artificial intelligence (AI) workloads implemented by the respective edge compute unit; receiving respective status information corresponding to a plurality of connected edge assets, wherein each connected edge asset is associated with one or more edge compute units of the plurality of edge compute units, and wherein the plurality of edge compute units and the plurality of connected edge assets are included in a fleet of edge devices; displaying, using a remote fleet management graphical user interface (GUI), at least a portion of the monitoring information or the status information corresponding to a selected subset of the fleet of edge devices, wherein the selected subset is determined based on one or more user selection inputs to the remote fleet management GUI; receiving, using the remote fleet management GUI, one or more user configuration inputs indicative of an updated configuration for at least one workload of at least one edge compute unit of the selected subset of the fleet of edge devices, the at least one workload corresponding to a pre-trained ML or AI model deployed on the at least one edge compute unit; and transmitting, from a cloud computing environment associated with the remote fleet management GUI, control information corresponding to the updated configuration, wherein the control information is transmitted to the at least one edge compute unit of the selected subset.

As used herein, the terms “user equipment” (UE) and “network entity” are not intended to be specific or otherwise limited to any particular radio access technology (RAT), unless otherwise noted. In general, a UE may be any wireless communication device (e.g., a mobile phone, router, tablet computer, laptop computer, and/or tracking device, etc.), wearable (e.g., smartwatch, smart-glasses, wearable ring, and/or an extended reality (XR) device such as a virtual reality (VR) headset, an augmented reality (AR) headset or glasses, or a mixed reality (MR) headset), vehicle (e.g., automobile, motorcycle, bicycle, etc.), robotic system (e.g., autonomous passenger vehicle, unmanned aircraft system (UAS), uncrewed ground vehicle (UGV), mobile robotic platform, uncrewed submersible, biped or multi-legged robot, cobot, industrial automation, articulated arm, etc.), and/or Internet of Things (IoT) device, etc., used by a user to communicate over a wireless communications network. A UE may be mobile or may (e.g., at certain times) be stationary, and may communicate with a radio access network (RAN). As used herein, the term “UE” may be referred to interchangeably as an “access terminal” or “AT,” a “client device,” a “wireless device,” a “subscriber device,” a “connected device,” a “subscriber terminal,” a “subscriber station,” a “user terminal” or “UT,” a “mobile device,” a “mobile terminal,” a “mobile station,” or variations thereof. Generally, UEs can communicate with a core network via a RAN, and through the core network the UEs can be connected with external networks such as the Internet and with other UEs. Of course, other mechanisms of connecting to the core network and/or the Internet are also possible for the UEs, such as over wired access networks, wireless local area network (WLAN) networks (e.g., based on IEEE 802.11 communication standards, etc.) and so on.

The term “network entity” or “base station” may refer to a single physical Transmission-Reception Point (TRP) or to multiple physical Transmission-Reception Points (TRPs) that may or may not be co-located. For example, where the term “network entity” or “base station” refers to a single physical TRP, the physical TRP may be an antenna of a base station (e.g., satellite constellation ground station/internet gateway) corresponding to a cell (or several cell sectors) of the base station. Where the term “network entity” or “base station” refers to multiple co-located physical TRPs, the physical TRPs may be an array of antennas (e.g., as in a multiple-input multiple-output (MIMO) system or where the base station employs beamforming) of the base station. Where the term “base station” refers to multiple non-co-located physical TRPs, the physical TRPs may be a distributed antenna system (DAS) (a network of spatially separated antennas connected to a common source via a transport medium) or a remote radio head (RRH) (a remote base station connected to a serving base station). Because a TRP is the point from which a base station transmits and receives wireless signals, as used herein, references to transmission from or reception at a base station are to be understood as referring to a particular TRP of the base station.

An RF signal comprises an electromagnetic wave of a given frequency that transports information through the space between a transmitter and a receiver. As used herein, a transmitter may transmit a single “RF signal” or multiple “RF signals” to a receiver. However, the receiver may receive multiple “RF signals” corresponding to each transmitted RF signal due to the propagation characteristics of RF signals through multipath channels. The same transmitted RF signal on different paths between the transmitter and receiver may be referred to as a “multipath” RF signal. As used herein, an RF signal may also be referred to as a “wireless signal” or simply a “signal” where it is clear from the context that the term “signal” refers to a wireless signal or an RF signal.

This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in isolation to determine the scope of the claimed subject matter. The subject matter should be understood by reference to appropriate portions of the entire specification of this patent, any or all drawings, and each claim.

The foregoing, together with other features and embodiments, will become more apparent upon referring to the following specification, claims, and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and other advantages and features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. The use of a same reference numbers in different drawings indicates similar or identical items or features. Understanding that these drawings depict only exemplary embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings in which:

FIG. 1 depicts an example design of a base station and a user equipment (UE) for transmission and processing of signals exchanged between the UE and the base station, in accordance with some examples;

FIG. 2 is a diagram illustrating an example configuration of a Non-Terrestrial Network (NTN) for providing data network connectivity to terrestrial (ground-based) devices, in accordance with some examples;

FIG. 3 is a diagram illustrating an example of a satellite internet constellation network that can be used to provide low latency satellite internet connectivity, in accordance with some examples;

FIG. 4 is a diagram illustrating an example of an edge computing system for machine learning (ML) and/or artificial intelligence (AI) workloads, where the edge computing system includes one or more local sites each having one or more edge compute units, in accordance with some examples;

FIG. 5 is a diagram illustrating an example software stack associated with implementing an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 6 is a diagram illustrating an example architecture for implementing global services and edge compute services of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 7 is a diagram illustrating an example infrastructure and architecture for implementing an edge compute unit of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 8 is a diagram illustrating an example graphical user interface (GUI) of a global management console associated with asset management and telemetry observation for a fleet of edge compute units of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 9 is a diagram illustrating another example GUI of a global management console associated with asset management and telemetry observation for a fleet of edge compute units of an edge computing system for ML and/or AI workloads, in accordance with some examples; and

FIG. 10 is a block diagram illustrating an example of a computing system architecture that can be used to implement one or more aspects described herein, in accordance with some examples.

DETAILED DESCRIPTION

Certain aspects of this disclosure are provided below for illustration purposes. Alternate aspects may be devised without departing from the scope of the disclosure. Additionally, well-known elements of the disclosure will not be described in detail or will be omitted so as not to obscure the relevant details of the disclosure. Some of the aspects described herein may be applied independently and some of them may be applied in combination as would be apparent to those of skill in the art. In the following description, for the purposes of explanation, specific details are set forth in order to provide a thorough understanding of aspects of the application. However, it will be apparent that various aspects may be practiced without these specific details. The figures and description are not intended to be restrictive.

The ensuing description provides example aspects only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the example aspects will provide those skilled in the art with an enabling description for implementing an example aspect. It should be understood that various changes may be made in the function and arrangement of elements without departing from the scope of the application as set forth in the appended claims.

Overview

Systems, apparatuses, methods (also referred to as processes), and computer-readable media (collectively referred to herein as “systems and techniques”) are described herein for high-performance edge computing for machine learning (ML) and artificial intelligence (AI) workloads. As used herein, reference to an “ML workload” includes both workloads implemented using a trained machine learning model and workloads implemented using a trained artificial intelligence model. Similarly, reference to an “AI workload” includes both workloads implemented using a trained artificial intelligence model and workloads implemented using a trained machine learning model.

In some aspects, one or more edge compute units (also referred to as a “fleet” of edge compute units) can be used to implement high-performance edge computing for ML and AI workloads. The edge compute unit can include modular and/or configurable compute hardware units (e.g., CPUs, GPUs, TPUs, NPUs, accelerators, memory, storage, etc.) for running the trained ML or AI models. In some cases, the edge compute unit can be a data center unit that is deployable to the edge. An edge compute unit (e.g., containerized data center or containerized compute unit) can be configured according to an intended use case and/or according to one or more deployment site location characteristics. For example, the edge compute unit can be a containerized data center having various hardware configurations (e.g., CPU-centric or GPU-centric compute hardware configuration; urban location or remote location configuration; private electrical/data network or utility electrical/data network connectivity configuration; etc.).

The containerized edge compute unit can be deployed to a user-determined (e.g., enterprise-determined) site location. The enterprise site location may have varying levels of existing infrastructure availability, based upon which the containerized edge compute unit can be correspondingly configured. For example, the containerized edge compute unit can be configured based at least in part on the electrical infrastr

TECHNICAL FIELD

The present disclosure pertains to edge computing, and more specifically pertains to systems and techniques for high-performance edge computing and management thereof.

BACKGROUND

Edge computing is a distributed computing paradigm that can be used to decentralize data processing and other computational operations by bringing compute capability and data storage closer to the edge (e.g., the location where the compute and/or data storage is needed, often at the “edge” of a network such as the internet). Edge computing systems are often provided in the same location where input data is generated and/or in the same location where an output result of the computational operations is needed. The use of edge computing systems can reduce latency and bandwidth usage, as data is ingested and processed locally at the edge and rather than being transmitted to a more centralized location for processing.

In many existing cloud computing architectures, data generated at endpoints (e.g., mobile devices, Internet of Things (IoT) sensors, robots, industrial automation systems, security cameras, etc., among various other edge devices and sensors) is transmitted to centralized data centers for processing. The processed results are then transmitted from the centralized data centers to the endpoints requesting the processed results. The centralized processing approach may present challenges for growing use cases, such as for real-time applications and/or artificial intelligence (AI) and machine learning (ML) workloads. For instance, centralized processing models and conventional cloud computing architectures can face constraints in the areas of latency, availability, bandwidth usage, data privacy, network security, and the capacity to process large volumes of data in a timely manner.

In the context of edge computing, the “edge” refers to the edge of the network, close to the endpoint devices and the sources of data. In an edge computing architecture, computation and data storage are distributed across a network of edge nodes that are near the endpoint devices and sources of data. The edge nodes can be configured to perform various tasks relating to data processing, storage, analysis, etc. Based on using the edge nodes to process data locally, the amount of data that is transferred from the edge to the cloud (or other centralized data center) can be significantly reduced. Accordingly, the use of edge computing has become increasingly popular for implementing a diverse range of AI and ML applications, as well as for serving other use cases that demand real-time processing, minimal latency, high availability, and high reliability. In general, such applications and use cases may rely on high-bandwidth sensors that have the ability to generate data at massive rates (e.g., on the order of 50 Gbit/sec or 22 TB/hr).

BRIEF SUMMARY

In some examples, systems and techniques are described for implementing fleet management (e.g., a fleet of edge compute units) and/or asset management (e.g., connected sensors and other assets at the edge) for high-performance edge computing, including edge computing for machine learning (ML) and/or artificial intelligence (AI) deployments and/or workloads.

According to at least one illustrative example, a method is provided, the method comprising: receiving monitoring information from each respective edge compute unit of a plurality of edge compute units, wherein the monitoring information includes information associated with one or more machine learning (ML) or artificial intelligence (AI) workloads implemented by the respective edge compute unit; receiving respective status information corresponding to a plurality of connected edge assets, wherein each connected edge asset is associated with one or more edge compute units of the plurality of edge compute units, and wherein the plurality of edge compute units and the plurality of connected edge assets are included in a fleet of edge devices; displaying, using a remote fleet management graphical user interface (GUI), at least a portion of the monitoring information or the status information corresponding to a selected subset of the fleet of edge devices, wherein the selected subset is determined based on one or more user selection inputs to the remote fleet management GUI; receiving, using the remote fleet management GUI, one or more user configuration inputs indicative of an updated configuration for at least one workload of at least one edge compute unit of the selected subset of the fleet of edge devices, the at least one workload corresponding to a pre-trained ML or AI model deployed on the at least one edge compute unit; and transmitting, from a cloud computing environment associated with the remote fleet management GUI, control information corresponding to the updated configuration, wherein the control information is transmitted to the at least one edge compute unit of the selected subset.

As used herein, the terms “user equipment” (UE) and “network entity” are not intended to be specific or otherwise limited to any particular radio access technology (RAT), unless otherwise noted. In general, a UE may be any wireless communication device (e.g., a mobile phone, router, tablet computer, laptop computer, and/or tracking device, etc.), wearable (e.g., smartwatch, smart-glasses, wearable ring, and/or an extended reality (XR) device such as a virtual reality (VR) headset, an augmented reality (AR) headset or glasses, or a mixed reality (MR) headset), vehicle (e.g., automobile, motorcycle, bicycle, etc.), robotic system (e.g., autonomous passenger vehicle, unmanned aircraft system (UAS), uncrewed ground vehicle (UGV), mobile robotic platform, uncrewed submersible, biped or multi-legged robot, cobot, industrial automation, articulated arm, etc.), and/or Internet of Things (IoT) device, etc., used by a user to communicate over a wireless communications network. A UE may be mobile or may (e.g., at certain times) be stationary, and may communicate with a radio access network (RAN). As used herein, the term “UE” may be referred to interchangeably as an “access terminal” or “AT,” a “client device,” a “wireless device,” a “subscriber device,” a “connected device,” a “subscriber terminal,” a “subscriber station,” a “user terminal” or “UT,” a “mobile device,” a “mobile terminal,” a “mobile station,” or variations thereof. Generally, UEs can communicate with a core network via a RAN, and through the core network the UEs can be connected with external networks such as the Internet and with other UEs. Of course, other mechanisms of connecting to the core network and/or the Internet are also possible for the UEs, such as over wired access networks, wireless local area network (WLAN) networks (e.g., based on IEEE 802.11 communication standards, etc.) and so on.

The term “network entity” or “base station” may refer to a single physical Transmission-Reception Point (TRP) or to multiple physical Transmission-Reception Points (TRPs) that may or may not be co-located. For example, where the term “network entity” or “base station” refers to a single physical TRP, the physical TRP may be an antenna of a base station (e.g., satellite constellation ground station/internet gateway) corresponding to a cell (or several cell sectors) of the base station. Where the term “network entity” or “base station” refers to multiple co-located physical TRPs, the physical TRPs may be an array of antennas (e.g., as in a multiple-input multiple-output (MIMO) system or where the base station employs beamforming) of the base station. Where the term “base station” refers to multiple non-co-located physical TRPs, the physical TRPs may be a distributed antenna system (DAS) (a network of spatially separated antennas connected to a common source via a transport medium) or a remote radio head (RRH) (a remote base station connected to a serving base station). Because a TRP is the point from which a base station transmits and receives wireless signals, as used herein, references to transmission from or reception at a base station are to be understood as referring to a particular TRP of the base station.

An RF signal comprises an electromagnetic wave of a given frequency that transports information through the space between a transmitter and a receiver. As used herein, a transmitter may transmit a single “RF signal” or multiple “RF signals” to a receiver. However, the receiver may receive multiple “RF signals” corresponding to each transmitted RF signal due to the propagation characteristics of RF signals through multipath channels. The same transmitted RF signal on different paths between the transmitter and receiver may be referred to as a “multipath” RF signal. As used herein, an RF signal may also be referred to as a “wireless signal” or simply a “signal” where it is clear from the context that the term “signal” refers to a wireless signal or an RF signal.

This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in isolation to determine the scope of the claimed subject matter. The subject matter should be understood by reference to appropriate portions of the entire specification of this patent, any or all drawings, and each claim.

The foregoing, together with other features and embodiments, will become more apparent upon referring to the following specification, claims, and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and other advantages and features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. The use of a same reference numbers in different drawings indicates similar or identical items or features. Understanding that these drawings depict only exemplary embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings in which:

FIG. 1 depicts an example design of a base station and a user equipment (UE) for transmission and processing of signals exchanged between the UE and the base station, in accordance with some examples;

FIG. 2 is a diagram illustrating an example configuration of a Non-Terrestrial Network (NTN) for providing data network connectivity to terrestrial (ground-based) devices, in accordance with some examples;

FIG. 3 is a diagram illustrating an example of a satellite internet constellation network that can be used to provide low latency satellite internet connectivity, in accordance with some examples;

FIG. 4 is a diagram illustrating an example of an edge computing system for machine learning (ML) and/or artificial intelligence (AI) workloads, where the edge computing system includes one or more local sites each having one or more edge compute units, in accordance with some examples;

FIG. 5 is a diagram illustrating an example software stack associated with implementing an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 6 is a diagram illustrating an example architecture for implementing global services and edge compute services of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 7 is a diagram illustrating an example infrastructure and architecture for implementing an edge compute unit of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 8 is a diagram illustrating an example graphical user interface (GUI) of a global management console associated with asset management and telemetry observation for a fleet of edge compute units of an edge computing system for ML and/or AI workloads, in accordance with some examples;

FIG. 9 is a diagram illustrating another example GUI of a global management console associated with asset management and telemetry observation for a fleet of edge compute units of an edge computing system for ML and/or AI workloads, in accordance with some examples; and

FIG. 10 is a block diagram illustrating an example of a computing system architecture that can be used to implement one or more aspects described herein, in accordance with some examples.

DETAILED DESCRIPTION

Certain aspects of this disclosure are provided below for illustration purposes. Alternate aspects may be devised without departing from the scope of the disclosure. Additionally, well-known elements of the disclosure will not be described in detail or will be omitted so as not to obscure the relevant details of the disclosure. Some of the aspects described herein may be applied independently and some of them may be applied in combination as would be apparent to those of skill in the art. In the following description, for the purposes of explanation, specific details are set forth in order to provide a thorough understanding of aspects of the application. However, it will be apparent that various aspects may be practiced without these specific details. The figures and description are not intended to be restrictive.

The ensuing description provides example aspects only, and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the example aspects will provide those skilled in the art with an enabling description for implementing an example aspect. It should be understood that various changes may be made in the function and arrangement of elements without departing from the scope of the application as set forth in the appended claims.

Overview

Systems, apparatuses, methods (also referred to as processes), and computer-readable media (collectively referred to herein as “systems and techniques”) are described herein for high-performance edge computing for machine learning (ML) and artificial intelligence (AI) workloads. As used herein, reference to an “ML workload” includes both workloads implemented using a trained machine learning model and workloads implemented using a trained artificial intelligence model. Similarly, reference to an “AI workload” includes both workloads implemented using a trained artificial intelligence model and workloads implemented using a trained machine learning model.

In some aspects, one or more edge compute units (also referred to as a “fleet” of edge compute units) can be used to implement high-performance edge computing for ML and AI workloads. The edge compute unit can include modular and/or configurable compute hardware units (e.g., CPUs, GPUs, TPUs, NPUs, accelerators, memory, storage, etc.) for running the trained ML or AI models. In some cases, the edge compute unit can be a data center unit that is deployable to the edge. An edge compute unit (e.g., containerized data center or containerized compute unit) can be configured according to an intended use case and/or according to one or more deployment site location characteristics. For example, the edge compute unit can be a containerized data center having various hardware configurations (e.g., CPU-centric or GPU-centric compute hardware configuration; urban location or remote location configuration; private electrical/data network or utility electrical/data network connectivity configuration; etc.).

The containerized edge compute unit can be deployed to a user-determined (e.g., enterprise-determined) site location. The enterprise site location may have varying levels of existing infrastructure availability, based upon which the containerized edge compute unit can be correspondingly configured. For example, the containerized edge compute unit can be configured based at least in part on the electrical infrastructure and data connectivity infrastructure availability at the enterprise site location. The containerized edge compute unit can be pre-configured (at the time of deployment to the enterprise site location) with hardware infrastructure, data connectivity, and critical environmental systems fully or partially integrated.

In one illustrative example, the containerized edge compute unit can be pre-configured (e.g., pre-loaded) with a fleet management, knowledge bases, predetermined datasets and trained ML/AI models and application software stack for edge computing AI and ML workloads, such as the fleet management and application software stack that is the subject of this disclosure and will be described in greater depth below.

The presently disclosed fleet management and application software stack is also referred to herein as an “edge ML/AI platform” or an “edge ML/AI management system.” In some embodiments, the edge ML/AI platform can include at least a remote fleet management engine, a telemetry and monitoring observation engine, a platform application orchestration engine, and a deployable application repository, each of which are described in greater detail with respect to the figures, and with particular reference to the examples of FIGS. 5 - 7 .

In one illustrative example, the remote fleet management (e.g., command) engine, telemetry and monitoring (e.g., observation) engine, platform application orchestration engine, and deployable application repository can be implemented using a single, global management console of the presently disclosed edge ML/AI platform. For instance, the global management console can be configured to provide a single pane of glass interface that provides a unified data presentation view and bidirectional interaction across the various sources and constituent engines included in or otherwise associated with the presently disclosed edge ML/AI platform. As used herein, the global management “console” can also be referred to as a global management “portal.” Further details of the global management console are described below with respect to the figures, and with particular reference to the examples of FIGS. 8 and 9 .

In some embodiments, the presently disclosed edge ML/AI platform can be used to implement a connected edge and cloud for ML and AI workloads. For instance, many ML and AI workloads, applications, and/or models are data-intensive and benefit from continual (or relatively frequent) retraining to account for data drift and model degradation. In some cases, the ML and AI workloads may require monitoring of model degradation in conjunction with regular training (e.g., retraining, fine tuning, instruction tuning, continual learning, etc.) with new data, model parameters, model hyperparameters, etc., as appropriate. In one illustrative example, the systems and techniques described herein can be used to provide an edge ML/AI monitoring and management platform configured to provide streamlined and efficient operations for deploying, maintaining, and updating ML and AI workloads or models to the edge.

As described in greater detail herein, the edge ML/AI monitoring and management platform can be implemented for a fleet of edge compute units (e.g., the containerized edge compute units described above) and a plurality of connected sensors and/or edge assets associated with at least one edge compute unit of the fleet. The containerized edge compute units of the fleet can be used to provide local (e.g., edge) storage, inference, prediction, response, etc. using trained ML and/or AI models from a centralized or cloud distribution source, where the trained models are trained or fine-tuned remotely from the edge compute unit. For instance, the edge ML/AI monitoring and management platform can be used to implement or otherwise interface to ML/AI training clusters running in the cloud. The edge compute units can subsequently run or implement their respective trained models locally (e.g., onboard the edge compute unit), using as input the data obtained from local sensors or other endpoint assets associated with the edge compute unit.

In some embodiments, the edge ML/AI monitoring and management platform can be used to implement and/or orchestrate a hub-and-spoke architecture for efficient ML/AI inferencing at the edge. For instance, ML and AI model training often necessitates massive amounts of data and processing power, with the resultant trained model quality being highly correlated with the size and diversity of the training and test data. Training large models can require running thousands of GPUs and ingesting hundreds of terabytes of data, over the course of several weeks. Accordingly, large-scale ML and AI model training may be better suited for deployment on cloud and/or on-premises infrastructure (e.g., centralized large-scale compute infrastructure). By comparison, ML and AI inferencing (e.g., performing inference using a trained ML or AI model) utilizes a relatively smaller amount of compute resources (e.g., CPU, GPU, memory, etc.) and can be performed efficiently at the edge—which often is also the location where the input data for the ML or AI inferencing originates and is collected. Accordingly, performing inference at the edge provides the benefit of better latency (e.g., lower latency, higher frame rate, lower response time, larger sampling frequency), as the input data does not need to first transit over to a cloud region prior to inference. In some aspects, trained ML or AI models (generated in the cloud or on-premises) can be optimized and compressed significantly prior to delivery or distribution to some (or all) of the edge locations, ultimately enabling the trained model to be distributed to a greater quantity and range of edge locations, and in a more efficient manner.

In one illustrative example, the systems and techniques described herein can be used to implement a hub-and-spoke architecture for efficient ML/AI inferencing at the edge, based on training (or retraining/finetuning) performed at a centralized cloud or on-premises location. The hub-and-spoke architecture can be orchestrated and managed using the presently disclosed edge ML/AI monitoring and management platform. In some embodiments, a continuous feedback loop can be used to capture data locally (e.g., at the containerized edge compute units managed by the edge ML/AI monitoring and management platform), perform inference, and respond locally. In some aspects, inference results and/or features from the source data can be compressed and transmitted from the edge to the ML/AI monitoring platform. For instance, the containerized edge compute units can be used to compress and transmit inference results and/or source data features back to the presently disclosed ML/AI monitoring platform (and/or other centralized management location). Training and finetuning can be performed in the cloud or using a centralized on-premises infrastructure, in both cases with training or finetuning operations mediated and managed by the edge ML/AI monitoring platform. The edge ML/AI monitoring platform can subsequently transmit or otherwise distribute the new or updated ML and AI models back to the edge (e.g., back to some or all of the edge compute units included in a fleet of edge compute units managed by the presently disclosed edge ML/AI monitoring and management platform). In some aspects, the edge ML/AI monitoring and management platform can be configured to optimize the usage of cloud, edge, and bandwidth resources for performing ML and/or AI workloads at the edge. The edge ML/AI monitoring and management platform can be further configured to ensure privacy and security of data generated at the edge (e.g., financial records and transactions, personal identifiable information, protected health information, proprietary images and videos, etc.).

Further details regarding the systems and techniques described herein will be discussed below with respect to the figures.

FIG. 1 shows a block diagram of a design of a base station 102 and a UE 104 that enable transmission and processing of signals exchanged between the UE and the base station, in accordance with some aspects of the present disclosure. Design 100 includes components of a base station 102 and a UE 104 . In some examples, the architecture of base station 102 can be the same as or similar to an architecture used to implement a satellite constellation ground station (e.g., internet gateway for providing internet connectivity via a satellite constellation). In some examples, the architecture of base station 102 can be the same as or similar to an architecture used to implement a satellite of a satellite constellation and/or a network entity in communication with a satellite constellation (e.g., such as the satellite constellations and/or networks depicted in FIGS. 2 and 3 ).

As illustrated in FIG. 1 , base station 102 may be equipped with T antennas 134 a through 134 t , and UE 104 may be equipped with R antennas 152 a through 152 r , where in general T≥1 and R≥1. At base station 102 , a transmit processor 120 may receive data from a data source 112 for one or more UEs, select one or more modulation and coding schemes (MCS) for each UE based at least in part on channel quality indicators (CQIs) received from the UE, process (e.g., encode and modulate) the data for each UE based at least in part on the MC S(s) selected for the UE, and provide data symbols for all UEs. Transmit processor 120 may also process system information (e.g., for semi-static resource partitioning information (SRPI) and/or the like) and control information (e.g., CQI requests, grants, upper layer signaling, and/or the like) and provide overhead symbols and control symbols. Transmit processor 120 may also generate reference symbols for reference signals (e.g., the cell-specific reference signal (CRS)) and synchronization signals (e.g., the primary synchronization signal (PSS) and secondary synchronization signal (SSS))). A transmit (TX) multiple-input multiple-output (MIMO) processor 130 may perform spatial processing (e.g., precoding) on the data symbols, the control symbols, the overhead symbols, and/or the reference symbols, if applicable, and may provide T output symbol streams to T modulators (MODs) 132 a through 132 t . The modulators 132 a through 132 t are shown as a combined modulator-demodulator (MOD-DEMOD). In some cases, the modulators and demodulators can be separate components. Each modulator of the modulators 132 a to 132 t may process a respective output symbol stream, e.g., for an orthogonal frequency-division multiplexing (OFDM) scheme and/or the like, to obtain an output sample stream. Each modulator of the modulators 132 a to 132 t may further process (e.g., convert to analog, amplify, filter, and upconvert) the output sample stream to obtain a downlink signal. T downlink signals may be transmitted from modulators 132 a to 132 t via T antennas 134 a through 134 t , respectively. According to certain aspects described in more detail below, the synchronization signals can be generated with location encoding to convey additional information.

At UE 104 , antennas 152 a through 152 r may receive the downlink signals from base station 102 and/or other base stations and may provide received signals to demodulators (DEMODs) 154 a through 154 r , respectively. The demodulators 154 a through 154 r are shown as a combined modulator-demodulator (MOD-DEMOD). In some cases, the modulators and demodulators can be separate components. Each demodulator of the demodulators 154 a through 154 r may condition (e.g., filter, amplify, downconvert, and digitize) a received signal to obtain input samples. Each demodulator of the demodulators 154 a through 154 r may further process the input samples (e.g., for OFDM and/or the like) to obtain received symbols. A MIMO detector 156 may obtain received symbols from all R demodulators 154 a through 154 r , perform MIMO detection on the received symbols if applicable, and provide detected symbols. A receive processor 158 may process (e.g., demodulate and decode) the detected symbols, provide decoded data for UE 104 to a data sink 160 , and provide decoded control information and system information to a controller/ processor 180 . A channel processor may determine reference signal received power (RSRP), received signal strength indicator (RSSI), reference signal received quality (RSRQ), channel quality indicator (CQI), and/or the like.

On the uplink, at UE 104 , a transmit processor 164 may receive and process data from a data source 162 and control information (e.g., for reports comprising RSRP, RSSI, RSRQ, CQI, and/or the like) from controller/ processor 180 . Transmit processor 164 may also generate reference symbols for one or more reference signals (e.g., based at least in part on a beta value or a set of beta values associated with the one or more reference signals). The symbols from transmit processor 164 may be precoded by a TX- MIMO processor 166 if application, further processed by modulators 154 a through 154 r (e.g., for DFT-s-OFDM, CP-OFDM, and/or the like), and transmitted to base station 102 . At base station 102 , the uplink signals from UE 104 and other UEs may be received by antennas 134 a through 134 t , processed by demodulators 132 a through 132 t , detected by a MIMO detector 136 if applicable, and further processed by a receive processor 138 to obtain decoded data and control information sent by UE 104 . Receive processor 138 may provide the decoded data to a data sink 139 and the decoded control information to controller (e.g., processor) 140 . Base station 102 may include communication unit 144 and communicate to a network controller 131 via communication unit 144 . Network controller 131 may include communication unit 194 , controller/ processor 190 , and memory 192 . In some aspects, one or more components of UE 104 may be included in a housing. Memories

142 and 182 may store data and program codes for the base station 102 and the UE 104 , respectively. A scheduler 146 may schedule UEs for data transmission on the downlink, uplink, and/or sidelink.

Data Network Connectivity Using Satellite Constellations

As noted previously, low-orbit satellite constellation systems have been rapidly developed and deployed to provide wireless communications and data network connectivity. A fleet of discrete satellites (also referred to as “birds”) can be arranged as a global satellite constellation that provides at least periodic or intermittent coverage to a large portion of the Earth's surface. In many cases, at least certain areas of the Earth's service may have continuous or near-continuous coverage from at least one bird of the satellite constellation. For instance, a global satellite constellation can be formed based on a stable (and therefore predictable) space geometric configuration, in which the fleet of birds maintain fixed space-time relationships with one another. A satellite constellation be used to provide data network connectivity to ground-based devices and/or other terrestrial receivers. For example, a satellite constellation can be integrated with or otherwise provide connectivity to one or more terrestrial (e.g., on-ground) data networks, such as the internet, a 4G/LTE network, and/or a 5G/NR network, among various others. In one illustrative example, a satellite internet constellation system can include a plurality of discrete satellites arranged in a low-earth orbit and used to provide data network connectivity to the internet.

To implement an internet satellite constellation, the discrete satellites can be used as space-based communication nodes that couple terrestrial devices to terrestrial internet gateways. The terrestrial internet gateways may also be referred to as ground stations, and are used to provide connectivity to the internet backbone. For instance, a given satellite can provide a first communication link to a terrestrial device and a second communication link to a ground station that is connected to an internet service provider (ISP). The terrestrial device can transmit data and/or data requests to the satellite over the first communication link, with the satellite subsequently forwarding the transmission to the ground station internet gateway (from which point onward the transmission from the device is handled as a normal internet transmission). The terrestrial device can receive data and/or requests using the reverse process, in which the satellite receives a transmission from the ground station internet gateway via the second communication link and then forwards the transmission to the terrestrial device using the first communication link.

Although an internet satellite constellation includes a fleet of discrete satellites, in some cases terrestrial devices connected with a satellite may communicate with a ground station/internet gateway that is also able to communicate with the same satellite. In other words, it is typically the case that the first and second communication links described above must be established with the same satellite of the satellite constellation. A user connecting to any particular satellite is therefore limited by the ground station/internet gateways that are visible to that particular satellite. For instance, a user connected to a satellite that is unable to establish a communication link with a ground station/internet gateway is therefore unable to connect to the internet—although the fleet of satellites is a global network in terms of spatial diversity and arrangement, the individual satellites function as standalone internet relay nodes unless an inter-satellite link capability is provided.

In some cases, inter-satellite links can allow point to point communications between the individual satellites included in a satellite constellation. For instance, data can travel at the speed of light from one satellite to another, resulting in a fully interconnected global mesh network that allows access to the internet as long as the terrestrial device can establish communication with at least one satellite of the satellite internet constellation. In one illustrative example, a satellite internet constellation can implement inter-satellite links as optical communication links. For example, optical space lasers can be used to implement optical intersatellite links (ISLs) between some (or all) of the individual birds of a satellite constellation. In this manner, the satellite internet constellation can be used to transmit data without the use of local ground stations, and may be seen to provide truly global coverage.

For instance, optical laser links between individual satellites in a satellite constellation can reduce long-distance latency by as much as 50%. Additionally, optical laser links (e.g., ISLs) can enable the more efficient sharing of capacity by utilizing the otherwise wasted satellite capacity over regions without ground station internet gateways. Moreover, optical laser links allow the satellite constellation to provide internet service (or other data network connectivity) to areas where ground stations are not present and/or are impossible to install.

To implement a satellite constellation, one or more satellites may be integrated with the terrestrial infrastructure of a wireless communication system. In general, satellites may refer to Low Earth Orbit (LEO) devices, Medium Earth Orbit (MEO) devices, Geostationary Earth Orbit (GEO) devices, and/or Highly Elliptical Orbit (HEO) devices. In some aspects, a satellite constellation can be included in or used to implement a non-terrestrial network (NTN). A non-terrestrial network (NTN) may refer to a network, or a segment of a network, that uses an airborne or spaceborne vehicle for transmission. For instance, spaceborne vehicles can refer to various ones of the satellites described above. An airborne vehicle may refer to High Altitude Platforms (HAPs) including Unmanned Aircraft Systems (UAS). An NTN may be configured to help to provide wireless communication in un-served or underserved areas to upgrade the performance of terrestrial networks. For example, a communication satellite (e.g., of a satellite constellation) may provide coverage to a larger geographic region than a terrestrial network base station. The NTN may also reinforce service reliability by providing service continuity for UEs or for moving platforms (e.g., passenger vehicles-aircraft, ships, high speed trains, buses). The NTN may also increase service availability, including critical communications. The NTN may also enable network scalability through the provision of efficient multicast/broadcast resources for data delivery towards the network edges or even directly to the user equipment.

FIG. 2 is a diagram illustrating an example configuration 200 of an NTN for providing data network connectivity to terrestrial (ground-based) devices. In one illustrative example, the NTN can be a satellite internet constellation, although various other NTNs and/or satellite constellation data network connectivity types may also be utilized without departing from the scope of the present disclosure. As used herein, the terms “NTN” and “satellite constellation” may be used interchangeably.

An NTN may refer to a network, or a segment of a network, that uses RF resources on-board an NTN platform. The NTN platform may refer to a spaceborne vehicle or an airborne vehicle. Spaceborne vehicles include communication satellites that may be classified based on their orbits. For example, a communication satellite may include a GEO device that appears stationary with respect to the Earth. As such, a single GEO device may provide coverage to a geographic coverage area. In other examples, a communication satellite may include a non-GEO device, such as an LEO device, an MEO device, or an HEO device. Non-GEO devices do not appear stationary with respect to the Earth. As such, a satellite constellation (e.g., one or more satellites) may be configured to provide coverage to the geographic coverage area. An airborne vehicle may refer to a system encompassing Tethered UAS (TUA), Lighter Than Air UAS (LTA), Heavier Than Air UAS (HTA) (e.g., in altitudes typically between 8 and 50 km including High Altitude Platforms (HAPs)).

A satellite constellation can include a plurality of satellites, such as the

satellites

202 , 204 , and 206 depicted in FIG. 2 . The plurality of satellites can include satellites that are the same as one another and/or can include satellites that are different from one another. A terrestrial gateway 208 can be used to provide data connectivity to a data network 210 . For instance, the terrestrial gateway 208 can be a ground station (e.g., internet gateway) for providing data connectivity to the internet. Also depicted in FIG. 2 is a UE 230 located on the surface of the earth, within a cell coverage area of the first satellite 202 . In some aspects, the UE 230 can include various devices capable of connecting to the NTN 200 and/or the satellite constellation thereof for wireless communication.

The gateway 208 may be included in one or more terrestrial gateways that are used to connect the NTN 200 and/or satellite constellation thereof to a public data network such as the internet. In some examples, the gateway 208 may support functions to forward a signal from the satellite constellation to a Uu interface, such as an NR-Uu interface. In other examples, the gateway 208 may provide a transport network layer node, and may support various transport protocols, such as those associated with providing an IP router functionality. A satellite radio interface (SRI) may provide IP trunk connections between the gateway 208 and various satellites (e.g., satellites 202 - 206 ) to transport NG or F1 interfaces, respectively.

Satellites within the satellite constellation that are within connection range of the gateway 208 (e.g., within line-of-sight of, etc.) may be fed by the gateway 208 . The individual satellites of the satellite constellation can be deployed across a satellite-targeted coverage area, which can correspond to regional, continental, or even global coverage. The satellites of the satellite constellation may be served successively by one or more gateways at a time. The NTN 200 associated with the satellite constellation can be configured to provide service and feeder link continuity between the successive serving gateways 208 with time duration to perform mobility anchoring and handover.

In one illustrative example, the first satellite 202 may communicate with the data network 210 (e.g., the internet) through a feeder link 212 established between the first satellite 202 and the gateway 208 . The feeder link 212 can be used to provide bidirectional communications between the first satellite 202 and the internet backbone coupled to or otherwise provided by gateway 208 . The <figure-callout id="202" label="first satellite" filenam

CLAIMS

Claims ( 19 )

What is claimed is:

1. A method comprising:

receiving monitoring information from each respective edge compute unit of a plurality of edge compute units, wherein the monitoring information includes information associated with one or more machine learning (ML) or artificial intelligence (AI) workloads implemented by the respective edge compute unit;

receiving respective status information corresponding to a plurality of connected edge assets, wherein each connected edge asset is associated with one or more edge compute units of the plurality of edge compute units, and wherein the plurality of edge compute units and the plurality of connected edge assets are included in a fleet of edge devices;

displaying, using a remote fleet management graphical user interface (GUI), at least a portion of the monitoring information or the status information corresponding to a selected subset of the fleet of edge devices, wherein the selected subset is determined based on one or more user selection inputs to the remote fleet management GUI;

receiving, using the remote fleet management GUI, one or more user configuration inputs indicative of an updated configuration for a respective ML or AI workload of at least one edge compute unit of the selected subset of the fleet of edge devices, the respective ML or AI workload corresponding to a pre-trained ML or AI model deployed on the at least one edge compute unit, wherein the updated configuration:

corresponds to the pre-trained ML or AI model and is configured to cause a subset of edge compute units of the fleet of edge devices to perform distributed retraining of the pre-trained ML or AI model; and

includes orchestration information for distributing a retraining workload across the respective edge compute units of the subset of edge compute units; and

transmitting, from a cloud computing environment associated with the remote fleet management GUI, control information corresponding to the updated configuration, wherein the control information is transmitted to the at least one edge compute unit of the selected subset.

2. The method of claim 1 , wherein the one or more user configuration inputs are indicative of an updated configuration for a respective ML or AI workload of the one or more ML or AI workloads.

3. The method of claim 1 , wherein the updated configuration for the respective ML or AI workload corresponds to a pre-trained ML or AI model associated with the respective ML or AI workload.

4. The method of claim 3 , wherein the updated configuration is configured to cause the at least one edge compute unit of the selected subset to perform local retraining of the pre-trained ML or AI model at an edge location of the at least one edge compute unit.

5. The method of claim 4 , wherein the updated configuration further includes retraining information for the local retraining of the pre-trained ML or AI model at the edge location.

6. The method of claim 5 , wherein the retraining information is generated by the cloud computing environment based on information obtained across the plurality of edge compute units included in the fleet of edge devices.

7. The method of claim 3 , wherein the updated configuration is configured to cause the at least one edge compute unit of the selected subset to perform local finetuning of the pre-trained ML or AI model at an edge location of the at least one edge compute unit.

8. The method of claim 7 , wherein the updated configuration further includes finetuning information for the local finetuning of the pre-trained ML or AI model at the edge location.

9. The method of claim 8 , wherein the finetuning information is generated by the cloud computing environment based on information obtained across the plurality of edge compute units included in the fleet of edge devices.

10. The method of claim 3 , wherein the updated configuration is configured to cause a subset of edge compute units of the plurality of edge compute units of the fleet of edge devices to perform distributed finetuning of the pre-trained ML or AI model, and wherein the updated configuration information includes orchestration information for distributing a finetuning workload across the respective edge compute units of the subset of edge compute units.

11. The method of claim 1 , wherein the one or more user configuration inputs are indicative of an updated network connectivity configuration applicable to at least a portion of the selected subset of the fleet of edge devices.

12. The method of claim 11 , wherein:

the updated network connectivity configuration corresponds to a local edge network implemented at an edge deployment location of a plurality of edge deployment locations for the fleet of edge devices; and

the local edge network is implemented at the edge deployment location by a corresponding edge compute unit of the fleet of edge devices.

13. The method of claim 12 , wherein the local edge network is configured for wireless communications between the corresponding edge compute unit and the respective connected edge assets associated with the corresponding edge compute unit.

14. The method of claim 13 , wherein the updated network connectivity configuration corresponds to updated provisioning information for deploying one or more additional connected edge assets to the fleet of edge devices and within the edge deployment location.

15. The method of claim 11 , wherein the one or more user configuration inputs are indicative of an updated network connectivity configuration applicable to one or more internet backhaul links between the fleet of edge devices and the cloud computing environment associated with the remote fleet management GUI.

16. The method of claim 15 , wherein each internet backhaul link of the one or more internet backhaul links is configured between a respective edge deployment location of a plurality of edge deployment locations for the fleet of edge devices and the cloud computing environment associated with the remote fleet management GUI.

17. The method of claim 15 , wherein each internet backhaul link of the one or more internet backhaul links comprises a satellite internet constellation backhaul link between at least one edge device of the fleet of edge devices and at least one satellite of a satellite internet constellation.

18. The method of claim 17 , wherein the one or more user configuration inputs are indicative of updated subscription information between the satellite internet constellation and a satellite internet constellation transceiver terminal associated with an edge compute unit of the fleet of edge devices.

19. The method of claim 11 , wherein the updated network connectivity configuration corresponds to a Software-Defined Networking (SDN) layer associated with the fleet of edge devices, and wherein the updated network connectivity configuration is indicative of one or more updated SDN layer configurations for at least a portion of the plurality of edge compute units of the fleet of edge devices.

US18/461,459

2023-09-05

2023-09-05

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Active

US11876858B1

( en )

Priority Applications (3)

Application Number

Priority Date

Filing Date

Title

US18/461,459

US11876858B1

( en )

2023-09-05

2023-09-05

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US18/524,506

US12034801B1

( en )

2023-09-05

2023-11-30

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US18/626,231

US20250077216A1

( en )

2023-09-05

2024-04-03

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Applications Claiming Priority (1)

Application Number

Priority Date

Filing Date

Title

US18/461,459

US11876858B1

( en )

2023-09-05

2023-09-05

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Related Child Applications (1)

Application Number

Title

Priority Date

Filing Date

US18/524,506

Continuation

US12034801B1

( en )

2023-09-05

2023-11-30

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Publications (1)

Publication Number

Publication Date

US11876858B1

true

US11876858B1 ( en )

2024-01-16

Family

ID=89511333

Family Applications (3)

Application Number

Title

Priority Date

Filing Date

US18/461,459

Active

US11876858B1

( en )

2023-09-05

2023-09-05

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US18/524,506

Active

US12034801B1

( en )

2023-09-05

2023-11-30

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US18/626,231

Pending

US20250077216A1

( en )

2023-09-05

2024-04-03

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Family Applications After (2)

Application Number

Title

Priority Date

Filing Date

US18/524,506

Active

US12034801B1

( en )

2023-09-05

2023-11-30

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US18/626,231

Pending

US20250077216A1

( en )

2023-09-05

2024-04-03

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

Country Status (1)

Country

Link

US

( 3 )

US11876858B1

( en )

Cited By (21)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20230224211A1

( en )

*

2012-01-20

2023-07-13

Salesforce, Inc.

Site management in an on-demand system

US20240161125A1

( en )

*

2022-10-31

2024-05-16

Tata Consultancy Services Limited

Method and system for data regulations-aware cloud storage and processing service allocation

CN118105091A

( en )

*

2024-01-29

2024-05-31

天津大学

A research method on audiovisual time perception mechanism based on attention compensation

CN118174761A

( en )

*

2024-03-27

2024-06-11

浙江大学

A downlink transmission method without physical layer channel feedback based on wireless map

CN118736847A

( en )

*

2024-09-04

2024-10-01

四川华体照明科技股份有限公司

Edge computing gateway data processing method and gateway

US12111744B1

( en )

*

2023-09-05

2024-10-08

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12131242B1

( en )

2023-09-05

2024-10-29

Armada Systems Inc.

Fleet and asset management for edge computing of machine learning and artificial intelligence workloads deployed from cloud to edge

US12147430B1

( en )

2023-09-05

2024-11-19

Armada Systems Inc.

Real-time search and retrieval of streaming sensor data

US12159535B1

( en )

2023-10-24

2024-12-03

Armada Systems Inc.

Fleet and asset management and interfaces thereof associated with edge computing deployments

US20250077216A1

( en )

*

2023-09-05

2025-03-06

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12261827B1

( en )

2024-01-19

2025-03-25

Auradine, Inc.

Proxy servers for managing queries to large language models

US20250132970A1

( en )

*

2023-10-19

2025-04-24

At&amp;T Intellectual Property I, L.P.

Anomaly detection based on multi-modal data analysis

US12333462B2

( en )

2023-09-05

2025-06-17

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12361220B1

( en )

2024-11-27

2025-07-15

Alpha Deal Llc

Customized integrated entity analysis using an artificial intelligence (AI) model

US12406084B1

( en )

2024-11-27

2025-09-02

Alpha Deal Llc

Providing access to composite AI-generated data

US12438917B1

( en )

*

2023-09-15

2025-10-07

Auradine, Inc.

Network security gateway

US20250323842A1

( en )

*

2024-04-16

2025-10-16

Honeywell International Inc.

Implementing observability of an asset in a cloud based environment

EP4672099A1

( en )

*

2024-06-25

2025-12-31

ARINC Incorporated

AIR AND SPACE SYSTEMS

US12524809B1

( en )

2024-11-27

2026-01-13

Alpha Deal Llc

Evaluating tokenized entities using an artificial intelligence (AI) model

US20260039711A1

( en )

*

2024-08-01

2026-02-05

Wiz, Inc.

System and method for cloud computing resource optimization for cybersecurity inspection

US12572551B1

( en )

2024-11-27

2026-03-10

Alpha Deal Llc

User interaction within a data analysis system

Families Citing this family (5)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20250200034A1

( en )

*

2023-12-19

2025-06-19

Yahoo Ad Tech Llc

System and method for mining data using generative ai

US12360753B2

( en )

*

2023-12-20

2025-07-15

Citibank, N.A.

Automating efficient deployment of artificial intelligence models

US12204565B1

( en )

2023-12-20

2025-01-21

Citibank, N.A.

Artificial intelligence sandbox for automating development of AI models

US11971891B1

( en )

2023-12-20

2024-04-30

Citibank, N.A.

Accessing siloed data across disparate locations via a unified metadata graph systems and methods

US12488225B1

( en )

*

2025-02-08

2025-12-02

Royce Geospatial Consultants, Inc.

Modular open system architecture for common intelligence picture generation

Citations (4)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20200136994A1

( en )

*

2019-09-28

2020-04-30

Intel Corporation

Methods and apparatus to aggregate telemetry data in an edge environment

US20200267053A1

( en )

*

2019-02-15

2020-08-20

Samsung Electronics Co., Ltd.

Systems and methods for latency-aware edge computing

US20200374974A1

( en )

*

2019-05-23

2020-11-26

Verizon Patent And Licensing Inc.

System and method for sharing multi-access edge computing resources in a wireless network

US20200379805A1

( en )

*

2019-05-30

2020-12-03

Microsoft Technology Licensing, Llc

Automated cloud-edge streaming workload distribution and bidirectional migration with lossless, once-only processing

Family Cites Families (21)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US10061791B2

( en )

2013-10-30

2018-08-28

Microsoft Technology Licensing, Llc

Data management for connected devices

US11087236B2

( en )

2016-07-29

2021-08-10

Splunk Inc.

Transmitting machine learning models to edge devices for edge analytics

US10984045B2

( en )

2017-05-24

2021-04-20

International Business Machines Corporation

Neural bit embeddings for graphs

US12293260B2

( en )

2017-11-21

2025-05-06

Amazon Technologies, Inc.

Generating and deploying packages for machine learning at edge devices

US11494693B2

( en )

2018-06-01

2022-11-08

Nami Ml Inc.

Machine learning model re-training based on distributed feedback

US11170320B2

( en )

2018-07-19

2021-11-09

Adobe Inc.

Updating machine learning models on edge servers

US20200160207A1

( en )

2018-11-15

2020-05-21

General Electric Company

Automated model update based on model deterioration

US11616839B2

( en )

2019-04-09

2023-03-28

Johnson Controls Tyco IP Holdings LLP

Intelligent edge computing platform with machine learning capability

US11868754B2

( en )

2020-07-17

2024-01-09

Sensia Llc

Systems and methods for edge device management

US20220060455A1

( en )

2020-08-21

2022-02-24

Microsoft Technology Licensing, Llc

Secure computing device

US20200401891A1

( en )

2020-09-04

2020-12-24

Intel Corporation

Methods and apparatus for hardware-aware machine learning model training

JP2024502009A

( en )

*

2020-12-30

2024-01-17

レベル スリー コミュニケーションズ，エルエルシー

Edge compute environment configuration tool

US20220303280A1

( en )

*

2021-03-19

2022-09-22

Seagate Technology Llc

Monitoring trust levels of nodes in a computer network

US11558451B2

( en )

2021-04-19

2023-01-17

International Business Machines Corporation

Machine learning based application deployment

US11238849B1

( en )

2021-05-31

2022-02-01

Rockspoon, Inc.

System and method for federated, context-sensitive, adaptive language models

US20230021216A1

( en )

2021-07-09

2023-01-19

Mantech International Corporation

Systems and methods for deploying secure edge platforms

US11995476B1

( en )

*

2021-09-22

2024-05-28

Amazon Technologies, Inc.

Client-configurable retention periods for machine learning service-managed resources

US12367249B2

( en )

2021-10-19

2025-07-22

Intel Corporation

Framework for optimization of machine learning architectures

US20220150125A1

( en )

2021-12-22

2022-05-12

Intel Corporation

AI Named Function Infrastructure and Methods

US11876858B1

( en )

*

2023-09-05

2024-01-16

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US11907093B1

( en )

*

2023-09-05

2024-02-20

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

2023

2023-09-05

US

US18/461,459

patent/US11876858B1/en

active

Active

2023-11-30

US

US18/524,506

patent/US12034801B1/en

active

Active

2024

2024-04-03

US

US18/626,231

patent/US20250077216A1/en

active

Pending

Patent Citations (4)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20200267053A1

( en )

*

2019-02-15

2020-08-20

Samsung Electronics Co., Ltd.

Systems and methods for latency-aware edge computing

US20200374974A1

( en )

*

2019-05-23

2020-11-26

Verizon Patent And Licensing Inc.

System and method for sharing multi-access edge computing resources in a wireless network

US20200379805A1

( en )

*

2019-05-30

2020-12-03

Microsoft Technology Licensing, Llc

Automated cloud-edge streaming workload distribution and bidirectional migration with lossless, once-only processing

US20200136994A1

( en )

*

2019-09-28

2020-04-30

Intel Corporation

Methods and apparatus to aggregate telemetry data in an edge environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party

Title

Huang, Lei, et al.; " Armada: A Robust Latency-Sensitive Edge Cloud in Heterogeneous Edge-Dense Environments "; pp. 13; Nov. 23, 2021.

Huang, Lei; " Armada: A Robust Latency-Sensitive Edge Cloud in Heterogeneous Edge-Dense Environments "; Jul. 2021; pp. 55.

Cited By (23)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US12375343B2

( en )

*

2012-01-20

2025-07-29

Salesforce, Inc.

Site management in an on-demand system

US20230224211A1

( en )

*

2012-01-20

2023-07-13

Salesforce, Inc.

Site management in an on-demand system

US20240161125A1

( en )

*

2022-10-31

2024-05-16

Tata Consultancy Services Limited

Method and system for data regulations-aware cloud storage and processing service allocation

US12423712B2

( en )

*

2022-10-31

2025-09-23

Tata Consultancy Services Limited

Method and system for data regulations-aware cloud storage and processing service allocation

US12333462B2

( en )

2023-09-05

2025-06-17

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12111744B1

( en )

*

2023-09-05

2024-10-08

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12131242B1

( en )

2023-09-05

2024-10-29

Armada Systems Inc.

Fleet and asset management for edge computing of machine learning and artificial intelligence workloads deployed from cloud to edge

US12147430B1

( en )

2023-09-05

2024-11-19

Armada Systems Inc.

Real-time search and retrieval of streaming sensor data

US20250077216A1

( en )

*

2023-09-05

2025-03-06

Armada Systems Inc.

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12438917B1

( en )

*

2023-09-15

2025-10-07

Auradine, Inc.

Network security gateway

US20250132970A1

( en )

*

2023-10-19

2025-04-24

At&amp;T Intellectual Property I, L.P.

Anomaly detection based on multi-modal data analysis

US12159535B1

( en )

2023-10-24

2024-12-03

Armada Systems Inc.

Fleet and asset management and interfaces thereof associated with edge computing deployments

US12261827B1

( en )

2024-01-19

2025-03-25

Auradine, Inc.

Proxy servers for managing queries to large language models

CN118105091A

( en )

*

2024-01-29

2024-05-31

天津大学

A research method on audiovisual time perception mechanism based on attention compensation

CN118174761A

( en )

*

2024-03-27

2024-06-11

浙江大学

A downlink transmission method without physical layer channel feedback based on wireless map

US20250323842A1

( en )

*

2024-04-16

2025-10-16

Honeywell International Inc.

Implementing observability of an asset in a cloud based environment

EP4672099A1

( en )

*

2024-06-25

2025-12-31

ARINC Incorporated

AIR AND SPACE SYSTEMS

US20260039711A1

( en )

*

2024-08-01

2026-02-05

Wiz, Inc.

System and method for cloud computing resource optimization for cybersecurity inspection

CN118736847A

( en )

*

2024-09-04

2024-10-01

四川华体照明科技股份有限公司

Edge computing gateway data processing method and gateway

US12361220B1

( en )

2024-11-27

2025-07-15

Alpha Deal Llc

Customized integrated entity analysis using an artificial intelligence (AI) model

US12406084B1

( en )

2024-11-27

2025-09-02

Alpha Deal Llc

Providing access to composite AI-generated data

US12524809B1

( en )

2024-11-27

2026-01-13

Alpha Deal Llc

Evaluating tokenized entities using an artificial intelligence (AI) model

US12572551B1

( en )

2024-11-27

2026-03-10

Alpha Deal Llc

User interaction within a data analysis system

Also Published As

Publication number

Publication date

US12034801B1

( en )

2024-07-09

US20250077216A1

( en )

2025-03-06

Similar Documents

Publication

Publication Date

Title

US12034801B1

( en )

2024-07-09

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12033006B1

( en )

2024-07-09

Edge deployment of cloud-originated machine learning and artificial intelligence workloads

US12111744B1

( en )

2024-10-08

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US12131242B1

( en )

2024-10-29

Fleet and asset management for edge computing of machine learning and artificial intelligence workloads deployed from cloud to edge

US12333462B2

( en )

2025-06-17

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US11935416B1

( en )

2024-03-19

Fleet and asset management and interfaces thereof associated with edge computing deployments

US12014634B1

( en )

2024-06-18

Cloud-based fleet and asset management for edge computing of machine learning and artificial intelligence workloads

US20240015196A1

( en )

2024-01-11

Low latency wireless communication system for teleoperated vehicle environments

US20250156244A1

( en )

2025-05-15

Containerized data center apparatus for resilient and self-contained high-performance computing at the edge

US11228501B2

( en )

2022-01-18

Apparatus and method for object classification based on imagery

US20250333194A1

( en )

2025-10-30

Real-time unmanned aerial vehicle connectivity

US12561332B2

( en )

2026-02-24

Real-time search and retrieval of streaming sensor data

US20260042552A1

( en )

2026-02-12

System and method for satellite-based masking and amplification

Yin et al.

2022

Cybertwin-enabled 6G space-air-ground integrated networks: Architecture, open issue, and challenges

US12376088B2

( en )

2025-07-29

Intelligent real-time carrier selection for UAVs

Zhao et al.

2025

Energy-efficient over-the-air computation for federated generative model fine-tuning in unmanned vehicle-assisted disaster relief

AU2024336986A1

( en )

2026-04-16

Fleet and asset management for edge computing of machine learning and artificial intelligence workloads deployed from cloud to edge

WO2025053870A1

( en )

2025-03-13

Edge deployment of cloud-originated machine learning and artificial intelligence workloads

US20250141740A1

( en )

2025-05-01

Network management and control with containerized router applications and multiple communication network modalities at the edge

WO2026090177A1

( en )

2026-04-30

Containerized data center apparatus for resilient and self-contained high-performance computing at the edge

Ding et al.

2024

Mobile Edge Computing and Communications: Driving Forces, Technology Foundation, and Application Areas

Wallace et al.

0

A High-Performance 5G/6G Framework for Deep-Space Missions with Multi-Level AI

Jiang et al.

0

Multimodal Data Analysis in Satellite-Ground Twin Networks

Legal Events

Date

Code

Title

Description

2023-09-05

FEPP

Fee payment procedure

Free format text : ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

2023-09-13

FEPP

Fee payment procedure

Free format text : ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

2023-12-27

STCF

Information on status: patent grant

Free format text : PATENTED CASE

Related documents

• Generating augmented reality experiences utilizing physical objects to … — Meta Platforms Technologies, Llc (US20260037214A1)#653960
• Virtual reality system using multiple force arrays for a solver — DeepMotion, Inc. (US10657696B2)#653961
• Tracking position of device inside-out for virtual reality interactivity — Sony Interactive Entertainment America Llc (US10535153B2)#653962
• Augmented reality system with spatialized audio tied to user manipulated … — Magic Leap, Inc. (US11231770B2)#653963
• Big data-based autonomous flight drone system and autonomous flight method … — Rgblab Co., Ltd. (US20210390867A1)#653964