Conceptio › Archive › Google Patents

Google Patentsopen access

Analyzing augmented reality content usage data — Snap Inc. (US12413643B2)

Snap Inc. · Google Patents

Google Patents · Patents · License: Open Access

Open Source ↗

snapinc.

patent, google patents, intellectual property, US12413643B2, Snap Inc., Jean Luo, en, 2025

ABSTRACT

Abstract

In one or more implementations, user interfaces may be generated that include user interface elements that enable the tracking or monitoring of interactions with augmented reality content by users of a client application. Usage metrics for augmented reality content may be collected and analyzed. In addition, information about client application users that interact with augmented reality content may be generated. In one or more examples, characteristics of users of the client application that interact with one or more augmented reality content items may be analyzed to determine a user characterization for one or more augmented reality content items. The usage metrics and user characterizations for augmented reality content items may be presented via a dashboard that is accessible to creators of augmented reality content.

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No. 18/310,367, filed May 1, 2023, which application is a continuation of U.S. patent application Ser. No. 17/362,623, filed Jun. 29, 2021, now issued as U.S. Pat. No. 11,641,403, which patent application claims the benefit of U.S. Provisional Patent Application No. 62/705,468, filed Jun. 29, 2020, entitled âANALYZING AUGMENTED REALITY CONTENT USAGE DATAâ, which are incorporated by reference herein in their entirety.

BACKGROUND

Applications executed by client devices may be used to generate content. For example, client applications may be used to generate messaging content, image content, video content, audio content, media overlays, documents, creative works, combinations thereof, and the like. In various situations, user content may be modified by augmented reality content.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. To easily identify the discussion of any particular element or act, the most significant digit or digits in a reference number refer to the figure number in which that element is first introduced. Some implementations are illustrated by way of example, and not limitation.

FIG. 1 is a diagrammatic representation of an architecture for exchanging data (e.g., messages and associated content) over a network, according to one or more example implementations.

FIG. 2 is a diagrammatic representation of a system, in accordance with some examples, that may have both client-side and server-side functionality.

FIG. 3 is a schematic diagram illustrating data that may be stored in a database of a server system, according to one or more example implementations.

FIG. 4 is a schematic diagram illustrating an example framework for content that may be accessible via a client application, in accordance with one or more example implementations.

FIG. 5 is a diagrammatic representation illustrating an architecture to analyze augmented reality content usage data, in accordance with one or more example implementations.

FIG. 6 is a flowchart illustrating example operations of a process to determine a characterization of client application users that interact with one or more augmented reality content items, according to one or more example implementations.

FIG. 7 is an illustration of a user interface that includes features that may be incorporated into augmented reality content, according to one or more example implementations.

FIG. 8 is an illustration of a user interface that includes user content to which an augmented reality content item may be applied, according to one or more example implementations.

FIG. 9 is an illustration of a user interface that includes augmented reality content that is applied to user content with a number of features of the augmented reality content being associated with a selectable user interface element, according to one or more example implementations.

FIG. 10 is a representation of an environment that includes a client device that displays a user interface including information about one or more augmented reality content items of an AR content creator, according to one or more example implementations.

FIG. 11 is a representation of an environment that includes a client device that displays an additional user interface including information about one or more augmented reality content items of an AR content creator, according to one or more example implementations.

FIG. 12 is a representation of an environment that includes a client device that displays a user interface including information that characterizes users of a client application that interact with augmented reality content items, according to one or more example implementations.

FIG. 13 is a block diagram illustrating components of a machine, in the form of a computer system, that may read and execute instructions from one or more machine-readable media to perform any one or more methodologies described herein, in accordance with one or more example implementations.

FIG. 14 is block diagram illustrating a representative software architecture that may be used in conjunction with one or more hardware architectures described herein, in accordance with one or more example implementations.

DETAILED DESCRIPTION

Individuals and organizations may create augmented reality content that may be consumed by users of a client application that may execute the augmented reality content. For example, augmented reality content may be created that modifies an appearance of one or more objects included in user content, where the user content may include at least one of image content, video content, or audio content captured via one or more input devices of a client device. To illustrate, augmented reality content may modify an appearance of one or more individuals included in user content. In one or more examples, the augmented reality content may modify user content by adding at least one of image content or video content to user content that modifies an appearance of an object included in the user content. In various examples, the augmented reality content may overlay at least a portion of an object included in the user content. Additionally, the augmented reality content may modify pixel data of image content or video content to change an appearance of at least one object included in the user content.

In existing systems and methods, the amount of information that augmented reality content creators may obtain about the use of their augmented reality content is limited. In one or more examples, augmented reality content creators may obtain information indicating an amount of time that users of a client application have viewed the augmented reality content or a number of times that the augmented reality content has been shared with additional users of the client application. In addition, augmented reality content creators are, at best, able to obtain limited information about the characteristics of users of the client application that are consuming the augmented reality content generated by these creators. Existing systems and methods generate augmented reality content that lacks the technical functionality to track the usage of augmented reality content in ways that provide more robust information to augmented reality content creators about the use of the augmented reality content they have created. In particular, during the creation of augmented reality content, existing systems and methods provide limited granularity with respect to the interactions that users have with augmented reality content. Further, the technical infrastructure used by existing systems and methods limits the availability and the amount of information about characteristics of users that interact with augmented reality content.

The systems, methods, techniques, instruction sequences, and computing machine program products described herein are directed to collecting and analyzing augmented reality content usage data. The implementations described herein may be used to obtain additional information related to the use of augmented reality content that is not available with existing systems and methods. For example, implementations described herein may collect profile information of users of a client application that interact with augmented reality content. Implementations described herein may also analyze the information collected about the client application users. In this way, the systems and methods described herein may provide detailed information to augmented reality content creators about the users that consume the augmented reality content generated by these creators. In one or more scenarios, augmented reality content creators may tailor their augmented reality content to an audience of additional client application users based on the characteristics of client application users that have previously interacted with their augmented reality content. Additionally, augmented reality content creators may implement campaigns to bring awareness of their augmented reality content to additional client application users that share characteristics with client application users that have previously interacted with the augmented reality content generated by these creators.

In various examples, the systems and methods described herein may enable creators of augmented reality content to tie a number of specific user interface elements to features of augmented reality content items. For example, creators of augmented reality content may select features of their augmented reality content items for which to track user interactions with the features. To illustrate, an augmented reality content item may include a number of features that client application users may interact with and a creator of the augmented reality content item may indicate one or more of the features to associate with a selectable user interface element. In these situations, user input indicating that at least one of the selectable user interface elements has been chosen may be collected and analyzed. In this way, additional interactions by client application users with augmented reality content may be tracked that are not able to be captured by existing systems and methods and a greater degree of granularity with respect to interactions with features of augmented reality content items may be tracked in relation to existing systems and methods. In one or more examples, metrics indicating the amount of user interaction with respect to an augmented reality content item or the amount of user interaction with features of the augmented reality content item may be determined based on the data obtained from tracking the selection of user interface elements that correspond to the augmented reality content item.

The systems and methods described herein may also determine profile information of client application users that interact with augmented reality content. In various examples, implementations described herein may identify interactions by client application users with augmented reality content and store profile information of the client applications users in association with the augmented reality content. The systems and methods described herein may then analyze the user profile information to determine a characterization of client application users that interact with the augmented reality content. The characterization of client application users may indicate characteristics of client application users that interact with the augmented reality content. In one or more examples, the profile information of client application users that interact with the augmented reality content may be analyzed to determine a target audience for the augmented reality content.

Accordingly, the systems, methods, techniques, instruction sequences, and computing machine program products described herein provide various implementations to collect more information about the use of augmented reality content than existing systems and methods by providing an underlying technical architecture that enables the tracking of interactions by client application users with various features of augmented reality content items. The systems and methods described herein also provide additional insights in relation to existing systems and methods for augmented reality content creators with regard to the client application users that interact with the augmented reality content items generated by these creators. In this way, the augmented reality content creators may identify client application users that are more likely to interact with their augmented reality content than existing systems and methods. In situations where the augmented reality content is related to one or more products, the augmented reality content creators are more likely to identify client application users that will purchase their products than existing systems and methods.

FIG. 1 is a diagrammatic representation of an architecture 100 for exchanging data (e.g., messages and associated content) over a network. The architecture 100 may include multiple client devices 102 . The client devices 102 may individually comprise, but are not limited to, a mobile phone, a desktop computer, a laptop computing device, a portable digital assistant (PDA), smart phone, tablet computing device, ultrabook, netbook, multi-processor system, microprocessor-based or programmable consumer electronic system, game console, set-top box, computer in a vehicle, a wearable device, one or more combinations thereof, or any other communication device that a user may utilize to access one or more components included in the architecture 100 .

Each client device 102 may host a number of applications, including a client application 104 and one or more third-party applications 106 . A user may use the client application 104 to create content, such as video, images (e.g., photographs), audio, and media overlays. In one or more illustrative examples, the client application 104 may include a social networking functionality that enables users to create and exchange content. In various examples, the client application 104 may include messaging functionality that may be used to send messages between instances of the client application 104 executed by various client devices 102 . The messages created using the client application 104 may include video, one or more images, audio, media overlays, text, content produced using one or more creative tools, annotations, and the like. In one or more implementations, the client application 104 may be used to view and generate interactive messages, view locations of other users of the client application 104 on a map, chat with other users of the client application 104 , and so forth.

One or more users may be a person, a machine, or other means of interacting with a client device, such as the client device 102 . In example implementations, the user may not be part of the architecture 100 but may interact with one or more components of the architecture 100 via a client device 102 or other means. In various examples, users may provide input (e.g., touch screen input or alphanumeric input) to a client device 102 and the input may be communicated to other entities in the architecture 100 . In this instance, the other entities in the architecture 100 , responsive to the user input, may communicate information to a client device 102 to be presented to the users. In this way, users may interact with the various entities in the architecture 100 using the client device 102 .

CROSS-REFERENCE TO RELATED APPLICATION

BACKGROUND

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic representation of an architecture for exchanging data (e.g., messages and associated content) over a network, according to one or more example implementations.

FIG. 2 is a diagrammatic representation of a system, in accordance with some examples, that may have both client-side and server-side functionality.

FIG. 3 is a schematic diagram illustrating data that may be stored in a database of a server system, according to one or more example implementations.

FIG. 4 is a schematic diagram illustrating an example framework for content that may be accessible via a client application, in accordance with one or more example implementations.

FIG. 5 is a diagrammatic representation illustrating an architecture to analyze augmented reality content usage data, in accordance with one or more example implementations.

FIG. 7 is an illustration of a user interface that includes features that may be incorporated into augmented reality content, according to one or more example implementations.

FIG. 8 is an illustration of a user interface that includes user content to which an augmented reality content item may be applied, according to one or more example implementations.

DETAILED DESCRIPTION

Each instance of the client application 104 is able to communicate and exchange data with at least one of another instance of the client application 104 , one or more third-party applications 106 , or a server system 108 . The data exchanged between instances of the client applications 104 , between the third-party applications 106 , and between instances of the client application 104 and the server system 108 includes functions (e.g., commands to invoke functions) and payload data (e.g., text, audio, image, video, or other multimedia data). Data exchanged between instances of the client applications 104 , between the third-party applications 106 , and between at least one instance of the client application 104 and at least one third-party application 106 may be exchanged directly from an instance of an application executed by a client device 102 and an instance of an application executed by an additional client device 102 . Further, data exchanged between the client applications 104 , between the third-party applications 106 , and between at least one client application 104 and at least one third-party application 106 may be communicated indirectly (e.g., via one or more intermediate servers) from an instance of an application executed by a client device 102 to another instance of an application executed by an additional client device 102 . In one or more illustrative examples, the one or more intermediate servers used in indirect communications between applications may be included in the server system 108 .

The third-party application(s) 106 may be separate and distinct from the client application 104 . The third-party application(s) 106 may be downloaded and installed by the client device 102 separately from the client application 104 . In various implementations, the third-party application(s) 106 may be downloaded and installed by the client device 102 before or after the client application 104 is downloaded and installed. The third-party application(s) 106 may be an application that is provided by an entity or organization that is different from the entity or organization that provides the client application 104 . The third-party application(s) 106 may be accessed by the client device 102 using separate login credentials than the client application 104 . Namely, the third-party application(s) 106 may maintain a first user account and the client application 104 may maintain a second user account. In one or more implementations, the third-party application(s) 106 may be accessed by the client device 102 to perform various activities and interactions, such as listening to music, videos, track exercises, view graphical elements (e.g., stickers), communicate with other users, and so forth. As an example, the third-party application(s) 106 may include a social networking application, a dating application, a ride or car sharing application, a shopping application, a trading application, a gaming application, an imaging application, a music application, a video browsing application, an exercise tracking application, a health monitoring application, a graphical element or sticker browsing application, or any other suitable application.

The server system 108 provides server-side functionality via one or more networks 110 to the client application 104 . The server system 108 may be a cloud computing environment, according to some example implementations. For example, the server system 108 , and one or more servers associated with the server system 108 , may be associated with a cloud-based application, in one illustrative example. In one or more implementations, the client device 102 and the server system 108 may be coupled via the one or more networks 110 .

The server system 108 supports various services and operations that are provided to the client application 104 . Such operations include transmitting data to, receiving data from, and processing data generated by the client application 104 . This data may include message content, media content, client device information, geolocation information, media annotation and overlays, message content persistence conditions, social network information, and live event information, as examples. Data exchanges within the architecture 100 are invoked and controlled through functions available via user interfaces (UIs) of the client application 104 .

While certain functions of the architecture 100 are described herein as being performed by either a client application 104 or by the server system 108 , the location of functionality either within the client application 104 or the server system 108 is a design choice. For example, it may be technically preferable to initially deploy certain technology and functionality within the server system 108 , but to later migrate this technology and functionality to the client application 104 where a client device 102 has a sufficient processing capacity.

The server system 108 includes an Application Programming Interface (API) server 112 that is coupled to, and provides a programmatic interface to, an application server 114 . The application server 114 is communicatively coupled to a database server 116 that facilitates access to one or more databases 118 . The one or more databases 118 may store data associated with information processed by the application server 114 . The one or more databases 118 may be storage devices that store information such as untreated media content, original media content from users (e.g., high-quality media content), processed media content (e.g., media content that is formatted for sharing with client devices 102 and viewing on client devices 102 ), context data related to a media content item, context data related to a user device (e.g., a computing or client device 102 ), media overlays, media overlay smart widgets or smart elements, user data, user device information, media content (e.g., video and images), media content data (e.g., data associated with video and images), computing device context data, serialized data, session data items, user device location data, mapping information, interactive message usage data, interactive message metrics data, and so forth. The one or more databases 118 may further store information related to third-party servers, client devices 102 , client applications 104 , users, third-party applications 106 , and so forth.

The API server 112 receives and transmits data (e.g., commands and message payloads) between client devices 102 and the application server 114 . Specifically, the Application Program Interface (API) server 112 provides a set of interfaces (e.g., routines and protocols) that can be called or queried by the client application 104 in order to invoke functionality of the application server 114 . The Application Program Interface (API) server 112 exposes various functions supported by the application server 114 , including account registration, login functionality, the sending of messages, via the application server 114 , from one instance of the client application 104 to another instance of the client application 104 , the sending of media files (e.g., images, audio, video) from a client application 104 to the application server 114 , and for possible access by another client application 104 , the setting of a collection of media content (e.g., a gallery, story, message collection, or media collection), the retrieval of a list of friends of a user of a client device 102 , the retrieval of such collections, the retrieval of messages and content, the adding and deletion of friends to a social graph, the location of friends within a social graph, and opening an application event (e.g., relating to the client application 104 ).

The server system 108 may also include a web server 120 . The web server 120 is coupled to the application servers 114 , and provides web-based interfaces to the application servers 114 . To this end, the web server 120 processes incoming network requests over the Hypertext Transfer Protocol (HTTP) and several other related protocols.

The application server 114 hosts a number of applications and subsystems, including a messaging application system 122 , a media content processing system 124 , a social network system 126 , an augmented reality (AR) content creation system 128 , an AR content usage system 130 , and a content management system 132 . The messaging application system 122 implements a number of message processing technologies and functions, particularly related to the aggregation and other processing of content (e.g., textual and multimedia content) included in messages received from multiple instances of the client application 104 . For example, the messaging application system 122 may deliver messages using electronic mail (email), instant messaging (IM), Short Message Service (SMS), text, facsimile, or voice (e.g., Voice over IP (VoIP)) messages via wired networks (e.g., the Internet), plain old telephone service (POTS), or wireless networks (e.g., mobile, cellular, WIFI, Long Term Evolution (LTE), or Bluetooth). The messaging application system 122 may aggregate text and media content from multiple sources into collections of content. These collections are then made available, by the messaging application system 122 , to the client application 104 . Other processor- and memory-intensive processing of data may also be performed server-side by the messaging application system 122 , in view of the hardware requirements for such processing.

The media content processing system 124 is dedicated to performing various media content processing operations, typically with respect to images, audio, or video received within the payload of a message or other content item at the messaging application system 122 . The media content processing system 124 may access one or more data storages (e.g., the database(s) 118 ) to retrieve stored data to use in processing media content and to store results of processed media content.

The social network system 126 supports various social networking functions and services, and makes these functions and services available to the messaging application system 122 . To this end, the social network system 126 maintains and accesses an entity graph within the database(s) 118 . Examples of functions and services supported by the social network system 126 include the identification of other users of the client application 104 with which a particular user has relationships or is âfollowingâ, and also the identification of other entities and interests of a particular user. The social network system 126 may access location information associated with each of the user's friends or other social network connections to determine where they live or are currently located geographically. In addition, the social network system 126 may maintain a location profile for each of the user's friends indicating the geographical location where the user's friends live.

The AR content creation system 128 may be used to generate AR content 134 that includes a number of AR content items 136 . Individual AR content items 136 may include computer-readable instructions that are executable to modify user content captured by the client device 102 . In various examples, the AR content creation system 128 may provide one or more user interfaces that may be used to create the AR content 134 . For example, the AR content creation system 128 may provide one or more user interfaces to import content that may be used to create one or more of the AR content items 136 . To illustrate, the AR content creation system 128 may provide one or more user interfaces to import at least one of image content, video content, or audio content that may be used to generate an AR content item 136 . The AR content creation system 128 may also provide one or more user interfaces with one or more creative tools that may be used to create one or more of the AR content items 136 . In one or more illustrative examples, the AR content creation system 128 may implement at least one of a drawing tool, a writing tool, a sketching tool, or a coloring tool that may be used to generate the AR content 134 .

The AR content creation system 128 may also enable a creator of an AR content item 136 to provide an indication that interactions by users of the client application 104 with the AR content item 136 are to be monitored or tracked. In one or more examples, the AR content creation system may enable a creator of the AR content item 136 to identify one or more features of the AR content item 136 to be tracked. The features of AR content items 136 that are being tracked may be included in tracked features 138 . In one or more illustrative examples, the AR content creation system 128 may provide one or more user interfaces that enable the selection of one or more features of the AR content items 136 that are to be tracked. In various examples, a user interface tool, such as a cursor or pointer, may be used to indicate a feature of an AR content item 136 or a region of an AR content item 136 for which user interactions are to be tracked. Tracking the use of AR content items 136 may comprise at least one of identifying or counting interactions with the AR content items 136 by users of the client application 104 . Interactions with an AR content item 136 may include at least one of applying an AR content item 136 to user content, sharing an AR content item 136 with another user of the client application 104 , generating a message that includes the AR content item 136 or a link corresponding to the AR content item 136 , activating a feature of the AR content item 136 , selecting a user interface element that corresponds to a feature of the AR content item 136 , unlocking the AR content item 136 , purchasing the AR content item 136 , or selecting an icon that corresponds to the AR content item 136 .

In one or more implementations, the AR content creation system 128 may provide one or more templates that indicate features of AR content 134 that may be tracked. The AR content creation system 128 may provide one or more templates for specified classifications of AR content 134 . For example, the AR content creation system 128 may provide a template for AR content items 136 that include faces, where the template indicates that one or more facial features included in the AR content item 136 may be tracked. In one or more additional examples, the AR content creation system 128 may provide a template for AR content items 136 that include products that may be purchased via the client application 104 . In these scenarios, the AR content creation system 128 may provide a template that indicates one or more features of the product, such as features that enable magnification of a view of the product, features that enable rotation of a view of the product, or features that enable the product to be applied to one or more objects. In one or more scenarios where the AR content item 136 is related to a beauty product, the AR content creation system 128 may provide a template that enables the beauty product to be applied to one or more facial features of an individual included in a user content item.

In various examples, the tracked features 138 may be associated with user interface elements that a user of the client application 104 may interact with. In one or more examples, the tracked features 138 may correspond to a portion of a user interface that may detect input by a user of the client application 104 . The input may be detected by using an input device, such as at least one of a cursor, stylus, finger, another implement, or a speaker of a client device 102 . The input may be directed to selection of a user interface element, moving the user interface element, or another method of indicating an interaction with a tracked feature 138 . In this way, input detected by a user interface element corresponding to a tracked feature 138 of an AR content item 136 may be collected, stored, such as in the database(s) 118 , and analyzed.

The AR content usage system 130 may determine an amount of usage of AR content 134 . The amount of usage of the AR content 134 may be determined based on an amount of interaction with one or more tracked features 138 of each AR content item 136 included in the AR content 134 . Each interaction by a user of the client application 104 with a tracked feature 138 may be counted by the AR content usage system 130 and stored in the database(s) 118 . In various examples, the database(s) 118 may include one or more data structures for individual AR content items 136 , and the one or more data structures for each AR content item 136 may indicate a number of interactions by users of the client application 104 with one or more of the tracked features 138 . In one or more examples, an AR content item 136 may have multiple tracked features 138 . In these scenarios, a data structure corresponding to the AR content item 136 may indicate at least one of interactions related to each of the tracked features 138 of the AR content item 136 or interactions related to a combination of the tracked features 138 of the AR content item 136 .

In one or more examples, the AR content usage system 130 may also track one or more metrics related to the usage of one or more tracked features 138 of one or more AR content items 136 included in the AR content 134 . For example, the AR content usage system 130 may determine a number of times that the AR content item 136 was shared with another user of the client application 104 and a number of times that the AR content item 136 was included in a message sent to another user of the client application 104 . Additionally, the AR content usage system 130 may determine a number of times that the AR content item 136 was applied to user content and a number of times that a tracked feature 138 of the AR content item 136 was selected by a user of the client application 104 . In additional examples, the AR content usage system 130 may collectively track the usage of a number of the tracked features 138 of one or more AR content items 136 included in the AR content 134 . To illustrate, the AR content usage system 130 may determine a total number of interactions related to the AR content item 136 . In these situations, the AR content usage system 130 may determine a sum that includes a number of times that the AR content item 136 has been shared, a number of times that the AR content item 136 has been related to a message, a number of times that the AR content item 136 has been applied to user content, and a number of times that tracked features 138 of the AR content item 136 have been interacted with by users of the client application 104 .

In various examples, the AR content usage data 140 may be associated with user profile data 144 . For example, the AR content usage system 130 may identify users of the client application 104 that interact with the AR content 134 . In one or more examples, identifiers of users of the client application 104 may be determined by the AR content usage system 130 . Based on identifying users of the client application 104 that interacted with one or more AR content items 136 , the AR content usage system 130 may determine characteristics of the users. In one or more examples, the AR content usage system 130 may determine demographic information related to users that interact with AR content items 136 , such as age, gender, occupation, education, one or more combinations thereof, and the like. In additional examples, the AR content usage system 130 may determine location information of users of the client application 104 that interact with AR content items 136 . In various examples, the location information may be determined based on at least one of user input or geographic positioning system (GPS) data.

In further examples, that AR content usage system 130 may determine additional information about users of the client application 104 that correspond to interactions by the users of client application 104 with content consumed via the client application 104 . For example, the AR content usage system 130 may determine usage metrics for one or more features of the client application 104 in relation to users of the client application 104 that interact with AR content 134 . To illustrate, the AR content usage system 130 may determine an amount of usage of one or more social networking features of the client application 104 by users of the client application 104 that interact with one or more AR content items 136 . The AR content usage system 130 may also determine an amount of usage of one or more messaging features of the client application 104 by users of the client application 104 that interact with one or more AR content items 136 . In addition, the AR content usage system 130 may determine an amount of usage of one or more search features of the client application 104 by users of the client application 104 that interact with one or more AR content items 136 . Further, the AR content usage system 130 may determine sources of content that are accessed by users of the client application 104 that interact with one or more AR content items 136 . The sources of content may include one or more additional users of the client application 104 , one or more media organizations, one or more news organizations, one or more fashion organizations, one or more retailers, one or more manufacturers, one or more governmental organizations, one or more authors, one or more blogs, one or more websites, one or more periodicals, one or more combinations thereof, and so forth. In various examples, the AR content usage system 130 may also determine types of AR content 134 that are interacted with by users of the client application 104 . In one or more illustrative examples, the AR content usage system 130 may determine interactions with AR content items 136 that comprise overlays of at least one of image content or video content by users of the client application 104 . Additionally, the AR content usage system 130 may determine interactions with AR content items 136 that include animations created by users of the client application 104 .

In one or more implementations, the AR content usage system 130 may determine characterizations of users of the client application 104 that interact with one or more AR content items 136 In one or more examples, the AR content usage system 130 may determine one or more characteristics of users of the client application 104 that interact with an AR content item 136 . In various examples, the AR content usage system 130 may determine a characterization of users of the client application 104 that interact with the AR content item 136 by determining one or more characteristics that are associated with at least a threshold number of the users of the client application 104 that interact with the AR content item 136 . For example, the AR content usage system 130 may determine one or more demographic characteristics that are common to at least a threshold number of users of the client application 104 that interact with the AR content item 136 . The AR content usage system 130 may also determine one or more location characteristics that are common to at least a threshold number of users of the client application 104 that interact with the AR content item 136 . In additional examples, the AR content usage system 130 may determine one or more AR content usage characteristics that are common to at least a threshold number of users of the client application 104 that interact with the AR content item 136 .

Based on characteristics of users of the client application 104 that interact with the AR content item 136 , the AR content usage system 130 may determine a target audience for the AR content item 136 . The target audience for the AR content item 136 may correspond to users of the client application 104 that have at least a threshold likelihood of interacting with the AR content item 136 . In this way, the characterization of users of the client application 104 that may interact with the AR content item 136 may provide insight to one or more creators of the AR content item 136 . Thus, the one or more creators of the AR content item 136 may identify users of the client application 104 that have not previously interacted with the AR content item 136 , but have at least a threshold likelihood of interacting with the AR content item 136 . In these scenarios, the one or more creators of the AR content item 136 may cause the server system 108 to bring awareness to the target audience of the AR content item 136 . The server system 108 may bring awareness of the AR content item 136 to the target audience via at least one of advertisements or recommendations related to the AR content item 136 . Further, the server system 108 may bring awareness of the AR content item 136 to the target audience by increasing the weighting of the AR content item 136 in search results for AR content 134 submitted by users of the client application 104 included in the target audience.

The content management system 132 may generate user interface data that corresponds to user interfaces that include information about usage metrics with respect to one or more AR content items 136 . The content management system 132 may also generate user interface data that includes information indicating characteristics of users of the client application 104 that interact with one or more AR content items 136 . In various examples, creators of AR content 134 may send requests to the server system 108 for information about users of the client application 104 that interact with one or more AR content items 136 generated by the creators. The requests may be directed to metrics related to specified characteristics of users of the client application 104 that interact with one or more AR content items 136 generated by an augmented reality content creator. For example, an augmented reality content creator may send a request to the server system 108 to obtain at least one of age, location, gender, occupation, or education of users of the client application 104 that interact with one or more AR content items 136 of the augmented reality content creator. In an additional example, the server system 108 may receive a request from an augmented reality content creator to obtain at least one of a frequency of interaction with AR content 134 generally or a frequency of interaction of a type of AR content 134 interacted with by users of the client application 104 that also interact with one or more AR content items 136 of the augmented reality content creator. In various examples, the content management system 132 may provide one or more templates that may be used by augmented reality content creators to request information about at least one of interactions with AR content items 136 of the creators or characteristics of users of the client application 104 that interact with AR content items 136 of the creator.

In response to a request from an augmented reality content creator for information about one or more of the augmented reality content items produced by the creator, the content management system 132 may operate in conjunction with the AR content usage system 130 to determine at least one of augmented reality content usage metrics or characteristics of users of the client application 104 related to the AR content 134 of the creator. The content management system 132 may then generate user interface data that indicates the information satisfying the request. In various examples, the content management system 132 may generate user interface data that corresponds to a dashboard that is accessible to augmented reality content creators, where the dashboard includes information corresponding to an information request received by the server system 108 from the creator. In one or more examples, the dashboard may include one or more standardized features that include information about the use of AR content 134 that are provided to each augmented reality content creator requesting augmented reality content information from the server system 108 . In additional examples, the dashboard may include one or more customized features that include information about the use of AR content 134 based on specific requests of augmented reality content creators that are received by the server system 108 .

FIG. 2 is a block diagram illustrating further details regarding the server system 108 , according to some examples. Specifically, the server system 108 is shown to comprise the client application 104 and the application servers 114 . The server system 108 embodies a number of subsystems, which are supported on the client-side by the client application 104 and on the sever-side by the application servers 114 . These subsystems include, for example, an ephemeral timer system 202 , a collection management system 204 , an augmentation system 206 , a map system 208 , a game system 210 , the AR content creation system 128 , the AR content usage system 130 , and the content management system 132 .

The ephemeral timer system 202 is responsible for enforcing the temporary or time-limited access to content by the client application 104 and the messaging application system 122 . The ephemeral timer system 202 incorporates a number of timers that, based on duration and display parameters associated with a message, or collection of messages (e.g., a story), selectively enable access (e.g., for presentation and display) to messages and associated content via the client application 104 . Further details regarding the operation of the ephemeral timer system 202 are provided below.

The collection management system 204 is responsible for managing sets or collections of media (e.g., collections of text, image video, and audio data). A collection of content (e.g., messages, including images, video, text, and audio) may be organized into an âevent galleryâ or an âevent story.â Such a collection may be made available for a specified time period, such as the duration of an event to which the content relates. For example, content relating to a music concert may be made available as a âstoryâ for the duration of that music concert. The collection management system 204 may also be responsible for publishing an icon that provides notification of the existence of a particular collection to the user interface of the client application 104 .

The collection management system 204 furthermore includes a curation interface 212 that allows a collection manager to manage and curate a particular collection of content. For example, the curation interface 212 enables an event organizer to curate a collection of content relating to a specific event (e.g., delete inappropriate content or redundant messages). Additionally, the collection management system 204 employs machine vision (or image recognition technology) and content rules to automatically curate a content collection. In certain examples, compensation may be paid to a user for the inclusion of user-generated content into a collection. In such cases, the collection management system 204 operates to automatically make payments to such users for the use of their content.

The augmentation system 206 provides various functions that enable a user to augment (e.g., annotate or otherwise modify or edit) media content associated with content produced via the client application 104 , such as a message. For example, the augmentation system 206 provides functions related to the generation and publishing of media overlays for content processed by the server system 108 . The augmentation system 206 operatively supplies a media overlay or augmentation (e.g., an image filter) to the client application 104 based on a geolocation of the client device 102 . In another example, the augmentation system 206 operatively supplies a media overlay to the client application 104 based on other information, such as social network information of the user of the client device 102 . A media overlay may include audio and visual content and visual effects. Examples of audio and visual content include pictures, texts, logos, animations, and sound effects. An example of a visual effect includes color overlaying. The audio and visual content or the visual effects can be applied to a media content item (e.g., a photo) at the client device 102 . For example, the media overlay may include text or image that can be overlaid on top of a photograph taken by the client device 102 . In another example, the media overlay includes an identification of a location overlay (e.g., Venice beach), a name of a live event, or a name of a merchant overlay (e.g., Beach Coffee House). In another example, the augmentation system 206 uses the geolocation of the client device 102 to identify a media overlay that includes the name of a merchant at the geolocation of the client device 102 . The media overlay may include other indicia associated with the merchant. The media overlays may be stored in the database(s) 118 and accessed through the database server(s) 116 .

In some examples, the augmentation system 206 provides a user-based publication platform that enables users to select a geolocation on a map and upload content associated with the selected geolocation. The user may also specify circumstances under which a particular media overlay should be offered to other users. The augmentation system 206 generates a media overlay that includes the uploaded content and associates the uploaded content with the selected geolocation.

In other examples, the augmentation system 206 provides a merchant-based publication platform that enables merchants to select a particular media overlay associated with a geolocation via a bidding process. For example, the augmentation system 206 associates the media overlay of the highest bidding merchant with a corresponding geolocation for a predefined amount of time.

The map system 208 provides various geographic location functions, and supports the presentation of map-based media content and messages by the client application 104 . For example, the map system 208 enables the display of user icons or avatars (e.g., stored in profile data 308 of FIG. 3 ) on a map to indicate a current or past location of âfriendsâ of a user, as well as media content (e.g., collections of messages including photographs and videos) generated by such friends, within the context of a map. For example, a message posted by a user to the server system 108 from a specific geographic location may be displayed within the context of a map at that particular location to âfriendsâ of a specific user on a map interface of the client application 104 . A user can furthermore share his or her location and status information (e.g., using an appropriate status avatar) with other users of the server system 108 via the client application 104 , with this location and status information being similarly displayed within the context of a map interface of the client application 104 to selected users.

The game system 210 provides various gaming functions within the context of the client application 104 . The client application 104 provides a game interface providing a list of available games that can be launched by a user within the context of the client application 104 , and played with other users of the server system 108 . The server system 108 further enables a particular user to invite other users to participate in the play of a specific game, by issuing invitations to such other users from the client application 104 . The client application 104 also supports both the voice and text messaging (e.g., chats) within the context of gameplay, provides a leaderboard for the games, and also supports the provision of in-game rewards (e.g., coins and items).

The AR content creation system 128 may generate one or more user interfaces that accept input that may be used to generate augmented reality content. The input obtained via the one or more user interfaces may be used to determine one or more features to associate with augmented reality content. In various examples, the one or more user interfaces generated using data from the AR content creation system 128 may include creative tools that enable users to associate one or more visual effects with augmented reality content. In one or more examples, the one or more user interfaces generated using data obtained from the AR content creation system 128 may associate one or more audio effects with augmented reality content. The augmentation system 206 may operate in conjunction with the AR content creation system 128 to generate augmented reality content according to the input obtained via the user interfaces generated by the AR content creation system 128 . For example, the augmentation system 206 may operate in conjunction with the AR content creation system 128 to generate computer-readable instructions that correspond to augmented reality content that are executable to produce at least one of visual effects or audio effects in relation to user content.

CLAIMS

Claims ( 20 )

What is claimed is:

1. A method comprising:

capturing, by one or more computing devices, augmented reality content creation data that corresponds to generating one or more augmented reality content items that are executable to modify user content captured by one or more cameras;

causing, by the one or more computing devices, a first user interface of an augmented reality content creator dashboard to be displayed that includes first values of one or more characteristics of users that interacted with the one or more augmented reality content items; and

causing, by the one or more computing devices, a second user interface of the augmented reality content creator dashboard to be displayed that indicates second values of one or more usage metrics indicating interactions of the users with the one or more augmented reality content items.

2. The method of claim 1 , wherein;

the one or more augmented reality content items correspond to one or more products; and

the one or more usage metrics are related to purchasing the one or more products.

3. The method of claim 1 , wherein the interactions of the users with the one or more augmented reality content items correspond to a number of times that an individual augmented reality content item of the one or more augmented reality content items has been shared by one or more of the users.

4. The method of claim 1 , wherein the one or more characteristics of the users that interacted with the one or more augmented reality content items include one or more locations of the users that interacted with the one or more augmented reality content items.

5. The method of claim 1 , wherein the interactions of the users with the one or more augmented reality content items correspond to a number of times that an individual augmented reality content item of the one or more augmented reality content items has been viewed by one or more of the users.

6. The method of claim 1 , wherein the interactions of the users with the one or more augmented reality content items correspond to a number of messages related to an augmented reality content item of the one or more augmented reality content items.

7. The method of claim 1 , wherein the one or more usage metrics indicate a frequency of interaction with an augmented reality content item of the one or more augmented reality content items.

8. The method of claim 1 , wherein at least one of the first user interface or the second user interface include a group of user interface elements with individual user interface elements of the group of user interface elements corresponding to individual augmented reality content items of a plurality of augmented reality content items of an augmented reality content creator.

9. The method of claim 1 , wherein the second user interface includes a user interface element that is selectable to view additional values of the one or more usage metrics with respect to an additional augmented reality content item of a plurality of augmented reality content items of an augmented reality content creator.

10. The method of claim 1 , wherein the second user interface indicates at least one of a total number of views of a plurality of augmented reality content items of an augmented reality content creator, a total number of shares of the plurality of augmented reality content items of the augmented reality content creator, or a total number of messages related to the plurality of augmented reality content items of an augmented reality content creator.

11. The method of claim 1 , wherein that one or more augmented reality content items correspond to one or more advertisements.

12. The method of claim 1 , wherein at least one of the first values of one or more characteristics of the users that interacted with the one or more augmented reality content items or the second values of the one or more usage metrics are displayed via at least one of one or more charts, one or more tables, or one or more graphs.

13. A computing apparatus comprising:

one or more hardware processors; and

memory storing computer-readable instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:

capturing augmented reality content creation data that corresponds to generating one or more augmented reality content items that are executable to modify user content captured by one or more cameras;

causing a first user interface of an augmented reality content creator dashboard to be displayed that includes first values of one or more characteristics of users that interacted with the one or more augmented reality content items; and

causing a second user interface of the augmented reality content creator dashboard to be displayed that indicates second values of one or more usage metrics indicating interactions of the users with the one or more augmented reality content items.

14. The computing apparatus of claim 13 , wherein the one or more augmented reality content items are related to an advertisement campaign.

15. The computing apparatus of claim 13 , wherein capturing the augmented reality content creation data includes capturing, via one or more user interface elements, information indicating at least one of a user characteristic or a usage metric that is to be tracked in relation to the one or more augmented reality content items.

16. The computing apparatus of claim 13 , wherein the memory stores additional computer-readable instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform additional operations comprising:

displaying one or more additional user interfaces to capture input indicating one or more channels to be used to promote the one or more augmented reality content items, the one or more channels including at least one of presenting the one or more augmented reality content items in results for searches of augmented reality content that correspond or providing the one or more augmented reality content items in recommendations for augmented reality content to one or more users.

17. The computing apparatus of claim 13 , wherein:

the first user interface includes one or more first options that are individually selectable to display at least a portion of the first values corresponding to a characteristic of the one or more characteristics of the users that interacted with the one or more augmented reality content items; and

the second user interface includes one or more second options that are individually selectable to display at least a portion of the second values corresponding to a usage metric of the one or more usage metrics.

18. One or more computer-readable storage media storing computer-readable instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to perform operations comprising:

19. The one or more computer-readable storage media of claim 18 , wherein:

an augmented reality content item of the one or more augmented reality content items includes a feature of a product that corresponds to a user interface element displayed in conjunction with the augmented reality content item, the user interface element being selectable to apply one or more visual effects to one or more user content items; and

the one or more usage metrics indicate a number of selections of the user interface element.

20. The one or more computer-readable storage media of claim 18 , storing additional computer-readable instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to perform additional operations comprising:

causing one or more additional user interfaces to be displayed as part of a tool to build augmented reality content items, the one or more additional user interfaces including one or more user interface elements that enable selection of one or more features of an augmented reality content item, wherein selection of the one or more features of the augmented reality content item using the tool causes interaction with the one or more features to be tracked in relation to the one or more usage metrics and the one or more features are included in a template of the tool.

US18/665,936

2020-06-29

2024-05-16

Analyzing augmented reality content usage data

Active

US12413643B2

( en )

Priority Applications (2)

Application Number

Priority Date

Filing Date

Title

US18/665,936

US12413643B2

( en )

2020-06-29

2024-05-16

Analyzing augmented reality content usage data

US19/287,727

US20250350663A1

( en )

2020-06-29

2025-07-31

Analyzing augmented reality content usage data

Applications Claiming Priority (4)

Application Number

Priority Date

Filing Date

Title

US202062705468P

2020-06-29

US17/362,623

US11641403B2

( en )

2020-06-29

2021-06-29

Analyzing augmented reality content usage data

US18/310,367

US12015671B2

( en )

2020-06-29

2023-05-01

Analyzing augmented reality content usage data

US18/665,936

US12413643B2

( en )

2020-06-29

2024-05-16

Analyzing augmented reality content usage data

Related Parent Applications (1)

Application Number

Title

Priority Date

Filing Date

US18/310,367

Continuation

US12015671B2

( en )

2020-06-29

2023-05-01

Analyzing augmented reality content usage data

Related Child Applications (1)

Application Number

Title

Priority Date

Filing Date

US19/287,727

Continuation

US20250350663A1

( en )

2020-06-29

2025-07-31

Analyzing augmented reality content usage data

Publications (2)

Publication Number

Publication Date

US20240305691A1

US20240305691A1 ( en )

2024-09-12

US12413643B2

true

US12413643B2 ( en )

2025-09-09

Family

ID=79030673

Family Applications (4)

Application Number

Title

Priority Date

Filing Date

US17/362,623

Active

US11641403B2

( en )

2020-06-29

2021-06-29

Analyzing augmented reality content usage data

US18/310,367

Active

US12015671B2

( en )

2020-06-29

2023-05-01

Analyzing augmented reality content usage data

US18/665,936

Active

US12413643B2

( en )

2020-06-29

2024-05-16

Analyzing augmented reality content usage data

US19/287,727

Pending

US20250350663A1

( en )

2020-06-29

2025-07-31

Analyzing augmented reality content usage data

Family Applications Before (2)

Application Number

Title

Priority Date

Filing Date

US17/362,623

Active

US11641403B2

( en )

2020-06-29

2021-06-29

Analyzing augmented reality content usage data

US18/310,367

Active

US12015671B2

( en )

2020-06-29

2023-05-01

Analyzing augmented reality content usage data

Family Applications After (1)

Application Number

Title

Priority Date

Filing Date

US19/287,727

Pending

US20250350663A1

( en )

2020-06-29

2025-07-31

Analyzing augmented reality content usage data

Country Status (5)

Country

Link

( 4 )

US11641403B2

( en )

( 1 )

EP4172957A4

( en )

( 2 )

KR20250111229A

( en )

( 2 )

CN121982267A

( en )

( 1 )

WO2022006162A1

( en )

Families Citing this family (18)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US11641403B2

( en )

2020-06-29

2023-05-02

Snap Inc.

Analyzing augmented reality content usage data

US11689487B1

( en )

2020-07-16

2023-06-27

Kynami, Inc.

System and method for identifying and blocking trolls on social networks

US11656681B2

( en )

2020-08-31

2023-05-23

Hypear, Inc.

System and method for determining user interactions with visual content presented in a mixed reality environment

US11360733B2

( en )

2020-09-10

2022-06-14

Snap Inc.

Colocated shared augmented reality without shared backend

US12573100B2

( en )

2021-03-31

2026-03-10

Snap Inc.

User-defined contextual spaces

US20220319124A1

( en )

2021-03-31

2022-10-06

Snap Inc.

Auto-filling virtual content

US12315495B2

( en )

2021-12-17

2025-05-27

Snap Inc.

Speech to entity

US12142257B2

( en )

2022-02-08

2024-11-12

Snap Inc.

Emotion-based text to speech

US12499628B2

( en )

2022-04-19

2025-12-16

Snap Inc.

Augmented reality experiences with dynamically loadable assets

US12272007B2

( en )

2022-04-25

2025-04-08

Snap Inc.

Persisting augmented reality experiences

US12293433B2

( en )

2022-04-25

2025-05-06

Snap Inc.

Real-time modifications in augmented reality experiences

US11949527B2

( en )

2022-04-25

2024-04-02

Snap Inc.

Shared augmented reality experience in video chat

US11894989B2

( en )

2022-04-25

2024-02-06

Snap Inc.

Augmented reality experience event metrics system

US12136160B2

( en )

2022-04-27

2024-11-05

Snap Inc.

Augmented reality experience power usage prediction

US12361934B2

( en )

2022-07-14

2025-07-15

Snap Inc.

Boosting words in automated speech recognition

US12482131B2

( en )

2023-07-10

2025-11-25

Snap Inc.

Extended reality tracking using shared pose data

US20250259210A1

( en )

2024-02-12

2025-08-14

Jacob Elmon

System and method for displaying advertising boards

US20260072567A1

( en )

2024-09-06

2026-03-12

Snap, Inc.

Dynamic augmented reality content delivery platform

Citations (58)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20120242697A1

( en )

2010-02-28

2012-09-27

Osterhout Group, Inc.

See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light

US20120249797A1

( en )

2010-02-28

2012-10-04

Osterhout Group, Inc.

Head-worn adaptive display

CA2850234A1

( en )

2011-07-22

2013-01-31

Glitchsoft Corporation

Game enhancement system for gaming environment

US20130127980A1

( en )

2010-02-28

2013-05-23

Osterhout Group, Inc.

Video display modification based on sensor input for a see-through near-to-eye display

US20130278631A1

( en )

2010-02-28

2013-10-24

Osterhout Group, Inc.

3d positioning of augmented reality information

US20130314303A1

( en )

2010-02-28

2013-11-28

Osterhout Group, Inc.

Ar glasses with user action control of and between internal and external applications with feedback

US20140063055A1

( en )

2010-02-28

2014-03-06

Osterhout Group, Inc.

Ar glasses specific user interface and control interface based on a connected external device type

US20140063054A1

( en )

2010-02-28

2014-03-06

Osterhout Group, Inc.

Ar glasses specific control interface based on a connected external device type

US20140146084A1

( en )

2012-05-14

2014-05-29

Orbotix, Inc.

Augmentation of elements in data content

US20140188766A1

( en )

2012-07-12

2014-07-03

Spritz Technology Llc

Tracking content through serial presentation

US20150153922A1

( en )

2013-12-01

2015-06-04

Apx Labs, Llc

Systems and methods for unlocking a wearable device

AU2014248874A1

( en )

2013-03-11

2015-10-01

Magic Leap, Inc.

System and method for augmented and virtual reality

US20150309316A1

( en )

2011-04-06

2015-10-29

Microsoft Technology Licensing, Llc

Ar glasses with predictive control of external device based on event input

US20160187654A1

( en )

2011-02-28

2016-06-30

Microsoft Technology Licensing, Llc

See-through near-eye display glasses with a light transmissive wedge shaped illumination system

US20160253746A1

( en )

2015-02-27

2016-09-01

3D Product Imaging Inc.

Augmented reality e-commerce

US9754397B1

( en )

2017-04-07

2017-09-05

Mirage Worlds, Inc.

Systems and methods for contextual augmented reality sharing and performance

CA3031771A1

( en )

2016-07-25

2018-02-01

Magic Leap, Inc.

Imaging modification, display and visualization using augmented and virtual reality eyewear

EP3321795A1

( en )

2016-11-14

2018-05-16

Nokia Technologies OY

An apparatus and associated methods

US20180201012A1

( en )

2017-01-18

2018-07-19

Seiko Epson Corporation

Liquid ejecting apparatus, control device, recording system, control program of liquid ejecting apparatus, recording medium, and image forming method

US10091322B2

( en )

2011-10-18

2018-10-02

Qualcomm Incorporated

Method and apparatus for improving a user experience or device performance using an enriched user profile

US20180300747A1

( en )

2017-04-14

2018-10-18

Facebook, Inc.

Systems and methods for providing demographic analysis for media content based on user view or activity

KR20190009081A

( en )

2017-07-18

2019-01-28

ë¤ì´ë²ë©ì¤ ì£¼ìíì¬

Method and system for authoring ar content by collecting ar content templates based on crowdsourcing

US20190044989A1

( en )

2017-12-28

2019-02-07

Intel Corporation

Content provision based on usage analytics for multiple display receiver devices

US10248306B1

( en )

2017-12-20

2019-04-02

Motorola Mobility Llc

Systems and methods for end-users to link objects from images with digital content

US20190121522A1

( en )

2017-10-21

2019-04-25

EyeCam Inc.

Adaptive graphic user interfacing system

US20190278997A1

( en )

2016-10-13

2019-09-12

Alibaba Group Holding Limited

Offline-service multi-user interaction based on augmented reality

US20190362554A1

( en )

2018-05-25

2019-11-28

Leon Chen

Apparatus, method, and system for presentation of multimedia content including augmented reality content

US20190362551A1

( en )

2018-05-25

2019-11-28

Lowe's Companies, Inc.

System and techniques for automated mesh retopology

US10529139B1

( en )

2018-08-21

2020-01-07

Jeremy Greene

System, method, and apparatus for avatar-based augmented reality electronic messaging

US20200009040A1

( en )

2017-02-07

2020-01-09

Myocept Inc.

Topical formulations and methods

US20200035003A1

( en )

2018-07-24

2020-01-30

Snap Inc.

Conditional modification of augmented reality object

US20200066044A1

( en )

2018-08-24

2020-02-27

Facebook, Inc.

Suggestion of Content Within Augmented-Reality Environments

US20200090401A1

( en )

2018-09-14

2020-03-19

Facebook Technologies, Llc

Display opacity control for preventing view occlusion in artificial reality

US10679440B2

( en )

2015-05-01

2020-06-09

Assa Abloy Ab

Wearable misplacement

US20200186489A1

( en )

2018-12-05

2020-06-11

Snap Inc.

Ui and devices for incenting user contribution to social network content

US10706584B1

( en )

2018-05-18

2020-07-07

Facebook Technologies, Llc

Hand tracking using a passive camera system

US10706554B2

( en )

2017-04-14

2020-07-07

Adobe Inc.

Three-dimensional segmentation of digital models utilizing soft classification geometric tuning

US20200234502A1

( en )

2019-01-21

2020-07-23

Alexandre Van Anderlecht

Social Media Platform using Augmented Reality and Microlocation

US10754418B1

( en )

2018-04-11

2020-08-25

Amazon Technologies, Inc.

Using body surfaces for placing augmented reality content

US10803665B1

( en )

2017-09-26

2020-10-13

Amazon Technologies, Inc.

Data aggregation for augmented reality applications

US20200351637A1

( en )

2018-01-25

2020-11-05

Nokia Solutions And Networks Oy

Method and apparatus for handling user service profile information in a communications network implementing mobile edge computing (mec)

US20200364937A1

( en )

2019-05-16

2020-11-19

Subvrsive, Inc.

System-adaptive augmented reality

US10861422B1

( en )

2019-08-16

2020-12-08

Facebook Technologies, Inc.

Display rendering

CA2953335C

( en )

2014-06-14

2021-01-05

Magic Leap, Inc.

Methods and systems for creating virtual and augmented reality

US10885719B1

( en )

2016-10-14

2021-01-05

Floreo, Inc.

Methods and systems for treating autism

US10902395B1

( en )

2017-07-11

2021-01-26

Massachusetts Mutual Life Insurance Company

Intelligent e-book reader incorporating augmented reality or virtual reality

US11056040B1

( en )

2019-11-20

2021-07-06

Facebook Technologies, Llc

Systems and methods for mask-based temporal dithering

US11087442B1

( en )

2019-11-20

2021-08-10

Facebook Technologies, Llc

Mask-based spatio-temporal dithering

BR112021009887A2

( en )

2018-11-22

2021-08-17

Mixed Reality Solutions Pty Ltd

computer-implemented method that enables monitoring of user engagement with printed content, device configured to enable monitoring of user engagement with a physical substrate that carries printed material, and system configured to enable monitoring of user engagement with a physical substrate who carries printed material

US20210345016A1

( en )

2020-05-04

2021-11-04

Google Llc

Computer vision based extraction and overlay for instructional augmented reality

US11173391B1

( en )

2015-07-17

2021-11-16

Naveen Kumar

Systems and methods for computer assisted operation

US11206459B2

( en )

2017-06-28

2021-12-21

At&T Intellectual Property I, L.P.

Method and apparatus for augmented reality presentation associated with a media program

US20210409517A1

( en )

2020-06-29

2021-12-30

Snap Inc.

Analyzing augmented reality content usage data

US20210409502A1

( en )

2020-06-30

2021-12-30

Snap Inc.

Tracking usage of augmented reality content across multiple users

US20220055480A1

( en )

2020-08-24

2022-02-24

Samsung Electronics Co., Ltd.

Method and apparatus for controlling head-up display based on eye tracking status

US11449189B1

( en )

2019-10-02

2022-09-20

Facebook Technologies, Llc

Virtual reality-based augmented reality development system

US11641603B2

( en )

2017-10-10

2023-05-02

Telefonaktiebolaget Lm Ericsson (Publ)

Report NSA/SA NR indicator

US11676504B1

( en )

2019-08-13

2023-06-13

Amplify Education, Inc.

Adaptive educational activities

Family Cites Families (5)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20150206349A1

( en )

2012-08-22

2015-07-23

Goldrun Corporation

Augmented reality virtual content platform apparatuses, methods and systems

US20170329840A1

( en )

2016-05-16

2017-11-16

Peeractive, Inc.

Computerized system and method for performing a feature-based search and displaying an interactive dynamically updatable, multidimensional user interface therefrom

US10949872B2

( en )

2017-04-28

2021-03-16

Snap Inc.

Methods and systems for server generation of interactive advertising with content collections

US10430016B2

( en )

2017-12-22

2019-10-01

Snap Inc.

Augmented reality user interface control

US10939182B2

( en )

2018-01-31

2021-03-02

WowYow, Inc.

Methods and apparatus for media search, characterization, and augmented reality provision

2021

2021-06-29

US17/362,623

patent/US11641403B2/en

active

Active

2021-06-29

KR1020257022794A

patent/KR20250111229A/en

active

Pending

2021-06-29

CN202610022585.XA

patent/CN121982267A/en

active

Pending

2021-06-29

PCT/US2021/039695

patent/WO2022006162A1/en

not_active

Ceased

2021-06-29

KR1020237003280A

patent/KR102833108B1/en

active

Active

2021-06-29

CN202180045808.XA

patent/CN115803779B/en

active

Active

2021-06-29

EP21833565.1A

patent/EP4172957A4/en

active

Pending

2023

2023-05-01

US18/310,367

patent/US12015671B2/en

active

Active

2024

2024-05-16

US18/665,936

patent/US12413643B2/en

active

Active

2025

2025-07-31

US19/287,727

patent/US20250350663A1/en

active

Pending

Patent Citations (64)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20140063054A1

( en )

2010-02-28

2014-03-06

Osterhout Group, Inc.

Ar glasses specific control interface based on a connected external device type

US20120249797A1

( en )

2010-02-28

2012-10-04

Osterhout Group, Inc.

Head-worn adaptive display

US20120242697A1

( en )

2010-02-28

2012-09-27

Osterhout Group, Inc.

See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light

US20130127980A1

( en )

2010-02-28

2013-05-23

Osterhout Group, Inc.

Video display modification based on sensor input for a see-through near-to-eye display

US20130278631A1

( en )

2010-02-28

2013-10-24

Osterhout Group, Inc.

3d positioning of augmented reality information

US20130314303A1

( en )

2010-02-28

2013-11-28

Osterhout Group, Inc.

Ar glasses with user action control of and between internal and external applications with feedback

US20140063055A1

( en )

2010-02-28

2014-03-06

Osterhout Group, Inc.

Ar glasses specific user interface and control interface based on a connected external device type

US20160187654A1

( en )

2011-02-28

2016-06-30

Microsoft Technology Licensing, Llc

See-through near-eye display glasses with a light transmissive wedge shaped illumination system

US20150309316A1

( en )

2011-04-06

2015-10-29

Microsoft Technology Licensing, Llc

Ar glasses with predictive control of external device based on event input

CA2850234A1

( en )

2011-07-22

2013-01-31

Glitchsoft Corporation

Game enhancement system for gaming environment

US10091322B2

( en )

2011-10-18

2018-10-02

Qualcomm Incorporated

Method and apparatus for improving a user experience or device performance using an enriched user profile

US20140146084A1

( en )

2012-05-14

2014-05-29

Orbotix, Inc.

Augmentation of elements in data content

US20160155272A1

( en )

2012-05-14

2016-06-02

Sphero, Inc.

Augmentation of elements in a data content

US20140188766A1

( en )

2012-07-12

2014-07-03

Spritz Technology Llc

Tracking content through serial presentation

AU2014248874A1

( en )

2013-03-11

2015-10-01

Magic Leap, Inc.

System and method for augmented and virtual reality

US20150153922A1

( en )

2013-12-01

2015-06-04

Apx Labs, Llc

Systems and methods for unlocking a wearable device

CA2953335C

( en )

2014-06-14

2021-01-05

Magic Leap, Inc.

Methods and systems for creating virtual and augmented reality

Analyzing augmented reality content usage data — Snap Inc. (US12413643B2)

Related documents