ABSTRACT
Abstract
A system configured to generate and/or modify three-dimensional scenes comprising animated character(s) based on individual asynchronous motion capture recordings. The system may comprise sensor(s), display(s), and/or processor(s). The system may receive selection of a first character to virtually embody within the virtual space, receive a first request to capture the motion and/or the sound for the first character, and/or record first motion capture information characterizing the motion and/or the sound made by the first user as the first user virtually embodies the first character. The system may receive selection of a second character to virtually embody, receive a second request to capture the motion and/or the sound for the second character, and/or record second motion capture information. The system may generate a compiled virtual reality scene wherein the first character and the second character appear animated within the compiled virtual reality scene contemporaneously.
Description
FIELD OF THE DISCLOSURE
This disclosure relates to a system and method for animating characters based on motion capture and/or generating a compiled virtual reality scene based on individual asynchronous motion capture recordings.
BACKGROUND
Virtual reality headset display devices are known. These devices visually simulate a user's physical presence in a virtual space. Simulations typically include a 360° view of the user's surrounding virtual space such that user may turn his head, lean, walk, run, and/or otherwise physically maneuver to view and/or navigate different portions of the surrounding space.
Motion capture is generally known. A user's motions, sounds, and/or other actions may be captured by a computer and reflected in the motions, sounds, and/or other actions of a character within a scene.
SUMMARY
A system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings may enable one or more users to record and/or create virtual reality content asynchronously. The virtual reality content may include scenes depicting multiple characters and/or the interaction of the multiple characters with each other and/or the virtual environment. The system may enable one or more users to asynchronously record the actions of one or more of the multiple characters within the scene via motion capture. By way of non-limiting example, one or more users may individually record the characters (e.g., one at a time per user) that appear within the same compiled virtual reality scene contemporaneously. When recording the actions to be manifested by one or more of the characters within the compiled virtual reality scene contemporaneously, the one or more users may be able to see manifestations of the previous recorded actions of one or more of the users by one or more other characters. As such, the user recording their actions for a given character may be able to interact with and/or react to previously recorded characters contemporaneously as will be reflected in the compiled virtual reality scene.
As used herein, âvirtual realityâ may refer to what is traditionally considered virtual reality as well as augmented reality, mixed reality (MR), and/or other similar concepts. In some implementations, âvirtual realityâ may refer to a form of virtual reality/augmented reality hybrid and/or include an aspect and/or ability to view content in an augmented reality way.
In some implementations, the system may comprise one or more: sensors, computing device(s), displays, server(s), processor(s), electronic storage, and/or other components. The sensors may be configured to generate output signals conveying information related to related to motion, sound, and/or other actions made by one or more users in physical space. The sensors may be configured to capture the motion and/or the sound made by the one or more users.
The user interface may include a display and/or other components. The display may be configured to present the virtual reality content to the user. The display(s) may be configured to present virtual reality content to the one or more users. Presentation of the virtual reality content via a display may simulate the presence of a user within a virtual space. The virtual space may be fixed relative to physical space. The one or more display(s) may be configured to present options for recording the motion and/or the sound for one or more of the characters within the virtual space. The display may be controlled by the processor to present the virtual reality content to the user.
A system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings may include one or more server(s) and/or one or more computing device(s). The server(s) may include one or more processors configured by machine-readable instructions to execute computer program components. The processor may be configured to execute computer program components. The computer program components may be configured to enable an expert and/or user to interface with the system and/or provide other functionality attributed herein to the computing devices, the sensor, the electronic storage, and/or the processor. The server(s) may include one or more processors configured by machine-readable instructions to execute computer program components. The computer program components may include one or more of: a display component, a selection component, a motion capture component, a compilation component, and/or other components.
The display component may be configured to cause the display(s) to present the virtual reality content, an editing scene, the compiled virtual reality scene, and/or other content to the user. The display component may be configured to provide and/or transmit the virtual reality content over the network to one or more computing devices for viewing, recording, editing, and/or otherwise creating and/or sharing the compiled virtual reality scene.
In some implementations, the virtual reality content may include an editing scene. The editing scene may be an editing version of the compiled scene that is presented to the one or more users while recording motion capture information for one or more characters. The display component may be configured to generate, provide, and/or transmit information for providing the editing scene to uses via the one or more computing device(s).
The selection component may be configured to receive selection of one or more characters to virtually embody within the virtual space. Selection of the one or more characters to virtually embody may be input by the one or more users via the user interface. Virtually embodying a character within the virtual space may include experiencing and/or interacting with the virtual space as the character. Virtually embodying a character may enable a user to record the motion and/or the sound made by the character within the compiled virtual reality scene. In some implementations, selection of a first character to virtually embody within the virtual space may be received by the selection component. Responsive to receiving selection of the first character by the selection component, the system may enable the first user to record the motion, the sound, and/or other actions to be made by the first character within the compiled virtual reality scene.
The motion capture component may be configured to receive one or more requests to capture the motion and/or the sound for one or more characters within the compiled virtual reality scene. A request to capture the motion and/or sound for a character may initiate recording of the motion, sound, and/or other actions of a user to be manifested by the character within the compiled virtual reality scene. In some implementations, the motion capture component may receive a first request to capture the motion, the sound, and/or other actions for the first character.
The motion capture component may be configured to record motion capture information characterizing the motion and/or the sound made by a user as the user virtually embodies a character. The motion capture component may record the motion capture information based on the output signals generated by the sensors.
In some implementations, the motion capture component may be configured to record first motion capture information characterizing the motion, the sound, and/or other actions made by the first user as the first user virtually embodies the first character. The first motion capture information may be captured in a manner such that the actions of the first user may be manifested by the first character within the compiled virtual reality scene.
The selection component may be configured to receive selection of a second character to virtually embody. The second character may be separate and distinct from the first character. Virtually embodying the second character may enable the first user or another user to record one or more of the motion, the sound, and/or other actions to be made by the second character within the compiled virtual reality scene.
The motion capture component may be configured to receive a second request to capture the motion, the sound, and/or other actions for the second character. The motion capture component may be configured to record second motion capture information that characterizes the motion, the sound, and/or the other actions made by the first user or other user as the first user or the other user virtually embodies the second character. The second motion capture information may be captured in a manner such that the actions of the first user or the other user are manifested by the second character within the compiled virtual reality scene. The actions of the first user or the other user may be manifested by the second character within the compiled virtual reality scene contemporaneously with the actions of the first user manifested by the first character within the compiled virtual reality scene. By way of non-limiting example, the first character, the second character, and/or other characters may appear to interact with each other and/or react to occurrences (e.g., actions by one or more characters, and/or other occurrences within the virtual space) performed within the same compiled virtual reality scene.
The compilation component may be configured to generate the compiled virtual reality scene. In some implementations, compiling the compiled virtual reality scene may include receiving the compiled virtual reality scene from one or more servers associated with the system. The compiled virtual reality scene may include animation of the first character, the second character, and/or other characters such that the first character, the second character, and/or the other characters appear animated within the compiled virtual reality scene contemporaneously.
These and other features, and characteristics of the present technology, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of the invention. As used in the specification and in the claims, the singular form of âaâ, âanâ, and âtheâ include plural referents unless the context clearly dictates otherwise.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, in accordance with one or more implementations.
FIG. 2 , depicts a computing device illustrated as a virtual reality headset that is worn on the head of a user, in accordance with one or more implementations.
FIG. 3 illustrates a server configured to communicate with a computing device via a network, in accordance with one or more implementations.
FIG. 4 illustrates an editing scene presented to a user including options for virtual scenery themes selectable by the user, in accordance with one or more implementations.
FIG. 5 illustrates an editing scene presented to a user including options for characters a user may place within editing scene, in accordance with one or more implementations.
FIG. 6 illustrates an editing scene presented to a user responsive to the user selecting a virtual object, in accordance with one or more implementations.
FIG. 7 A illustrates an editing scene in which a user selects a character to virtually embody, in accordance with one or more implantations.
FIG. 7 B illustrates an editing scene wherein user is virtually embodying a character, in accordance with one or more implantations.
FIG. 8 illustrates an editing scene wherein a user is presented with facial expression options for a character, in accordance with one or more implementations.
FIG. 9 illustrates an editing scene depicting a manifestation of a user's previous actions by a first character, in accordance with one or more implementations.
FIG. 10 illustrates a compiled virtual reality scene, in accordance with one or more implementations.
FIG. 11 illustrates an implementation of a method for animating characters based on motion capture, and/or for playing back individual asynchronous motion capture recordings as a compiled virtual reality scene, in accordance with one or more implementations.
DETAILED DESCRIPTION
The present system may be configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings. The present system may enable one or more users to record and/or create virtual reality content by asynchronously recording individual characters via motion capture. The individual recordings may be combined into a compiled virtual reality scene having animated characters that are animated based on the motion capture information. The one or more users may individually record the motion, sound, and/or actions to be manifested by individual ones of the characters by initiating recording for a given character and performing the motion, sound, and/or other actions. The motion, sound, and/or actions to be manifested by individual ones of the characters within the compiled virtual reality scene may be characterized by motion capture information recorded by one or more sensors and/or other components of the computing device and/or the system. The motion capture information may be recorded individually and/or asynchronously such that an aggregation of the individual characters recorded (e.g., the compiled virtual reality scene) reflects the multiple characters acting, performing, and/or interacting contemporaneously within the same virtual reality scene (i.e., the compiled virtual reality scene).
FIG. 1 illustrates a system 10 configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, in accordance with one or more implementations. System 10 may include one or more sensors 18 configured to generate to capture the motion, the sound, and/or the other actions made by the one or more users. Capturing the motion of the one or more users may include capturing the physical movement and/or muscle articulation of at least a portion of the user's body (e.g., arms, legs, torso, head, knees, elbows, hands, feet, eyes, mouth, etc.). Capturing the motion of one or more users may include capturing the body position, movement and muscle articulation for large scale body poses and motions, and/or movement
FIELD OF THE DISCLOSURE
This disclosure relates to a system and method for animating characters based on motion capture and/or generating a compiled virtual reality scene based on individual asynchronous motion capture recordings.
BACKGROUND
Virtual reality headset display devices are known. These devices visually simulate a user's physical presence in a virtual space. Simulations typically include a 360° view of the user's surrounding virtual space such that user may turn his head, lean, walk, run, and/or otherwise physically maneuver to view and/or navigate different portions of the surrounding space.
Motion capture is generally known. A user's motions, sounds, and/or other actions may be captured by a computer and reflected in the motions, sounds, and/or other actions of a character within a scene.
SUMMARY
A system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings may enable one or more users to record and/or create virtual reality content asynchronously. The virtual reality content may include scenes depicting multiple characters and/or the interaction of the multiple characters with each other and/or the virtual environment. The system may enable one or more users to asynchronously record the actions of one or more of the multiple characters within the scene via motion capture. By way of non-limiting example, one or more users may individually record the characters (e.g., one at a time per user) that appear within the same compiled virtual reality scene contemporaneously. When recording the actions to be manifested by one or more of the characters within the compiled virtual reality scene contemporaneously, the one or more users may be able to see manifestations of the previous recorded actions of one or more of the users by one or more other characters. As such, the user recording their actions for a given character may be able to interact with and/or react to previously recorded characters contemporaneously as will be reflected in the compiled virtual reality scene.
As used herein, âvirtual realityâ may refer to what is traditionally considered virtual reality as well as augmented reality, mixed reality (MR), and/or other similar concepts. In some implementations, âvirtual realityâ may refer to a form of virtual reality/augmented reality hybrid and/or include an aspect and/or ability to view content in an augmented reality way.
In some implementations, the system may comprise one or more: sensors, computing device(s), displays, server(s), processor(s), electronic storage, and/or other components. The sensors may be configured to generate output signals conveying information related to related to motion, sound, and/or other actions made by one or more users in physical space. The sensors may be configured to capture the motion and/or the sound made by the one or more users.
The user interface may include a display and/or other components. The display may be configured to present the virtual reality content to the user. The display(s) may be configured to present virtual reality content to the one or more users. Presentation of the virtual reality content via a display may simulate the presence of a user within a virtual space. The virtual space may be fixed relative to physical space. The one or more display(s) may be configured to present options for recording the motion and/or the sound for one or more of the characters within the virtual space. The display may be controlled by the processor to present the virtual reality content to the user.
A system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings may include one or more server(s) and/or one or more computing device(s). The server(s) may include one or more processors configured by machine-readable instructions to execute computer program components. The processor may be configured to execute computer program components. The computer program components may be configured to enable an expert and/or user to interface with the system and/or provide other functionality attributed herein to the computing devices, the sensor, the electronic storage, and/or the processor. The server(s) may include one or more processors configured by machine-readable instructions to execute computer program components. The computer program components may include one or more of: a display component, a selection component, a motion capture component, a compilation component, and/or other components.
The display component may be configured to cause the display(s) to present the virtual reality content, an editing scene, the compiled virtual reality scene, and/or other content to the user. The display component may be configured to provide and/or transmit the virtual reality content over the network to one or more computing devices for viewing, recording, editing, and/or otherwise creating and/or sharing the compiled virtual reality scene.
In some implementations, the virtual reality content may include an editing scene. The editing scene may be an editing version of the compiled scene that is presented to the one or more users while recording motion capture information for one or more characters. The display component may be configured to generate, provide, and/or transmit information for providing the editing scene to uses via the one or more computing device(s).
The selection component may be configured to receive selection of one or more characters to virtually embody within the virtual space. Selection of the one or more characters to virtually embody may be input by the one or more users via the user interface. Virtually embodying a character within the virtual space may include experiencing and/or interacting with the virtual space as the character. Virtually embodying a character may enable a user to record the motion and/or the sound made by the character within the compiled virtual reality scene. In some implementations, selection of a first character to virtually embody within the virtual space may be received by the selection component. Responsive to receiving selection of the first character by the selection component, the system may enable the first user to record the motion, the sound, and/or other actions to be made by the first character within the compiled virtual reality scene.
The motion capture component may be configured to receive one or more requests to capture the motion and/or the sound for one or more characters within the compiled virtual reality scene. A request to capture the motion and/or sound for a character may initiate recording of the motion, sound, and/or other actions of a user to be manifested by the character within the compiled virtual reality scene. In some implementations, the motion capture component may receive a first request to capture the motion, the sound, and/or other actions for the first character.
The motion capture component may be configured to record motion capture information characterizing the motion and/or the sound made by a user as the user virtually embodies a character. The motion capture component may record the motion capture information based on the output signals generated by the sensors.
In some implementations, the motion capture component may be configured to record first motion capture information characterizing the motion, the sound, and/or other actions made by the first user as the first user virtually embodies the first character. The first motion capture information may be captured in a manner such that the actions of the first user may be manifested by the first character within the compiled virtual reality scene.
The selection component may be configured to receive selection of a second character to virtually embody. The second character may be separate and distinct from the first character. Virtually embodying the second character may enable the first user or another user to record one or more of the motion, the sound, and/or other actions to be made by the second character within the compiled virtual reality scene.
The motion capture component may be configured to receive a second request to capture the motion, the sound, and/or other actions for the second character. The motion capture component may be configured to record second motion capture information that characterizes the motion, the sound, and/or the other actions made by the first user or other user as the first user or the other user virtually embodies the second character. The second motion capture information may be captured in a manner such that the actions of the first user or the other user are manifested by the second character within the compiled virtual reality scene. The actions of the first user or the other user may be manifested by the second character within the compiled virtual reality scene contemporaneously with the actions of the first user manifested by the first character within the compiled virtual reality scene. By way of non-limiting example, the first character, the second character, and/or other characters may appear to interact with each other and/or react to occurrences (e.g., actions by one or more characters, and/or other occurrences within the virtual space) performed within the same compiled virtual reality scene.
The compilation component may be configured to generate the compiled virtual reality scene. In some implementations, compiling the compiled virtual reality scene may include receiving the compiled virtual reality scene from one or more servers associated with the system. The compiled virtual reality scene may include animation of the first character, the second character, and/or other characters such that the first character, the second character, and/or the other characters appear animated within the compiled virtual reality scene contemporaneously.
These and other features, and characteristics of the present technology, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of the invention. As used in the specification and in the claims, the singular form of âaâ, âanâ, and âtheâ include plural referents unless the context clearly dictates otherwise.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, in accordance with one or more implementations.
FIG. 2 , depicts a computing device illustrated as a virtual reality headset that is worn on the head of a user, in accordance with one or more implementations.
FIG. 3 illustrates a server configured to communicate with a computing device via a network, in accordance with one or more implementations.
FIG. 4 illustrates an editing scene presented to a user including options for virtual scenery themes selectable by the user, in accordance with one or more implementations.
FIG. 5 illustrates an editing scene presented to a user including options for characters a user may place within editing scene, in accordance with one or more implementations.
FIG. 6 illustrates an editing scene presented to a user responsive to the user selecting a virtual object, in accordance with one or more implementations.
FIG. 7 A illustrates an editing scene in which a user selects a character to virtually embody, in accordance with one or more implantations.
FIG. 7 B illustrates an editing scene wherein user is virtually embodying a character, in accordance with one or more implantations.
FIG. 8 illustrates an editing scene wherein a user is presented with facial expression options for a character, in accordance with one or more implementations.
FIG. 9 illustrates an editing scene depicting a manifestation of a user's previous actions by a first character, in accordance with one or more implementations.
FIG. 10 illustrates a compiled virtual reality scene, in accordance with one or more implementations.
FIG. 11 illustrates an implementation of a method for animating characters based on motion capture, and/or for playing back individual asynchronous motion capture recordings as a compiled virtual reality scene, in accordance with one or more implementations.
DETAILED DESCRIPTION
The present system may be configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings. The present system may enable one or more users to record and/or create virtual reality content by asynchronously recording individual characters via motion capture. The individual recordings may be combined into a compiled virtual reality scene having animated characters that are animated based on the motion capture information. The one or more users may individually record the motion, sound, and/or actions to be manifested by individual ones of the characters by initiating recording for a given character and performing the motion, sound, and/or other actions. The motion, sound, and/or actions to be manifested by individual ones of the characters within the compiled virtual reality scene may be characterized by motion capture information recorded by one or more sensors and/or other components of the computing device and/or the system. The motion capture information may be recorded individually and/or asynchronously such that an aggregation of the individual characters recorded (e.g., the compiled virtual reality scene) reflects the multiple characters acting, performing, and/or interacting contemporaneously within the same virtual reality scene (i.e., the compiled virtual reality scene).
FIG. 1 illustrates a system 10 configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, in accordance with one or more implementations. System 10 may include one or more sensors 18 configured to generate to capture the motion, the sound, and/or the other actions made by the one or more users. Capturing the motion of the one or more users may include capturing the physical movement and/or muscle articulation of at least a portion of the user's body (e.g., arms, legs, torso, head, knees, elbows, hands, feet, eyes, mouth, etc.). Capturing the motion of one or more users may include capturing the body position, movement and muscle articulation for large scale body poses and motions, and/or movement and muscle articulation for small scale things (e.g., eye direction, squinting, and/or other small scale movement and/or articulation). System 10 may include one or more displays that present content to one or more users. The content may include three-dimensional content, two-dimensional content, and/or other content. For example, the content may include one or more of virtual reality content, augmented reality content, mixed-media content, and/or other three-dimensional and/or two-dimensional content. Presentation of the virtual reality content via a display 16 may simulate presence of a user within a virtual space that is fixed relative to physical space. System 10 may include one or more physical processors 20 configured by machine- readable instructions 15 . System 10 may be configured to receive selection of a first character to virtually embody within the virtual space. Virtually embodying the first character may enable a first user to record the motion, the sound, and/or other actions to be made by the first character within the compiled virtual reality scene. System 10 may receive a first request to capture the motion, the sound, and/or other actions for the first character. System 10 may record first motion capture information characterizing the motion, the sound, and/or other actions made by the first user as the first user virtually embodies the first character.
The first motion capture information may be captured in a manner such that the actions of the first user may be manifested by the first character within the compiled virtual reality scene. System 10 may be configured to receive selection of a second character to virtually embody. The second character may be separate and distinct from the first character. Virtually embodying the second character may enable the first user or another user to record one or more of the motion, the sound, and/or other actions to be made by the second character within the compiled virtual reality scene. System 10 may receive a second request to capture the motion, the sound, and/or other actions for the second character. The system may be configured to record second motion capture information that characterizes the motion, the sound, and/or other actions made by the first user or other user as the first user or the other user virtually embodies the second character. The second motion capture information may be captured in a manner such that the actions of the first user or the other user may be manifested by the second character contemporaneously with the actions of the first user manifested by the first character within the compiled virtual reality scene. System 10 may be configured to generate the compiled virtual reality scene including animation of the first character, the second character, and/or other characters such that the first character, the second character, and/or other characters appear animated within the compiled virtual reality scene contemporaneously.
The compiled virtual reality scene may include one or more of a clip, show, movie, short film, and/or virtual reality experience recorded and/or generated based on motion capture of one or more users. By way of non-limiting example, motion capture may include tracking the motion, physical movements, and/or muscle articulations of one or more users. Motion capture may include one or more of body tracking, physical location tracking, facial tracking, eye tracking, hand tracking, foot tracking, elbow tracking, knee tracking, and/or any type of tracking that may enable recording and/or capture of users' motions, physical movements, muscle articulations, expressions, postures, reflexes, and/or other motions and/or movements. The compiled virtual reality scene may include animations of one or more characters, virtual objects, virtual scenery, virtual scenery objects, and/or other virtual items. The animations may be based on the motion capture of the one or more users while virtually embodying individual ones of the characters included in the compiled virtual reality scene. In some implementations, the animations may be based on user inputs received via one or more input methods (e.g., controlled based inputs, and/or other inputs).
By way of non-limiting example, one or more users may individually record the characters (e.g., one at a time per user) that appear within the same compiled virtual reality scene contemporaneously. When recording the actions to be manifested by a character within the compiled virtual reality scene, system 10 may be configured to present an editing scene to the user. The editing scene may include the manifestations of one or more users previous motions, sounds, and/or actions by one or more characters such that user may be able to interact with the previously recorded character(s) while recording the motions, sounds, and/or actions to be manifested by another character. In some implementations, the editing scene may include a recording input option to initiate recording of user's actions to be manifested by the character the user selected. As such, the user recording their actions for a given character may be able to interact and/or react with previously recorded characters contemporaneously as will be reflected in the compiled virtual reality scene.
As used herein, âvirtual realityâ may refer to what is traditionally considered virtual reality as well as augmented reality and/or other similar concepts. In some implementations, âvirtual realityâ may refer to a form of virtual reality/augmented reality hybrid and/or include an aspect and/or ability to view content in an augmented reality way. For example, creators may generate traditional virtual reality content but use augmented reality cameras to keep the user's peripheral vision open so they can keep an eye on the physical world around them.
In some implementations, system 10 may comprise one or more of a user interface 14 (which may include a display 16 and/or other components as described herein), sensors 18 , a processor 20 , electronic storage 30 , and/or other components. In some implementations, one or more components of system 10 may be included in a single computing device 12 . In some implementations, computing device 12 may be associated with the user. For example, computing device 12 may be owned by the user, carried by the user, operated by the user, and/or associated with the user in other ways. Computing device 12 may include communication lines, or ports to enable the exchange of information with a network, and/or other computing platforms. Computing device may include a plurality of hardware, software, and/or firmware components operating together to provide the functionality attributed herein to computing device 12 . Computing device 12 may include, for example, a cellular telephone, a smartphone, a laptop, a tablet computer, a desktop computer, a television set-top box, smart TV, a gaming console, a virtual reality headset, and/or other devices. In some implementations, individual components of system 10 (e.g., display 16 , sensors 18 ) may be coupled to (e.g., wired to, configured to wirelessly communicate with) computing device 12 without being included in computing device 12 . In some implementations, server 40 may be configured to communicate with computing device 12 via a client computing device.
In some implementations, computing device 12 may include one or more components (e.g., hardware and/or software) configured to facilitate recording of the user motions, sounds, and/or other actions for use by system 10 . The user motions may include physical movement and/or muscle articulation of at least a portion of the user's body (e.g., arms, legs, torso, head, knees, elbows, hands, feet, eyes, mouth, etc.). Recording user motions may account for body position, movement and muscle articulation for large scale body poses, and/or movement and muscle articulation for small scale things (e.g., eye direction, squinting, and/or other small scale movement and/or articulation). This may include, for example, recoding user movements, muscle articulations, positions, gestures, actions, noises, dialogue, and/or other motions, sounds, and/or actions. The one or more components configured to facilitate recording of user motions, sounds, and/or other actions may include, for example, sensors 18 . In some implementations, the one or more components configured to facilitate recording of user motions, sounds, and/or other actions may include, for example, one or more user input controllers (e.g., special controllers for puppeteering, etc.).
System 10 may include one or more processor(s) 20 configured by machine-readable instructions 21 to execute computer program components. The processor may be configured to execute computer program components 22 - 28 . The computer program components may be configured to enable an expert and/or user to interface with the system and/or provide other functionality attributed herein to the computing devices, the sensors, the electronic storage, and/or the processor. The computer program components may include one or more of: a display component 22 , a selection component 24 , a motion capture component 26 , a scene generation component 28 , and/or other components.
Display component 22 may be configured to cause the display(s) 16 to present the virtual reality content to one or more users. Presenting virtual reality content to the one or more users may simulate the user(s)' presence within a virtual space. The virtual reality content may include one or more of an editing scene, the compiled virtual reality scene, and/or other virtual reality content. The display component may be configured to provide and/or transmit the virtual reality content for presentation over the network to one or more computing devices for viewing, recording, editing, and/or otherwise creating and/or sharing the compiled virtual reality scene.
In some implementations, the virtual reality content may include an editing scene. The editing scene may be an editing version of the compiled scene that is presented to the one or more users while recording motion capture information for one or more characters. In some implementations, a user may be able to change the timing, physical placement, scale, and/or other attributes of the motion capture information and/or the compiled virtual reality scene via the editing scene. The display component may be configured to generate, provide, and/or transmit information for providing the virtual reality space and/or virtual reality content to users via the one or more computing device(s).
The presented virtual reality content may correspond to one or more of a view direction of the user, a physical position of the user, a virtual position of the user within the virtual space, and/or other information. In some implementations, the display may be included in a virtual reality headset worn by the user. It should be noted that the description of the display provided herein is not intended to be limiting. Rather, the description of the display is intended to include future evolutions of virtual reality display technology (which may not even be display based, for example). For example, the display may include cameras and/or systems for augmented reality, and/or other augmented reality components, light field imaging devices that project an image onto the back of a user's retina (e.g., near-eye light field displays, etc.) virtual reality technology that utilizes contact lenses, virtual reality technology that communicates directly with the brain, and/or other display technology.
Views of the virtual space may correspond to a location in the virtual space (e.g., a location in a scene). The location may have a topography, express contemporaneous interaction between one or more characters and/or a user, and/or include one or more objects positioned within the topography that are capable of locomotion within the topography. In some implementations, the topography may be a 3-dimensional topography. The topography may include dimensions of the space, and/or surface features of a surface or objects that are ânativeâ to the space. In some instances, the topography may describe a surface (e.g., a ground surface) that runs through at least a substantial portion of the space. In some instances, the topography may describe a volume with one or more bodies positioned therein (e.g., a simulation of gravity-deprived space with one or more celestial bodies positioned therein). The views of the virtual space may be presented to the user such that a user may move through the virtual space and interact with the virtual space as the user would move through and interact with a corresponding physical space. For example, a user may walk and/or run through the virtual space, sit down, stand up, stop and observe an object in the virtual space, look up/down/left/right/etc., lean to look around an object in the virtual space, and/or other movements and/or interactions.
The above description of the views of the virtual space is not intended to be limiting. The virtual space may be expressed in a more limited, or richer, manner. For example, in some implementations, views determined for the virtual space may be selected from a limited set of graphics depicting an event in a given place within the virtual space. In some implementations, views determined for the virtual space may include additional content (e.g., text, audio, pre-stored video content, and/or other content) that describe, augment, and/or overlay particulars of the current, previous, and/or future state of the place.
System 10 may include user interface 14 . User interface 14 may include display 16 , one or more input controls, (not illustrated) and/or other components. Display 16 may be configured to present the virtual space and/or the virtual reality content to the user. Presentation of the virtual reality content via display 16 may simulate the presence of a user within a virtual space. The virtual space may be fixed relative to physical space. System 10 may include multiple displays 16 , and/or be configured to communicate with one or more servers, computer devices, and/or displays associated with other users. The one or more display(s) may be configured to present options for recording the motion and/or the sound for one or more of the characters within the virtual space. The options may include one or more of: a start/stop option for recording motion capture information; character selection options from which a user may select one or more characters to include in the compiled virtual reality scene; scene selection options from which a user may select one or more virtual scenery themes, virtual scenery objects, and/or virtual items; and/or other options. The display may be controlled by processor 20 to present, select, record, and/or otherwise generate the virtual reality content.
FIG. 2 , depicts computing device 12 illustrated as a virtual reality headset that is worn on the head of a user 200 . The virtual reality content may be presented to the user in a virtual space via a display included in the headset. The virtual reality headset may be configured such that a perception of a three dimensional space is created by two stereoscopic movies, one generated for each eye, that are each being rendered in real time and then displayed. The convergence of these two movies in real timeâone image to each eye (along with how those views are reactive to viewer head rotation and position in space)âmay create a specific kind of immersive 3D effect and/or a sensation of presence in a virtual world. Presenting the virtual reality content to the user in the virtual space may include presenting one or more views of the virtual space to the user. Users may participate in the virtual space by interacting with content presented to the user in the virtual space. The content presented to the user may include a virtual space having one or more virtual events, characters, objects, and/or settings; an editing scene; a compiled virtual reality scene; and/or other content. In some implementations, the virtual reality content may be similarly presented to the user via one or more screens, projection devices, three dimensional image generation devices, light field imaging devices that project an image onto the back of a user's retina, virtual reality technology that utilizes contact lenses, virtual reality technology that communicates directly with (e.g., transmits signals to and/or receives signals from) the brain, and/or other devices configured to display the virtual reality content to the user.
FIG. 3 illustrates a server 40 configured to communicate with computing device via a network, in accordance with one or more implementations. In some implementations, server 40 may be configured to provide the virtual space by hosting the virtual reality content over a network, such as the Internet. Server 40 may include electronic storage, one or more processors, communication components, and/or other components. Server 40 may include communication lines, or ports to enable the exchange of information with a network and/or other computing devices. Server 40 may include a plurality of hardware, software, and/or firmware components operating together to provide the functionality attributed herein to server 40 . For example, server 40 may be implemented by a cloud of computing devices operating together as server 40 .
Server 40 may be configured to execute computer readable instructions to perform one or more functionalities attributed to the computing device(s) 12 , and/or one or more other functions. By way of non-limiting example, sever 40 may include one or more processors configured by machine-readable instructions to host, generate, transmit, provide, and/or facilitate presentation of virtual reality content to the computing device(s) 12 ; provide an editing scene to the computing device(s) 12 ; receive motion capture information from one or more of the computing device(s) 12 ; generate the complied virtual reality scene (e.g., based on the motion capture information received from the one or more computing device(s)); and/or otherwise facilitate animation of characters based on motion capture and/or generation of a compiled virtual reality scene based on individual asynchronous motion capture recordings.
For example, server 40 may be configured such that one or more users record the motion, the sound, and/or the actions for one or more characters for a compiled virtual reality scene individually. By way of non-limiting example, the motion capture for individual ones of the multiple characters that are to appear animated in a compiled virtual reality scene may be recorded asynchronously by different users, via different computing devices, and/or located at different physical locations.
External resources 300 may include sources of information that are outside of system 10 , external entities participating with system 10 , and/or other resources.
In some implementations, some or all of the functionality attributed herein to external resources 300 may be provided by resources included in system 10 .
Returning to FIG. 1 , sensors 18 may be configured to generate output signals conveying information related to related to motion, sound, and/or other actions made by one or more users in physical space. Sensors 18 may, for example, record user movements, muscle articulations, positions, gestures, actions, noises, dialogue, and/or other motions, sounds, and/or actions. Sensors 18 may be configured to capture the motion and/or the sound made by the one or more users. The motion(s) captured via sensors 18 may include physical movement and/or muscle articulation of at least a portion of the user's body (e.g., arms, legs, torso, head, knees, elbows, hands, feet, eyes, mouth, etc.). Recording user motions may account for body position, movement and muscle articulation for large scale body poses, and/or movement and muscle articulation for small scale things (e.g., eye direction, squinting, and/or other small scale movement and/or articulation). In some implementations, the sensors may include one or more cameras and/or other optical sensors, inertial sensors, mechanical motion sensors, magnetic sensors, depth sensors, microphones, gyrosensor, accelerometer, laser position sensor, pressure sensors, volumetric sensors, voxel recordings/sensors, and/or other sensors.
FIG. 4 illustrates an editing scene 400 presented to a user including options 402 for virtual scenery themes selectable by the user. Editing scene 400 may be presented by a display the same as or similar to display 16 . The user may interact with the editing scene and/or select one or more options within the editing scene via one or more input controls 404 . Editing scene 400 may represent the virtual space in which the user's presence is simulated. The editing scene 400 may be virtual reality content presented to the user via a display (e.g., a head mounted display and/or other display).
Editing scene 400 may present options 402 for virtual scenery themes. The user may be able to select a virtual scenery theme 406 to apply to the virtual space for the compiled virtual reality scene. Responsive to the user selecting the virtual scenery theme 406 to apply to the virtual space, the virtual scenery theme 406 may be applied to the virtual space. By way of non-limiting example, virtual scenery theme 406 may include a desert such that applying virtual scenery theme 406 includes presenting a desert virtual reality content such that the user's presence within the desert is simulated.
Returning to FIG. 1 , selection component 24 may be configured to receive selection of one or more characters to virtually embody within the virtual space. Selection of the one or more characters to virtually embody may be input by the one or more users via user interface 14 . Virtually embodying a character within the virtual space may include experiencing the virtual space as the character. Experiencing the virtual space as the character may include, for example, viewing the virtual space from the perspective of the character, moving within the virtual space as the character, interacting with the virtual space and/or other characters within the virtual space as the character, controlling the character's actions within the virtual space by performing the actions in real world physical space, and/or otherwise embodying the character within the virtual space. Virtually embodying a character may enable a user to record the motion and/or the sound made by the character within the compiled virtual reality scene.
In some implementations, selection of a first character to virtually embody within the virtual space may be received by selection component 24 . Responsive to receiving selection of the first character by the selection component 24 , the system may enable the first user to record the motion and/or the sound to be made by the first character within the compiled virtual reality scene. Selection of the first character may be received by selection component 24 from one or more input controls associated with user interface 14 .
Selection component 24 may be configured to receive selection of a second character for a user virtually embody. The second character may be separate and distinct from the first character. Virtually embodying the second character may enable a first user or another user to record one or more of the motion, the sound, and/or other actions to be made by the second character within the compiled virtual reality scene. In some implementations, selection of the second character may be received by selection component 24 after first motion capture information characterizing the motion, the sound, and/or the other actions made by the first user as the first user virtually embodies the first character is recorded. In some implementations, selection of the second character is received from a second display for a second computing device associated with a second user. The second motion capture information may characterize the motion, sound, and/or other actions made by the second user. The second user may be a different user than the first user. A first computing device associated with a first user may be separate and distinct from a second display for a second computing device associated with a second user.
In some implementations, selection component 24 may be configured to receive selection of a third character for a user to virtually embody. The third character may be separate and/or distinct from the first character, the second character, and/or other characters within the editing scene and/or the compiled virtual reality scene. Virtually embodying the third character may enable the first user or a different user to record one or more of the motion, the sound, and/or other actions to be made by the third character within the compiled virtual reality scene. By way of non-limiting example, the actions manifested within the compiled virtual reality scene by one, two, or all three of the first character, the second character, and/or third character may correspond to the actions of one user, two different users, three different users, and/or any number of different users. In some implementations, the first computing device and the second computing device may be physically located in different locations such that information indicating portions of the compiled virtual reality scene must be transmitted over a network to one or more server(s) 40 , one or more computing device(s) 12 , and/or external resources 300 .
In som
CLAIMS
Claims ( 16 )
What is claimed is:
1. A system configured to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, the system comprising:
one or more sensors configured to capture motion and/or sound made by one or more users in a physical space and generate output signals conveying information related to the motion and/or the sound made;
one or more presentation devices that present virtual reality content to one or more users;
one or more processors configured by machine-readable instructions to:
receive selection of a first character and a second character to virtually embody within the virtual space such that virtually embodying the first character and the second character enables a first user to record the motion and/or the sound to be made by the first character and a second character within a compiled virtual reality scene;
record, responsive to the selection of the first character and the second character, first motion capture information characterizing the motion and/or the sound made by the first user as the first user virtually embodies the first character and the second character, wherein the first motion capture information is captured in a manner such that actions of the first user are manifested by the first character and the second character within the compiled virtual reality scene;
receive selection of a third character to virtually embody, wherein the third character is separate and distinct from the first character and the second character, and wherein virtually embodying the third character enables a second user to record the motion and/or the sound to be made by the third character within the compiled virtual reality scene;
contemporaneous to the recording of the first motion capture information, record second motion capture information that characterizes the motion and/or the sound made by the second user as reactions to the motions and/or sounds of the first user virtually embodying the first character and second character or cause the motion and/or the sound made by the first user, wherein the second motion capture information is captured in a manner such that actions of the second user are manifested by the third character synchronously with the actions of the first user manifested by the first character and the second character within the compiled virtual reality scene; and
generate the compiled virtual reality scene including animation of the first character, the second character, and the third character such that the first character, the second character, and the third character appear animated within the compiled virtual reality scene contemporaneously.
2. The system of claim 1 , wherein the one or more processors are further configured by machine-readable instructions to:
contemporaneous to receiving the selection of the third character, receive selection of a fourth character to virtually embody, wherein the fourth character is separate and distinct from the first character, the second character, and the third character, and wherein virtually embodying the fourth character enables a third user to record the motion and/or the sound to be made by the fourth character within the compiled virtual reality scene; and
contemporaneous to recording the first motion capture information and the second motion capture information and responsive to the selection of the fourth character, record third motion capture information that characterizes the motion and/or the sound made by the third user as the third user virtually embodies the fourth character, wherein the third motion capture information is captured in a manner such that the actions of the third user are manifested by the fourth character are a reaction to the actions of the first user manifested by the first character and the second character and the actions of the second user manifested by the third character, or cause the motion and/or the sound made by the first user and/or the second user,
such that the compiled virtual reality scene includes animation of the first character, the second character, the third character, and the fourth character such that the first character, the second character, the third character, and the fourth character appear animated within the compiled virtual reality scene contemporaneously.
3. The system of claim 2 , wherein the first user, the second user, and the third user are different.
4. The system of claim 3 , wherein the first user, the second user, and the third user are associated with different computing devices located at different physical locations.
5. The system of claim 1 , wherein the virtual reality content includes an editing scene, wherein the editing scene is an editing version of the compiled scene that is presented to the one or more users while recording motion capture information for one or more characters, wherein the editing scene includes the manifestation of the first user's actions by the first character and the second character presented contemporaneously to the second user while the second motion capture information is being recorded, and wherein the displays are configured to present the editing scene including one or more manifestations of the one or more users' actions by the one or more characters based on previously recorded motion capture information while recording subsequent motion capture information characterizing the motion and/or the sound made by the users as the users virtually embody the one or more characters.
6. The system of claim 1 , wherein the one or more processors are further configured by machine-readable instructions to receive selection of a start time within a timeline of the compiled scene that indicates when the first character and the second character should start manifesting the actions of the first user within the compiled virtual reality scene during playback of the compiled virtual reality scene.
7. The system of claim 1 , wherein the one or more processors are further configured by machine-readable instructions to receive selection of one or more virtual objects, virtual scenery themes, and/or virtual scenery items for placement within an editing scene to be reflected in the compiled virtual reality scene.
8. The system of claim 1 , wherein the one or more processors are further configured by machine-readable instructions to receive selection of a first facial expression for the first character and the second character, such that the first motion capture information includes the first facial expression for the first character and the second character, and one or more of the actions of the first user are manifested in the compiled virtual reality scene by the first character and the second character with the first facial expression.
9. A method to generate and/or modify three-dimensional scenes comprising animated characters based on individual asynchronous motion capture recordings, the method being implemented by one or more sensors, displays, and/or processors configured to perform the method, the method comprising:
generating, by the one or more sensors configured to capture motion and/or sound made by one or more users in a physical space, output signals conveying information related to the motion and/or the sound made;
presenting, via the one or more presentation devices, virtual reality content to one or more users;
receiving, at the one or more processors, selection of a first character and a second character to virtually embody within the virtual space such that virtually embodying the first character and the second character enables a first user to record the motion and/or the sound to be made by the first character and the second character within a compiled virtual reality scene;
recording, at the one or more processors, responsive to the selection of the first character and the second character, first motion capture information characterizing the motion and/or the sound made by the first user as the first user virtually embodies the first character and the second character, wherein the first motion capture information is captured in a manner such that actions of the first user are manifested by the first character and the second character within the compiled virtual reality scene;
receiving, at the one or more processors, selection of a third character to virtually embody, wherein the third character is separate and distinct from the first character and the second character, and wherein virtually embodying the third character enables a second user to record the motion and/or the sound to be made by the third character within the compiled virtual reality scene;
contemporaneous to the recording of the first motion capture information, recording, by the one or more processors, second motion capture information that characterizes the motion and/or the sound made by the second user as reactions to the motions and/or sounds of the first user virtually embodies the first character and second character or cause the motion and/or the sound made by the first user, wherein the second motion capture information is captured in a manner such that actions of the second user are manifested by the third character synchronously with the actions of the first user manifested by the first character and the second character within the compiled virtual reality scene; and
generating, by the one or more processors, the compiled virtual reality scene including animation of the first character, the second character, and the third character such that the first character, the second character, and the third character appear animated within the compiled virtual reality scene contemporaneously.
10. The method of claim 9 , further comprising:
contemporaneous to receiving the selection of the third character, receiving, at the one or more processors, selection of a fourth character to virtually embody, wherein the fourth character is separate and distinct from the first character, the second character, and the third character, and wherein virtually embodying the fourth character enables a third user to record the motion and/or the sound to be made by the fourth character within the compiled virtual reality scene; and
contemporaneous to recording the first motion capture information and the second motion capture information and responsive to the selection of the fourth character, recording, by the one or more processors, third motion capture information that characterizes the motion and/or the sound made by the third user as the third user virtually embodies the fourth character, wherein the third motion capture information is captured in a manner such that the actions of the third user are manifested by the fourth character are a reaction to the actions of the first user manifested by the first character and the second character and the actions of the second user manifested by the third character, or cause the motion and/or the sound made by the first user and/or the second user,
such that the compiled virtual reality scene includes animation of the first character, the second character, the third character, and the fourth character such that the first character, the second character, the third character, and the fourth character appear animated within the compiled virtual reality scene contemporaneously.
11. The method of claim 10 , wherein the first user, the second user, and the third user are different.
12. The method of claim 11 , wherein the first user, the second user, and the third user are associated with different computing devices located at different physical locations.
13. The method of claim 9 , wherein the virtual reality content includes an editing scene, wherein the editing scene is an editing version of the compiled scene that is presented to the one or more users while recording motion capture information for one or more characters, wherein the editing scene includes the manifestation of the first user's actions by the first character and the second character presented contemporaneously to the second user while the second motion capture information is being recorded, and wherein the displays are configured to present the editing scene including one or more manifestations of the one or more users' actions by the one or more characters based on previously recorded motion capture information while recording subsequent motion capture information characterizing the motion and/or the sound made by the users as the users virtually embody the one or more characters.
14. The method of claim 9 , further comprising receiving, at the one or more processors, selection of a start time within a timeline of the compiled scene that indicates when the first character and the second character should start manifesting the actions of the first user within the compiled virtual reality scene during playback of the compiled virtual reality scene.
15. The method of claim 9 , further comprising receiving, at the one or more processors, selection of one or more virtual objects, virtual scenery themes, and/or virtual scenery items for placement within an editing scene to be reflected in the compiled virtual reality scene.
16. The method of claim 9 , further comprising receiving, at the one or more processors, selection of a first facial expression for the first character and the second character, such that the first motion capture information includes the first facial expression for the first character and the second character, and one or more of the actions of the first user are manifested in the compiled virtual reality scene by the first character and the second character with the first facial expression.
US18/073,955
2017-05-23
2022-12-02
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Active
2037-05-23
US11861059B2
( en )
Priority Applications (1)
Application Number
Priority Date
Filing Date
Title
US18/073,955
US11861059B2
( en )
2017-05-23
2022-12-02
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Applications Claiming Priority (6)
Application Number
Priority Date
Filing Date
Title
US15/603,099
US10228760B1
( en )
2017-05-23
2017-05-23
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/295,376
US10664045B2
( en )
2017-05-23
2019-03-07
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/854,684
US10969860B2
( en )
2017-05-23
2020-04-21
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/203,646
US11231773B2
( en )
2017-05-23
2021-03-16
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/531,539
US11599188B2
( en )
2017-05-23
2021-11-19
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US18/073,955
US11861059B2
( en )
2017-05-23
2022-12-02
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Related Parent Applications (1)
Application Number
Title
Priority Date
Filing Date
US17/531,539
Continuation
US11599188B2
( en )
2017-05-23
2021-11-19
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Publications (2)
Publication Number
Publication Date
US20230109054A1
US20230109054A1 ( en )
2023-04-06
US11861059B2
true
US11861059B2 ( en )
2024-01-02
Family
ID=65633154
Family Applications (6)
Application Number
Title
Priority Date
Filing Date
US15/603,099
Active
2037-07-09
US10228760B1
( en )
2017-05-23
2017-05-23
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/295,376
Active
US10664045B2
( en )
2017-05-23
2019-03-07
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/854,684
Active
US10969860B2
( en )
2017-05-23
2020-04-21
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/203,646
Active
US11231773B2
( en )
2017-05-23
2021-03-16
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/531,539
Active
US11599188B2
( en )
2017-05-23
2021-11-19
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US18/073,955
Active
2037-05-23
US11861059B2
( en )
2017-05-23
2022-12-02
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Family Applications Before (5)
Application Number
Title
Priority Date
Filing Date
US15/603,099
Active
2037-07-09
US10228760B1
( en )
2017-05-23
2017-05-23
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/295,376
Active
US10664045B2
( en )
2017-05-23
2019-03-07
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US16/854,684
Active
US10969860B2
( en )
2017-05-23
2020-04-21
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/203,646
Active
US11231773B2
( en )
2017-05-23
2021-03-16
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US17/531,539
Active
US11599188B2
( en )
2017-05-23
2021-11-19
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
Country Status (1)
Country
Link
US
( 6 )
US10228760B1
( en )
Families Citing this family (57)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US10751608B2
( en )
2012-08-31
2020-08-25
Blue Goji Llc.
Full body movement control of dual joystick operated devices
EP3345184A1
( en )
2015-09-02
2018-07-11
THOMSON Licensing
Method, apparatus and system for facilitating navigation in an extended scene
US10228760B1
( en )
2017-05-23
2019-03-12
Visionary Vr, Inc.
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
JP6925589B2
( en )
*
2017-11-17
2021-08-25
â²é¨°â¼â²è¨â¼ç§æï¼æ·±â²ã»ã³â¼ï¼æéå ¬å¸
Character simulation method and terminal device in VR scene
US11294453B2
( en )
*
2019-04-23
2022-04-05
Foretell Studios, LLC
Simulated reality cross platform system
US11055920B1
( en )
*
2019-06-27
2021-07-06
Facebook Technologies, Llc
Performing operations using a mirror in an artificial reality environment
US11145126B1
( en )
2019-06-27
2021-10-12
Facebook Technologies, Llc
Movement instruction using a mirror in an artificial reality environment
US11036987B1
( en )
*
2019-06-27
2021-06-15
Facebook Technologies, Llc
Presenting artificial reality content using a mirror
GB2596588B
( en )
*
2020-07-03
2022-10-26
Sony Interactive Entertainment Inc
Data processing apparatus and method
WO2022056151A1
( en )
*
2020-09-09
2022-03-17
Colin Brady
A system to convert expression input into a complex full body animation, in real time or from recordings, analyzed over time
CN116719452A
( en )
2020-09-25
2023-09-08
è¹æå ¬å¸
Method for interacting with virtual controls and/or affordances for moving virtual objects in a virtual environment
CN117555417B
( en )
2020-09-25
2024-07-19
è¹æå ¬å¸
Method for adjusting and/or controlling immersion associated with a user interface
KR102833872B1
( en )
2020-09-25
2025-07-15
ì í ì¸í¬.
Methods for manipulating objects in an environment
JP7130719B2
( en )
*
2020-11-19
2022-09-05
ã°ãªã¼æ ªå¼ä¼ç¤¾
Computer program, method and server device
CN116670627A
( en )
2020-12-31
2023-08-29
è¹æå ¬å¸
Methods for Grouping User Interfaces in Environments
US11995230B2
( en )
2021-02-11
2024-05-28
Apple Inc.
Methods for presenting and sharing content in an environment
CN112882575A
( en )
*
2021-02-24
2021-06-01
å®æ¥èä¸ææ¯å¦é¢ï¼å®æ¥å¸ææ¯å·¥äººå¦æ ¡ï¼
Panoramic dance action modeling method and dance teaching auxiliary system
CN113256815B
( en )
*
2021-02-24
2024-03-22
å京åæ¸ æéç§ææéå ¬å¸
Virtual reality scene fusion and playing method and virtual reality equipment
CN112891930B
( en )
*
2021-03-25
2022-11-29
è ¾è®¯ç§æï¼æ·±å³ï¼æéå ¬å¸
Information display method, device, equipment and storage medium in virtual scene
US12112009B2
( en )
2021-04-13
2024-10-08
Apple Inc.
Methods for providing an immersive experience in an environment
WO2023276215A1
( en )
*
2021-06-29
2023-01-05
ã½ãã¼ã°ã«ã¼ãæ ªå¼ä¼ç¤¾
Information processing device, information processing method, and program
JP7702573B2
( en )
2021-09-25
2025-07-03
ã¢ããã« ã¤ã³ã³ã¼ãã¬ã¤ããã
DEVICE, METHOD, AND GRAPHICAL USER INTERFACE FOR PRESENTING VIRTUAL OBJECTS IN A VIRTUAL ENVIRONMENT - Patent application
US20240096033A1
( en )
*
2021-10-11
2024-03-21
Meta Platforms Technologies, Llc
Technology for creating, replicating and/or controlling avatars in extended reality
US12456271B1
( en )
2021-11-19
2025-10-28
Apple Inc.
System and method of three-dimensional object cleanup and text annotation
CN114332365B
( en )
*
2021-12-24
2025-08-15
å京ç¾åº¦ç½è®¯ç§ææéå ¬å¸
Virtual character image generation method, device, electronic equipment and storage medium
US11944907B2
( en )
*
2022-01-07
2024-04-02
Sony Interactive Entertainment Inc.
User options in modifying face of computer simulation character
CN118871875A
( en )
2022-01-12
2024-10-29
è¹æå ¬å¸
Methods for displaying, selecting, and moving objects and containers in the environment
KR20240134030A
( en )
2022-01-19
2024-09-05
ì í ì¸í¬.
Methods for displaying and repositioning objects within an environment.
US12254564B2
( en )
2022-02-14
2025-03-18
Meta Platforms, Inc.
Artificial intelligence-assisted virtual object builder
US12272005B2
( en )
2022-02-28
2025-04-08
Apple Inc.
System and method of three-dimensional immersive applications in multi-user communication sessions
US12541280B2
( en )
2022-02-28
2026-02-03
Apple Inc.
System and method of three-dimensional placement and refinement in multi-user communication sessions
US12033257B1
( en )
*
2022-03-25
2024-07-09
Mindshow Inc.
Systems and methods configured to facilitate animation generation
WO2023196258A1
( en )
2022-04-04
2023-10-12
Apple Inc.
Methods for quick message response and dictation in a three-dimensional environment
US11527032B1
( en )
2022-04-11
2022-12-13
Mindshow Inc.
Systems and methods to generate and utilize content styles for animation
CN119404170A
( en )
2022-04-20
2025-02-07
è¹æå ¬å¸
Occluded objects in a 3D environment
US12511009B2
( en )
2022-04-21
2025-12-30
Apple Inc.
Representations of messages in a three-dimensional environment
US12620187B2
( en )
2022-05-17
2026-05-05
Apple Inc.
Systems, methods, and user interfaces for generating a three-dimensional virtual representation of an object
CN117111723A
( en )
*
2022-05-17
2023-11-24
å京åè·³ç½ç»ææ¯æéå ¬å¸
Special effects display methods, devices, electronic equipment and storage media
US12394167B1
( en )
2022-06-30
2025-08-19
Apple Inc.
Window resizing and virtual object rearrangement in 3D environments
US12148078B2
( en )
2022-09-16
2024-11-19
Apple Inc.
System and method of spatial groups in multi-user communication sessions
US12112011B2
( en )
*
2022-09-16
2024-10-08
Apple Inc.
System and method of application-based three-dimensional refinement in multi-user communication sessions
US12099653B2
( en )
2022-09-22
2024-09-24
Apple Inc.
User interface response based on gaze-holding event assessment
US12405704B1
( en )
2022-09-23
2025-09-02
Apple Inc.
Interpreting user movement as direct touch user interface interactions
WO2024064937A1
( en )
2022-09-24
2024-03-28
Apple Inc.
Methods for interacting with user interfaces based on attention
CN120266077A
( en )
2022-09-24
2025-07-04
è¹æå ¬å¸
Methods for controlling and interacting with a three-dimensional environment
EP4591145A1
( en )
2022-09-24
2025-07-30
Apple Inc.
Methods for time of day adjustments for environments and environment presentation during communication sessions
US20250014293A1
( en )
*
2022-12-21
2025-01-09
Meta Platforms Technologies, Llc
Artificial Reality Scene Composer
WO2024163514A1
( en )
2023-01-30
2024-08-08
Apple Inc.
Devices, methods, and graphical user interfaces for displaying sets of controls in response to gaze and/or gesture inputs
US12108012B2
( en )
2023-02-27
2024-10-01
Apple Inc.
System and method of managing spatial states and display modes in multi-user communication sessions
CN116668605A
( en )
*
2023-05-10
2023-08-29
å京å½é äºè½¬æç§ææéå ¬å¸
Meta-universe studio system, playing method, storage medium and electronic device
US12443286B2
( en )
2023-06-02
2025-10-14
Apple Inc.
Input recognition based on distinguishing direct and indirect user interactions
US12118200B1
( en )
2023-06-02
2024-10-15
Apple Inc.
Fuzzy hit testing
WO2024254096A1
( en )
2023-06-04
2024-12-12
Apple Inc.
Methods for managing overlapping windows and applying visual effects
US12099695B1
( en )
2023-06-04
2024-09-24
Apple Inc.
Systems and methods of managing spatial groups in multi-user communication sessions
CN119909381A
( en )
*
2023-10-31
2025-05-02
ç½æ(ä¸æµ·)ç½ç»æéå ¬å¸
Game character editing method, device and electronic device
US12608877B2
( en )
2024-06-09
2026-04-21
Apple Inc.
Methods of interacting with content in a virtual environment
WO2026089168A1
( en )
*
2024-10-24
2026-04-30
Samsung Electronics Co., Ltd.
Method and system for three dimensional (3d) construction of an object in a virtual environment
Citations (21)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20020105521A1
( en )
2000-12-26
2002-08-08
Kurzweil Raymond C.
Virtual reality presentation
WO2003058518A2
( en )
2002-01-07
2003-07-17
Stephen James Crampton
Method and apparatus for an avatar user interface system
US20030146915A1
( en )
2001-10-12
2003-08-07
Brook John Charles
Interactive animation of sprites in a video production
US20090307189A1
( en )
2008-06-04
2009-12-10
Cisco Technology, Inc.
Asynchronous workflow participation within an immersive collaboration environment
US20100008639A1
( en )
2008-07-08
2010-01-14
Sceneplay, Inc.
Media Generating System and Method
US20110064388A1
( en )
2006-07-11
2011-03-17
Pandoodle Corp.
User Customized Animated Video and Method For Making the Same
US8284157B2
( en )
2010-01-15
2012-10-09
Microsoft Corporation
Directed performance in motion capture system
US20130278607A1
( en )
2012-04-20
2013-10-24
A Thinking Ape Technologies
Systems and Methods for Displaying Animations on a Mobile Device
US20140267350A1
( en )
2013-03-14
2014-09-18
Pixar
Stylizing animation by example
US8937620B1
( en )
2011-04-07
2015-01-20
Google Inc.
System and methods for generation and control of story animation
US20150030305A1
( en )
*
2012-04-12
2015-01-29
Dongguk University Industry-Academic Cooperation Foundation
Apparatus and method for processing stage performance using digital characters
US20150243324A1
( en )
2001-05-04
2015-08-27
Legend3D, Inc.
Image sequence enhancement and motion picture project management system
US9159151B2
( en )
2009-07-13
2015-10-13
Microsoft Technology Licensing, Llc
Bringing a visual representation to life via learned input from the user
US20170046906A1
( en )
2015-08-11
2017-02-16
Bally Gaming, Inc.
Gaming machine and system for concurrent gaming player interface manipulation based on visual focus
US20170061704A1
( en )
2015-08-26
2017-03-02
Warner Bros. Entertainment, Inc.
Social and procedural effects for computer-generated environments
US20190204906A1
( en )
2017-05-23
2019-07-04
Visionary Vr, Inc.
System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US20200066022A1
( en )
2018-08-27
2020-02-27
Microsoft Technology Licensing, Llc
Playback for embedded and preset 3d animations
US20200226724A1
( en )
2019-01-11
2020-07-16
Adobe Inc.
Transferring Image Style to Content of a Digital Image
US20200311120A1
( en )
2019-03-28
2020-10-01
Facebook, Inc.
Generating digital media clusters corresponding to predicted distribution classes from a repository of digital media based on network distribution history
US20210117736A1
( en )
2019-10-17
2021-04-22
International Business Machines Corporation
Automatic generation of content using multimedia
US20210279269A1
( en )
2020-03-04
2021-09-09
Adobe Inc.
Content Fragments Aligned to Content Criteria
2017
2017-05-23
US
US15/603,099
patent/US10228760B1/en
active
Active
2019
2019-03-07
US
US16/295,376
patent/US10664045B2/en
active
Active
2020
2020-04-21
US
US16/854,684
patent/US10969860B2/en
active
Active
2021
2021-03-16
US
US17/203,646
patent/US11231773B2/en
active
Active
2021-11-19
US
US17/531,539
patent/US11599188B2/en
active
Active
2022
2022-12-02
US
US18/073,955
patent/US11861059B2/en
active
Active
Patent Citations (27)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20020105521A1
( en )
2000-12-26
2002-08-08
Kurzweil Raymond C.
Virtual reality presentation
US20150243324A1
( en )
2001-05-04
2015-08-27
Legend3D, Inc.
Image sequence enhancement and motion picture project management system
US20030146915A1
( en )
2001-10-12
2003-08-07
Brook John Charles
Interactive animation of sprites in a video production
WO2003058518A2
( en )
2002-01-07
2003-07-17
Stephen James Crampton
Method and apparatus for an avatar user interface system
US20110064388A1
( en )
2006-07-11
2011-03-17
Pandoodle Corp.
User Customized Animated Video and Method For Making the Same
US20090307189A1
( en )
2008-06-04
2009-12-10
Cisco Technology, Inc.
Asynchronous workflow participation within an immersive collaboration environment
US20100008639A1
( en )
2008-07-08
2010-01-14
Sceneplay, Inc.
Media Generating System and Method
US9159151B2
( en )
2009-07-13
2015-10-13
Microsoft Technology Licensing, Llc
Bringing a visual representation to life via learned input from the user
US8284157B2
( en )
2010-01-15
2012-10-09
Microsoft Corporation
Directed performance in motion capture system
US8937620B1
( en )
2011-04-07
2015-01-20
Google Inc.
System and methods for generation and control of story animation
US20150030305A1
( en )
*
2012-04-12
2015-01-29
Dongguk University Industry-Academic Cooperation Foundation
Apparatus and method for processing stage performance using digital characters
US20130278607A1
( en )
2012-04-20
2013-10-24
A Thinking Ape Technologies
Systems and Methods for Displaying Animations on a Mobile Device
US20140267350A1
( en )
2013-03-14
2014-09-18
Pixar
Stylizing animation by example
US20170046906A1
( en )
2015-08-11
2017-02-16
Bally Gaming, Inc.
Gaming machine and system for concurrent gaming player interface manipulation based on visual focus
US20170061704A1
( en )
2015-08-26
2017-03-02
Warner Bros. Entertainment, Inc.
Social and procedural effects for computer-generated environments
<tr itemprop