ABSTRACT
Abstract
A rhythm-based video game (âgameâ) is disclosed. In the game, a player slashes blocks representing musical beats using a pair of energy blades resembling a lightsaber. A gaming console renders multiple digital objects, e.g., digital blocks, digital mines and digital obstacles, that are approaching a player in a virtual space. The gaming console also renders a digital representation of an instrument, e.g., a lightsaber (âdigital saberâ), using which the player slashes, cuts or otherwise interacts with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The player can score by slashing the digital blocks, not hitting the digital mines and avoiding the digital obstacles. The game presents the player with a stream of approaching digital objects in synchronization with music, e.g., a song's beats, being played in the game. The pace at which the digital blocks approach the player increases with the beats.
Description
CROSS-REFERENCE TO RELATED APPLICATION(S)
The present application claims the benefit of U.S. Provisional Patent Application No. 62/755,468, entitled âVIDEO GAME INCLUDING BODY TRACKING AND VIRTUAL OBJECTS,â and filed Nov. 3, 2018, which is incorporated herein in its entirety.
TECHNICAL FIELD
The disclosure is related to video games, and more specifically to video games that track the movements of the player.
BACKGROUND
A player-tracking video game is one where a user's movements (e.g., of their head, body, arms, wrists, hands, or legs) provide meaningful controls to the game. Player-tracking games take a variety of forms and often include music video games.
A music video game is a video game where the gameplay is meaningfully and often almost entirely oriented around the player's interactions with a musical score or individual songs. Music video games may take a variety of forms and are often grouped with puzzle games due to their common use of ârhythmically generated puzzlesâ. Music video games are distinct from purely audio games in that they feature a visual feedback, to lead the player through the game's soundtrack, although eidetic music games can fall under both categories.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of an environment in which a rhythm-based video game can be implemented.
FIG. 2 is a block diagram of a three-dimensional (3D) virtual space in which the game is played, consistent with various embodiments.
FIG. 3 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 4 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 5 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 6 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 7 illustrates variable game actions based on angle and position of incidence between a digital element and a digital object.
FIG. 8 is a screenshot of a player playing the game, consistent with various embodiments.
FIG. 9 is a screenshot of a player view of the 3D virtual space generated by the gaming console, consistent with various embodiments.
FIG. 10 is a screenshot of a graphical user interface (GUI) with instructions to the player, consistent with various embodiments.
FIG. 11 is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 12A is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 12B is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 13 is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 14 is a screenshot of a GUI in which the player can select various options, consistent with various embodiments.
FIG. 15 is a screenshot of a GUI showing multiple digital objects approaching the player in the 3D virtual space, consistent with various embodiments.
FIG. 16 is a screenshot of a GUI showing multiple digital objects approaching the player in the 3D virtual space, consistent with various embodiments.
FIG. 17 is a block diagram of a computer system as may be used to implement features of some embodiments of the disclosed technology.
DETAILED DESCRIPTION
The disclosure is related to a video game (âgameâ). In the game a player interacts with digital objects that approach the user in a 3D corridor. Interaction occurs via digital collision between a digital element controlled by the player. Control of the digital element is based on body tracking. In some embodiments, body tracking is performed via a worn or held peripheral that tracks its own movement relative some other reference point. In some embodiments, a depth camera or room-mapping cameras (e.g., Playstation Camera, Microsoft Kinect, LeapMotion, or equivalents) captures video of the player and uses computer vision techniques to identify body positions of the user. The game presents the player with a stream of approaching digital objects and the user causes the digital element to collide with the digital objects based on use of body tracking. Digital collisions with different types of digital objects and from different angles cause a variety of game actions to occur. In some embodiments, the game further tracks the motion of the user's body and shifts a player location in game corresponding to body movements. Movement of the player location enables the player to avoid digital obstacles.
An embodiment of the disclosure is related to a rhythm-based video game. In the rhythm-based video game a player slashes blocks representing musical beats using one or a pair of energy blades resembling a lightsaber (the digital element). A gaming console renders multiple digital objects, e.g., a digital representation of a block (âdigital blockâ or âblockâ), that are moving in a specified direction, e.g., in a direction towards a user or player. The gaming console also renders a digital representation of an instrument, e.g., a digital representation of a sword resembling a lightsaber (âdigital saberâ), using which the player slashes, cuts or otherwise interact with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The game presents the player with a stream of approaching digital blocks in synchronization with beats of music, e.g., a song's beats and notes, being played in the game. As the beat picks up in the music, the pace at which the digital blocks approach the player can increase.
A game action occurs in response to the digital collision. The game action can be any of an increase or decrease in score of the player, an increase or decrease in energy of the player, a gain or loss of life of the player in the game, an increase or decrease in a rate at which the score changes, an increase or decrease in the pace at which the blocks move towards the player, etc. The game can end based on multiple factors, such as after a specified time period, when the player runs out of energy or lives, or when the player issues a command to stop the game. The video game can be implemented as a two-dimensional (2D) video game, a three-dimensional (3D) video game, a virtual reality (VR) game, or an augmented reality (AR) game. In some embodiments, the gaming console is configured to implement the video game as a VR game.
FIG. 1 is a block diagram of an environment 100 in which the rhythm-based video game can be implemented. The environment 100 includes a gaming console 105 which executes a rhythm-based video game, such as the one described above. In some embodiments, the gaming console 105 can be a computing device having a processor and memory, and the processor executes instructions stored in the memory to present the game to a player 110 on a display device 115 . The display device 115 supports 2D and/or 3D rendering of the game. In some embodiments, the player 110 may have to wear 3D glasses (not illustrated) to experience the game in 3D. The gaming console 105 supports a VR implementation of the game. In the VR implementation, an apparatus such as a headset 120 may have to be used by the player 110 to experience the game in VR.
The headset 120 is head-mounted device, which is used to track the orientation or position of a body or head of the player 110 . The headset 120 has one or more display devices that presents the game in VR. The headset 120 can also have one or more sensors that are used to determine and transmit co-ordinates of the position of the player 110 to the gaming console 105 . Examples of such sensors include gyroscopes, accelerometers, structured light systems, depth sensing cameras, magnetic position sensors, and eye tracking sensors. Sensors can be located in one or more locations, e.g., integrated with the headset 120 , be worn by the player 110 anywhere on the body, integrated with a motion controller 125 , or part of other equipment worn by the player 110 . The gaming console 105 establishes the position of the player 110 in a 3D virtual space by translating the co-ordinates received from the headset 120 to coordinates in the 3D virtual space. The co-ordinates received from the headset 120 can also help in determining different positions or actions of the player 110 , e.g., whether the player 110 is sitting, standing, ducking, jumping, moving, etc. The headset 120 may include a microphone to receive any audio input from the player 110 or the surroundings of the player 110 . The headset 120 may include one or more speakers that outputs audio to the player 110 , such as the song being played in the game. The headset 120 can communicate with the gaming console 105 wirelessly or using wired means.
The environment 100 also includes a hand-held or hand-worn apparatus such as a motion controller 125 , which is used to track an orientation, position and movement of the hand of the player 110 . The motion controller 125 includes one or more sensors, e.g., such as the ones mentioned above, that track the orientation, position and motion of the hand of the player 110 (examples include an Oculus Touch, a Samsung Gear controller, a PlayStation Move, or a Nintendo Switch controller). In some embodiments, the motion controller includes a magnetic position sensor that senses a position of the motion controller 125 in relation to a non-hand-held peripheral, e.g., headset 120 . The motion controller 125 transmits the co-ordinates of the hand and/or the movement of the hand to the gaming console 105 , which then translates the movement to the 3D virtual space. The motion controller 125 can also include a haptic feedback mechanism that provides haptic feedback, e.g., when the player 110 slashes the digital block. In some embodiments, the environmen
CROSS-REFERENCE TO RELATED APPLICATION(S)
The present application claims the benefit of U.S. Provisional Patent Application No. 62/755,468, entitled âVIDEO GAME INCLUDING BODY TRACKING AND VIRTUAL OBJECTS,â and filed Nov. 3, 2018, which is incorporated herein in its entirety.
TECHNICAL FIELD
The disclosure is related to video games, and more specifically to video games that track the movements of the player.
BACKGROUND
A player-tracking video game is one where a user's movements (e.g., of their head, body, arms, wrists, hands, or legs) provide meaningful controls to the game. Player-tracking games take a variety of forms and often include music video games.
A music video game is a video game where the gameplay is meaningfully and often almost entirely oriented around the player's interactions with a musical score or individual songs. Music video games may take a variety of forms and are often grouped with puzzle games due to their common use of ârhythmically generated puzzlesâ. Music video games are distinct from purely audio games in that they feature a visual feedback, to lead the player through the game's soundtrack, although eidetic music games can fall under both categories.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of an environment in which a rhythm-based video game can be implemented.
FIG. 2 is a block diagram of a three-dimensional (3D) virtual space in which the game is played, consistent with various embodiments.
FIG. 3 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 4 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 5 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 6 is a flow diagram of a process for presenting the game to a player, consistent with various embodiments.
FIG. 7 illustrates variable game actions based on angle and position of incidence between a digital element and a digital object.
FIG. 8 is a screenshot of a player playing the game, consistent with various embodiments.
FIG. 9 is a screenshot of a player view of the 3D virtual space generated by the gaming console, consistent with various embodiments.
FIG. 10 is a screenshot of a graphical user interface (GUI) with instructions to the player, consistent with various embodiments.
FIG. 11 is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 12A is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 12B is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 13 is a screenshot of a GUI with instructions to the player, consistent with various embodiments.
FIG. 14 is a screenshot of a GUI in which the player can select various options, consistent with various embodiments.
FIG. 15 is a screenshot of a GUI showing multiple digital objects approaching the player in the 3D virtual space, consistent with various embodiments.
FIG. 16 is a screenshot of a GUI showing multiple digital objects approaching the player in the 3D virtual space, consistent with various embodiments.
FIG. 17 is a block diagram of a computer system as may be used to implement features of some embodiments of the disclosed technology.
DETAILED DESCRIPTION
The disclosure is related to a video game (âgameâ). In the game a player interacts with digital objects that approach the user in a 3D corridor. Interaction occurs via digital collision between a digital element controlled by the player. Control of the digital element is based on body tracking. In some embodiments, body tracking is performed via a worn or held peripheral that tracks its own movement relative some other reference point. In some embodiments, a depth camera or room-mapping cameras (e.g., Playstation Camera, Microsoft Kinect, LeapMotion, or equivalents) captures video of the player and uses computer vision techniques to identify body positions of the user. The game presents the player with a stream of approaching digital objects and the user causes the digital element to collide with the digital objects based on use of body tracking. Digital collisions with different types of digital objects and from different angles cause a variety of game actions to occur. In some embodiments, the game further tracks the motion of the user's body and shifts a player location in game corresponding to body movements. Movement of the player location enables the player to avoid digital obstacles.
An embodiment of the disclosure is related to a rhythm-based video game. In the rhythm-based video game a player slashes blocks representing musical beats using one or a pair of energy blades resembling a lightsaber (the digital element). A gaming console renders multiple digital objects, e.g., a digital representation of a block (âdigital blockâ or âblockâ), that are moving in a specified direction, e.g., in a direction towards a user or player. The gaming console also renders a digital representation of an instrument, e.g., a digital representation of a sword resembling a lightsaber (âdigital saberâ), using which the player slashes, cuts or otherwise interact with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The game presents the player with a stream of approaching digital blocks in synchronization with beats of music, e.g., a song's beats and notes, being played in the game. As the beat picks up in the music, the pace at which the digital blocks approach the player can increase.
A game action occurs in response to the digital collision. The game action can be any of an increase or decrease in score of the player, an increase or decrease in energy of the player, a gain or loss of life of the player in the game, an increase or decrease in a rate at which the score changes, an increase or decrease in the pace at which the blocks move towards the player, etc. The game can end based on multiple factors, such as after a specified time period, when the player runs out of energy or lives, or when the player issues a command to stop the game. The video game can be implemented as a two-dimensional (2D) video game, a three-dimensional (3D) video game, a virtual reality (VR) game, or an augmented reality (AR) game. In some embodiments, the gaming console is configured to implement the video game as a VR game.
FIG. 1 is a block diagram of an environment 100 in which the rhythm-based video game can be implemented. The environment 100 includes a gaming console 105 which executes a rhythm-based video game, such as the one described above. In some embodiments, the gaming console 105 can be a computing device having a processor and memory, and the processor executes instructions stored in the memory to present the game to a player 110 on a display device 115 . The display device 115 supports 2D and/or 3D rendering of the game. In some embodiments, the player 110 may have to wear 3D glasses (not illustrated) to experience the game in 3D. The gaming console 105 supports a VR implementation of the game. In the VR implementation, an apparatus such as a headset 120 may have to be used by the player 110 to experience the game in VR.
The headset 120 is head-mounted device, which is used to track the orientation or position of a body or head of the player 110 . The headset 120 has one or more display devices that presents the game in VR. The headset 120 can also have one or more sensors that are used to determine and transmit co-ordinates of the position of the player 110 to the gaming console 105 . Examples of such sensors include gyroscopes, accelerometers, structured light systems, depth sensing cameras, magnetic position sensors, and eye tracking sensors. Sensors can be located in one or more locations, e.g., integrated with the headset 120 , be worn by the player 110 anywhere on the body, integrated with a motion controller 125 , or part of other equipment worn by the player 110 . The gaming console 105 establishes the position of the player 110 in a 3D virtual space by translating the co-ordinates received from the headset 120 to coordinates in the 3D virtual space. The co-ordinates received from the headset 120 can also help in determining different positions or actions of the player 110 , e.g., whether the player 110 is sitting, standing, ducking, jumping, moving, etc. The headset 120 may include a microphone to receive any audio input from the player 110 or the surroundings of the player 110 . The headset 120 may include one or more speakers that outputs audio to the player 110 , such as the song being played in the game. The headset 120 can communicate with the gaming console 105 wirelessly or using wired means.
The environment 100 also includes a hand-held or hand-worn apparatus such as a motion controller 125 , which is used to track an orientation, position and movement of the hand of the player 110 . The motion controller 125 includes one or more sensors, e.g., such as the ones mentioned above, that track the orientation, position and motion of the hand of the player 110 (examples include an Oculus Touch, a Samsung Gear controller, a PlayStation Move, or a Nintendo Switch controller). In some embodiments, the motion controller includes a magnetic position sensor that senses a position of the motion controller 125 in relation to a non-hand-held peripheral, e.g., headset 120 . The motion controller 125 transmits the co-ordinates of the hand and/or the movement of the hand to the gaming console 105 , which then translates the movement to the 3D virtual space. The motion controller 125 can also include a haptic feedback mechanism that provides haptic feedback, e.g., when the player 110 slashes the digital block. In some embodiments, the environment 100 may include more than one motion controller 125 , e.g., a pair of motion controllers. The player 110 can hold one motion controller in one hand and the other in the other hand. In some embodiments, a single motion controller 125 is held in both hands. In a two-player game one player can hold one motion controller and the other player can hold the other motion controller. The motion controller 125 can be of any shape, size or dimension that is suitable to be held in the hand of a player. The motion controller 125 can communicate with the gaming console 105 wirelessly or using wired means. The motion controller 125 can also communicate with other devices, such as headset 120 , wirelessly or using wired means.
In the rhythm-based video game, the gaming console 105 establishes a 3D virtual space, such as the 3D virtual space 205 of FIG. 2 . The 3D virtual space 205 includes a position of the player 110 , e.g., which is determined based on the co-ordinates of the position of the player 110 obtained from the headset 120 . The 3D virtual space 205 includes a proximate end 210 that is proximate to the player 110 and a distal end 215 opposite to the proximate end 210 . A portion of the proximate end 210 corresponds to the position of the player 110 . In some embodiments, the player may calibrate the controller or the virtual space 205 to themselves. Calibration may be performed by the hardware, or manually by the player.
The gaming console 105 renders multiple digital objects, e.g., a digital block 220 , that are approaching the player 110 from the distal end 220 . In some embodiments, the digital block 220 may appear bigger in size as it approaches the proximate end 210 . The gaming console 105 also renders a digital representation of an instrument, e.g., a digital saber, using which the player 110 can slash, cut or otherwise interact with the digital block 220 to cause a game action to occur in the game. The game presents the player 110 with a stream of the digital blocks in synchronization with beats of music, e.g., a song's beats and notes, being played in the game. As the beat picks up in the music, the pace at which the digital blocks approach the player 110 can increase.
In the VR implementation, the motion controller 125 can be a VR based motion controller, which is represented as a digital saber in the 3D virtual space 205 . The player 110 uses a pair of VR motion controllers to wield a pair of digital lightsabers, e.g., a first digital saber 230 and a second digital saber 235 , in the 3D virtual space 205 to slash the digital blocks. The digital blocks can be of various types, e.g., a first type and a second type, which the player 110 may interact with using the two different digital sabers. A specific type of digital blocks should be interacted with using a specified digital saber. In some embodiments, the first type of digital blocks can be of a first color and may have to be interacted with using a digital saber of the corresponding color, and the second type of digital blocks can be of a second color and may have to be interacted with using a digital saber of the corresponding color. For example, each digital block is colored red or blue to indicate whether the red or blue digital saber should be used to slash it.
In some embodiments, each of the digital blocks is marked with a direction indicator 225 , which indicates the direction to slash through the digital block. For example, a directional indicator 225 such as an arrow can indicate one of eight possible directions to slash through the digital block 220 . In another example, a directional indicator 225 such as a dot can indicate that the player 110 may slash through the digital block 220 in any direction. When a digital block is slashed by a digital saber, the digital block is destroyed, and a score is awarded based on one or more factors, e.g., timing accuracy and physical positioning of the cut.
The game can also present digital objects other than digital blocks, which the player 110 should not hit. For example, the game can present a digital object such as a âdigital mineâ 240 that the player 110 should not hit. In another example, the game can present obstacles such as a digital representation of an oncoming wall (âdigital obstacleâ) 245 that the player 110 or the head of the player 110 should avoid. The player 110 can avoid the digital obstacle 245 approaching the proximate end 210 by moving out of the path of digital obstacle 245 , which can be done by stepping to the right or left of the digital obstacle 245 or by ducking below the digital obstacle 245 . For example, if the player 110 steps to the right (in the real world) of the oncoming digital obstacle 245 , the gaming console 105 shifts at least a portion of the 3D virtual space 205 to the right of the player 110 so that the digital obstacle ends up passing through the left of the player 110 at the proximate end 210 .
The sensors worn by the player 110 , e.g., in the headset 120 , motion controller 125 or elsewhere, can transmit the co-ordinates of the player 110 , portion of the body of the player 110 , such as a head of the player 110 , movements of the player 110 , or movements of a portion of the body of the player 110 to the gaming console 105 . The gaming console 105 translates the received co-ordinates to the co-ordinates in the 3D virtual space 205 and determines the action of the player 110 , e.g., whether there was a digital collision between a digital block and a digital saber, whether there was a digital collision between a digital obstacle and a digital saber, whether there was a digital collision between a digital wall and any portion of the body of the player 110 (which corresponds to a portion of the 3D virtual space in the proximate end 210 ), whether the player 110 moved out of the path of the approaching digital obstacles, etc., which result in a specified game action.
A game action can occur in response to a digital collision between a digital saber and a digital object. The game action can be any of an increase or decrease in score of the player, an increase or decrease in energy of the player 110 , a gain or loss of life of the player 110 in the game, an increase or decrease in a rate at which the score changes, an increase or decrease in the pace at which the digital objects are created or move towards the player 110 , etc. Different types of game actions can occur in response to different events. For example, a score of the player 110 can increase in response to a digital collision between a digital block of a specified color and the digital saber of the specified color. In another example, a score of the player 110 can decrease in response to a digital collision between a digital block of a specified color and a digital saber of a color other than the specified color. In another example, a score of the player 110 may increase, or increase by an amount above a threshold, in response to a digital collision between a digital block and a digital saber in which a contact angle of the digital saber with the digital block is consistent with the direction indicated on the digital block.
In another example, a score of the player 110 may not increase, or increase by an amount below a threshold, in response to a digital collision between a digital block and a digital saber in which a contact angle of the digital saber with the digital block is not consistent with the direction indicated on the digital block. In another example, a score of the player 110 may not increase, or increase by an amount below a threshold, in response to a digital collision between a digital block and a digital saber whose collision impact is below a specified threshold.
In some embodiments, the collision impact can be measured as a function of how hard, fast or strong the player 110 swings the motion controller 125 to slash the digital block 220 . In another example, a score, energy or life of the player 110 can decrease in response to a digital collision between a digital mine and a digital saber. In another example, a score, energy or life of the player 110 can decrease in response to a digital collision between a digital obstacle and a digital saber or the player 110 . In some embodiments, a game action can also occur if there is no digital collision for a specified duration. For example, if the player 110 does not slash through any of the digital blocks for a duration exceeding a specified threshold, a score, energy or life of the player 110 can decrease, or the rate at which the score, energy or life increases can be decreased. The game can be configured to calculate the score, energy, or a life of the player 110 using various factors, including the above specified factors.
The game can end based on one or more factors, such as after a specified time period, when the player runs out of energy or lives, when the player 110 has completed one or more levels of the game, when the music stops playing, or when the player issues a command to stop the game.
As mentioned above, the game can be implemented as a 2D game, 3D game, a VR game, or an AR game. The entities of the environment 100 can be adjusted, adapted or configured for a specific implementation. For example, while the environment 100 described providing the VR gaming experience through the headset 120 , in some embodiments, the VR gaming experience can also be created through specially designed rooms with multiple large screens.
In some embodiments, some of the entities of the environment 100 may have to be calibrated before being able to play the game to obtain the coordinates of the position of the player 110 . For example, a setup process in the game may ask the player 110 to turn the headset 120 and perform some gestures, such as moving from left to right, right to left, ducking, jumping, or talking. In another example, the setup process in the game may ask the player 110 to move the motion controller in each hand to perform a gesture, such as raising the motion controller, swinging the hand with the motion controller to hit a digital object displayed on the display device 115 or the headset 120 . Once the calibration is complete, the gaming console 105 establishes the 3D virtual space 205 after which the player 110 can proceed to play the game.
In some embodiments, the user is able to customize their game experience. Examples include changing the graphical representation on the digital element (the digital sabers) 230 / 235 . The digital sabers 230 / 235 may change color, change in graphical design and through use of various âskins.â The sabers 230 / 235 may also change in shape or character causing the manner in which the user causes digital collisions to shift. In some embodiments, a player avatar is displayed to the user. The player avatar is customizable using skins and different digital models. In some embodiments, the user is able to generate gameplay via attaching a âbeat mapâ to an audio file. A beat map includes data describing each
digital object
220 , 240 , 245 that is generated in the 3D virtual space 205 , at what point in the audio file the
objects
220 , 240 , 245 are generated, the speed of the
objects
220 , 240 , 245 , the type/color of each
object
220 , 240 , 245 , the directionality 225 of each
object
220 , 240 , 245 , and a position and vector in the 3D virtual space 205 of each
object
220 , 240 , 245 . Given a beat map and a corresponding audio file, any song can be played in the game. A digital distribution system may also provide packs or groups of beat maps and audio files to play with the game.
FIG. 3 is a flow diagram of a process 300 for presenting the game to a player, consistent with various embodiments. In some embodiments, the process 300 can be implemented in the environment 100 of FIG. 1 . The player 110 can complete the setup process to calibrate the motion controller and the headset 120 . In some embodiments, the player 110 may need to complete the calibration only once per session, e.g., when the gaming console 105 is powered on and prior to playing a first game and need not calibrate the devices again unless the gaming console 105 is powered off and powered on again. In some embodiments, the devices may have to be calibrated when the player changes. In some embodiments, the devices may have to be calibrated when there are environmental changes around the player 110 , e.g., a change in intensity of light in the room where the player 110 plays the game, a change in distance between the player 110 and the gaming console 105 , a change in the position of the furniture in the room where the game is played. After the devices are calibrated, the gaming console 105 will have the necessary coordinates to establish the 3D virtual space in which the game is played.
At block 305 , the gaming console 105 renders the 3D virtual space 305 in which the game is to be played. The 3D virtual space 305 includes a digital position of the player 110 .
At block 310 , the gaming console 105 renders a digital element, e.g., a digital saber, in the 3D virtual space 305 relative to the digital position of the player 110 . The co-ordinates and the orientation of the digital saber relative to the digital position correspond to an orientation and the co-ordinates of the physical hand of the player 110 relative to the physical body of the player 110 . The gaming console 105 obtains the orientation and the co-ordinates of the physical hand of the player 110 relative to the physical body of the player 110 using the motion controller 125 held in the hand of the player 110 and the headset 120 worn by the player 110 .
At block 315 , the gaming console 105 renders multiple digital objects that approach the digital position of the player 110 from a distance in the 3D virtual space. The digital objects can include digital blocks that the player 110 should slash using the digital element. In some embodiments, the digital objects can include digital mines that the player 110 should not hit, and digital obstacles that the player 110 should avoid.
At block 320 , the gaming console 105 causes a game action to occur in response to a digital collision between the digital element and one or more of the digital objects. The different type of game actions that can occur are described at least with reference to FIG. 1 .
FIG. 4 is a flow diagram of a process 400 for presenting the game to a player, consistent with various embodiments. In some embodiments, the process 400 can be implemented in the environment 100 of FIG. 1 . The process 400 assumes that the headset 120 and the motion controllers are calibrated. At block 405 , the gaming console 105 renders a 4D virtual space in which the game is to be played. The 4D virtual space 205 includes a proximate end 210 that is proximate to the player 110 and a distal end 2
CLAIMS
Claims ( 19 )
The invention claimed is:
1. A method comprising:
instantiating a game space that includes a player location, and a lane having a proximate end positioned next to the player location and a distal end opposite the player location;
rendering a plurality of digital objects that move in a linear path in the lane from the distal end to the proximate end, wherein at least a first subset of the plurality of digital objects include a directional component; and
detecting collisions between the plurality of digital objects and one or more digital sword elements controlled by a user,
wherein detected collisions that A) are between the first subset of the plurality of digital objects and a first digital sword elements, of the one or more digital sword elements, and B) that occurring at a contact angle that is consistent with the directional component, effect a first game action,
wherein detected collisions that C) are between the first subset of the plurality of digital objects and the first digital sword element and D) that occurring at a contact angle that is inconsistent with the directional component, effect a second game action, and
wherein control of the one or more digital sword elements is based on a position and orientation of a pair of hands of the user.
2. The method of claim 1 , wherein the first game action or second game action are any of:
increasing a game score;
decreasing the game score;
effecting a pace of the approach of the digital objects;
effecting a creation of the digital objects; or
effecting a rate of change in the game score.
3. The method of claim 1 , further comprising:
playing a musical score including musical notes, wherein a pace of movement of the plurality of digital objects through the lane is based on the musical notes.
4. The method of claim 3 , wherein a pace of generation of the plurality of digital objects within the lane is based on the musical notes.
5. The method of claim 1 , wherein the digital sword elements include a right sword and a left sword, and wherein a first subset of the plurality of digital objects correspond to the right sword and a second subset of the plurality of digital objects correspond to the left sword, and wherein detected collisions between the plurality of digital objects and a corresponding digital sword element effect a first game action and detected collisions between the plurality of digital objects and the an opposing digital sword element effect a second game action.
6. A system comprising:
a hand tracking apparatus configured to track a position and orientation of at least a first real hand of a user; and
a processor that, in response to executing instructions, performs operations comprising:
directing rendering of a virtual space that includes a digital position of the user,
instantiating a first digital element in the virtual space that is positioned and oriented relative to the digital position corresponding to the position and orientation of the first real hand of the user,
causing a display to graphically represent a plurality of digital objects in the virtual space that approach the digital position from a distance, wherein at least a first digital object of the plurality of digital objects includes a directional component, and
causing a predetermined game action to occur in response to a digital collision in the virtual space between the first digital object of the plurality of digital objects and the first digital element,
wherein the predetermined game action is a first game action when a contact angle of the digital collision is consistent with the directional component of the first digital object, and
wherein the predetermined game action is a second game action when the contact angle of the digital collision is inconsistent with the directional component of the first digital object.
7. The system of claim 6 , wherein the hand tracking apparatus is any of:
hand-held peripherals that wirelessly transmit the position and orientation to a communication apparatus communicatively coupled with the processor;
hand-held peripherals including magnetic position sensors that sense a position of the hand-held peripherals in relation to a non-hand-held peripheral; or
a depth sensing camera positioned toward at least the first hand of the user.
8. The system of claim 6 , wherein the display is any of:
a head mounted display; or
a 2D display monitor.
9. The system of claim 6 , wherein the virtual space is any of:
an immersive virtual reality environment wherein the space surrounds the user;
a digital space overlaid on a real space via augmented reality wherein the space surrounds the user; or
a digital space wherein a user perspective is positioned external to a fourth wall.
10. The system of claim 6 , further comprising:
a body or head tracking apparatus configured to track body or head position and orientation, and wherein a detected change in body or head position and orientation cause the processor to effect a corresponding change in a position and orientation of the digital position of the user in the virtual space.
11. A method comprising:
rendering a virtual space that includes a digital position of a user;
instantiating in the virtual space a first digital element, wherein a set of coordinates and orientation of the first digital element relative to the digital position of the user corresponds to an orientation of a first real hand of the user to a real body of the user;
graphically representing a plurality of digital objects in the virtual space that approach the digital position, wherein a first digital object of the plurality of digital objects includes a directional component; and
causing a predetermined game action to occur in response to a digital collision in the virtual space between the first digital object and the first digital element,
wherein the predetermined game action is a first game action when a contact angle of the digital collision is consistent with the directional component of the first digital object; and
wherein the predetermined game action is second game action when the contact angle of the digital collision is inconsistent with the directional component of the first digital object.
12. The method of claim 11 , wherein a pace of the approach of the digital objects to the digital position of the user corresponds with musical notes.
13. The method of claim 11 , further comprising:
causing a third game action to occur in response to a second digital object of the plurality of digital objects passing by a collision region without digitally colliding with the first digital element.
14. The method of claim 11 , wherein the first digital element is a sword.
15. The method of claim 11 , wherein the predetermined game action is any of:
increasing a game score;
decreasing the game score;
effecting a pace of the approach of the digital objects;
effecting a creation of the digital objects; or
effecting a rate of change in the game score.
16. The method of claim 11 , further comprising:
instantiating in the virtual space a second digital element, wherein a second set of coordinates and orientation of the second digital element relative to the digital position of the user corresponds to an orientation of a second real hand of the user to the real body of the user;
causing an additional game action to occur in response to a digital collision in the virtual space between a second digital object of the plurality of digital objects and the second digital element.
17. The method of claim 16 , wherein a first subset of the plurality of digital objects correspond to the first digital element and a second subset of the plurality of digital objects correspond to the second digital element.
18. The method of claim 11 , wherein the first digital object includes a type criterion and the predetermined game action includes an effect style, wherein the effect style is based on the type criterion.
19. The method of claim 11 , wherein the contact angle is consistent with the directional component of the first digital object when the first digital element initiates contact with the first digital object on an intersection path that is in a same direction as a direction indicated by the directional component.
US16/195,404
2018-11-03
2018-11-19
Virtual reality collision interpretation
Active
US10780349B2
( en )
Priority Applications (3)
Application Number
Priority Date
Filing Date
Title
US16/195,404
US10780349B2
( en )
2018-11-03
2018-11-19
Virtual reality collision interpretation
US16/926,572
US11235245B1
( en )
2018-11-03
2020-07-10
Player-tracking video game
US17/551,415
US11701590B2
( en )
2018-11-03
2021-12-15
Player-tracking video game
Applications Claiming Priority (2)
Application Number
Priority Date
Filing Date
Title
US201862755468P
2018-11-03
2018-11-03
US16/195,404
US10780349B2
( en )
2018-11-03
2018-11-19
Virtual reality collision interpretation
Related Child Applications (1)
Application Number
Title
Priority Date
Filing Date
US16/926,572
Continuation
US11235245B1
( en )
2018-11-03
2020-07-10
Player-tracking video game
Publications (2)
Publication Number
Publication Date
US20200139240A1
US20200139240A1 ( en )
2020-05-07
US10780349B2
true
US10780349B2 ( en )
2020-09-22
Family
ID=70458337
Family Applications (4)
Application Number
Title
Priority Date
Filing Date
US16/195,498
Abandoned
US20200139226A1
( en )
2018-11-03
2018-11-19
Player tracking video game
US16/195,404
Active
US10780349B2
( en )
2018-11-03
2018-11-19
Virtual reality collision interpretation
US16/926,572
Active
US11235245B1
( en )
2018-11-03
2020-07-10
Player-tracking video game
US17/551,415
Active
US11701590B2
( en )
2018-11-03
2021-12-15
Player-tracking video game
Family Applications Before (1)
Application Number
Title
Priority Date
Filing Date
US16/195,498
Abandoned
US20200139226A1
( en )
2018-11-03
2018-11-19
Player tracking video game
Family Applications After (2)
Application Number
Title
Priority Date
Filing Date
US16/926,572
Active
US11235245B1
( en )
2018-11-03
2020-07-10
Player-tracking video game
US17/551,415
Active
US11701590B2
( en )
2018-11-03
2021-12-15
Player-tracking video game
Country Status (1)
Country
Link
US
( 4 )
US20200139226A1
( en )
Cited By (6)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US10950055B2
( en )
2018-11-03
2021-03-16
Facebook Technologies, Llc
Video game controlled by player motion tracking
USD922427S1
( en )
*
2018-03-29
2021-06-15
Facebook Technologies, Llc
Display device with animated graphical user interface
US20210394068A1
( en )
*
2020-06-23
2021-12-23
Nintendo Co., Ltd.
Computer-readable non-transitory storage medium having instructions stored therein, game apparatus, game system, and game processing method
US11235245B1
( en )
2018-11-03
2022-02-01
Facebook Technologies, Llc
Player-tracking video game
US20230419627A1
( en )
*
2022-06-24
2023-12-28
Lowe's Companies, Inc.
Object modeling based on properties and images of an object
US12489815B1
( en )
*
2020-05-11
2025-12-02
Apple Inc.
Toolbox and context for user interactions
Families Citing this family (11)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
CN111833461B
( en )
*
2020-07-10
2022-07-01
å京åèè·³å¨ç½ç»ææ¯æéå ¬å¸
Method and device for realizing special effect of image, electronic equipment and storage medium
CN112121410B
( en )
*
2020-10-22
2024-04-12
æ·±å³å¸çç«è§å¤åªä½ç§ææéå ¬å¸
VR game-based cabinet-entering method
US11617949B1
( en )
*
2021-09-28
2023-04-04
Sony Group Corporation
Methods for predefining virtual staircases connecting platforms in extended reality (XR) environments
US11612817B1
( en )
*
2021-09-28
2023-03-28
Sony Group Corporation
Method for predefining activity zones in an extended reality (XR) environment
US11596866B1
( en )
*
2021-09-28
2023-03-07
Sony Group Corporation
Method to use recognition of nearby physical surfaces to generate NPC reactions to events
CN115082285B
( en )
*
2022-06-15
2025-05-27
å京åè·³ç½ç»ææ¯æéå ¬å¸
Image processing method, device, electronic device and storage medium
CN116149464B
( en )
*
2022-11-21
2026-04-10
å京åè·³ç½ç»ææ¯æéå ¬å¸
Interaction methods and devices
CN115808980A
( en )
*
2022-12-19
2023-03-17
æ·±å³åç±³ç½ç»ç§ææéå ¬å¸
Graphic Cutting Method Based on Somatosensory
US20240293022A1
( en )
*
2023-03-03
2024-09-05
Eyes in Sync Inc.
System and method for stereoscopic vision testing
JP7824912B2
( en )
*
2023-07-26
2026-03-05
任天å æ ªå¼ä¼ç¤¾
Game program, game system, game device, and game processing method
US20250032905A1
( en )
*
2023-07-28
2025-01-30
Adeia Guides Inc.
Dynamic personal extended reality safe area control
Citations (15)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US6200138B1
( en )
1997-10-30
2001-03-13
Sega Enterprises, Ltd.
Game display method, moving direction indicating method, game apparatus and drive simulating apparatus
US20070211025A1
( en )
*
2006-03-08
2007-09-13
Nintendo Co., Ltd.
Motion determining apparatus and storage medium having motion determining program stored thereon
US20080064500A1
( en )
2006-09-13
2008-03-13
Namco Bandai Games Inc.
Game controller and charging cradle
US20080300055A1
( en )
2007-05-29
2008-12-04
Lutnick Howard W
Game with hand motion control
US20100151948A1
( en )
2008-12-15
2010-06-17
Disney Enterprises, Inc.
Dance ring video game
US20110003639A1
( en )
2009-07-06
2011-01-06
Konami Digital Entertainment Co., Ltd.
Gaming device, game processing method and information memory medium
US20110287842A1
( en )
2010-05-19
2011-11-24
Nintendo Co., Ltd.
Game apparatus, storage medium having game program stored therein, game system, and game process method
US20130113826A1
( en )
2011-11-04
2013-05-09
Sony Corporation
Image processing apparatus, image processing method, and program
US20130194182A1
( en )
2012-01-31
2013-08-01
Konami Digital Entertainment Co., Ltd.
Game device, control method for a game device, and non-transitory information storage medium
US20130203492A1
( en )
*
2012-02-07
2013-08-08
Krew Game Studios LLC
Interactive music game
US20160195940A1
( en )
*
2015-01-02
2016-07-07
Microsoft Technology Licensing, Llc
User-input control device toggled motion tracking
US20170266551A1
( en )
*
2016-03-18
2017-09-21
Colopl, Inc.
Game medium, method of using the game medium, and game system for using the game medium
US20170329515A1
( en )
*
2016-05-10
2017-11-16
Google Inc.
Volumetric virtual reality keyboard methods, user interface, and interactions
US20180108179A1
( en )
*
2016-10-17
2018-04-19
Microsoft Technology Licensing, Llc
Generating and Displaying a Computer Generated Image on a Future Pose of a Real World Object
US20190243472A1
( en )
*
2018-02-02
2019-08-08
Sony Interactive Entertainment Inc.
Head-mounted display to controller clock synchronization over em field
Family Cites Families (7)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US6663491B2
( en )
2000-02-18
2003-12-16
Namco Ltd.
Game apparatus, storage medium and computer program that adjust tempo of sound
CN101068605B
( en )
*
2004-12-03
2011-07-13
æ°ä¸ä»£æ ªå¼ä¼ç¤¾
Boxing game processing method, display control method, position detection method, cursor control method, energy consumption calculating method and exercise system
US20070243915A1
( en )
2006-04-14
2007-10-18
Eran Egozy
A Method and Apparatus For Providing A Simulated Band Experience Including Online Interaction and Downloaded Content
US9746921B2
( en )
*
2014-12-31
2017-08-29
Sony Interactive Entertainment Inc.
Signal generation and detector systems and methods for determining positions of fingers of a user
US10682572B2
( en )
*
2018-07-25
2020-06-16
Cameron Wilson
Video game reticle
US20200139226A1
( en )
2018-11-03
2020-05-07
Beat Games s.r.o.
Player tracking video game
US10950055B2
( en )
2018-11-03
2021-03-16
Facebook Technologies, Llc
Video game controlled by player motion tracking
2018
2018-11-19
US
US16/195,498
patent/US20200139226A1/en
not_active
Abandoned
2018-11-19
US
US16/195,404
patent/US10780349B2/en
active
Active
2020
2020-07-10
US
US16/926,572
patent/US11235245B1/en
active
Active
2021
2021-12-15
US
US17/551,415
patent/US11701590B2/en
active
Active
Patent Citations (15)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US6200138B1
( en )
1997-10-30
2001-03-13
Sega Enterprises, Ltd.
Game display method, moving direction indicating method, game apparatus and drive simulating apparatus
US20070211025A1
( en )
*
2006-03-08
2007-09-13
Nintendo Co., Ltd.
Motion determining apparatus and storage medium having motion determining program stored thereon
US20080064500A1
( en )
2006-09-13
2008-03-13
Namco Bandai Games Inc.
Game controller and charging cradle
US20080300055A1
( en )
2007-05-29
2008-12-04
Lutnick Howard W
Game with hand motion control
US20100151948A1
( en )
2008-12-15
2010-06-17
Disney Enterprises, Inc.
Dance ring video game
US20110003639A1
( en )
2009-07-06
2011-01-06
Konami Digital Entertainment Co., Ltd.
Gaming device, game processing method and information memory medium
US20110287842A1
( en )
2010-05-19
2011-11-24
Nintendo Co., Ltd.
Game apparatus, storage medium having game program stored therein, game system, and game process method
US20130113826A1
( en )
2011-11-04
2013-05-09
Sony Corporation
Image processing apparatus, image processing method, and program
US20130194182A1
( en )
2012-01-31
2013-08-01
Konami Digital Entertainment Co., Ltd.
Game device, control method for a game device, and non-transitory information storage medium
US20130203492A1
( en )
*
2012-02-07
2013-08-08
Krew Game Studios LLC
Interactive music game
US20160195940A1
( en )
*
2015-01-02
2016-07-07
Microsoft Technology Licensing, Llc
User-input control device toggled motion tracking
US20170266551A1
( en )
*
2016-03-18
2017-09-21
Colopl, Inc.
Game medium, method of using the game medium, and game system for using the game medium
US20170329515A1
( en )
*
2016-05-10
2017-11-16
Google Inc.
Volumetric virtual reality keyboard methods, user interface, and interactions
US20180108179A1
( en )
*
2016-10-17
2018-04-19
Microsoft Technology Licensing, Llc
Generating and Displaying a Computer Generated Image on a Future Pose of a Real World Object
US20190243472A1
( en )
*
2018-02-02
2019-08-08
Sony Interactive Entertainment Inc.
Head-mounted display to controller clock synchronization over em field
Non-Patent Citations (9)
* Cited by examiner, â Cited by third party
Title
" Je teste Beat Saber@Gamescom 2017-Full Run ", YouTube webpages, Aug. 28, 2017, https:/www.youtube.com/watch?v=LDxCv8X1w4Y&t=4s, 2 pages.
" Wii Sports Resort-Swordplay Speed Slice vs. Champion Matt + All Stamps ", youtube.com, <https://www.youtube.com/watch?v+tO_SBUDLIG, Nov. 15, 2015, pp. 1-9.
" Je teste Beat Saber@Gamescom 2017âFull Run ", YouTube webpages, Aug. 28, 2017, https:/www.youtube.com/watch?v=LDxCv8X1w4Y&t=4s, 2 pages.
" Wii Sports ResortâSwordplay Speed Slice vs. Champion Matt + All Stamps ", youtube.com, <https://www.youtube.com/watch?v+tO_SBUDLIG, Nov. 15, 2015, pp. 1-9.
David Jagneaux, Lightsabers Come to Robo Recall With This Fan-Made Star Wars Mod, Apr. 4, 2017, Upload, https://uploadvr.com/robo-recall-star-wars-mod/.
*
Herbert, Dean," Osu! the game ", evidenced by https//en.wikikpedia. or/w/index.php?title=Osu!&oldid=807743069 and https://www.youtube.com/watch?v=kwoR1TKQF4Y, Sep. 16, 2007, pp. 1-15.
IGN, " Wii Sports Resort Wiki Guide, <https://www.ign.com/wikis/wii-sports-resort/Speed_Slice#Speed_Slice> ", Sep. 12, 2012, pp. 1-7.
MGS Studio, SW Mod Update for Robo Recall, Mar. 12, 2017, YouTube, https://www.youtube.com/watch?v=m32d_Yshp38&feature=youtu.be.
*
TommyT999, Virtual Reality Lightsaber + Music = Beat Saber VR Gameplay, May 19, 2018, YouTube, https://www.youtube.com/watch?v=0V623RJgA6s.
*
Cited By (9)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
USD922427S1
( en )
*
2018-03-29
2021-06-15
Facebook Technologies, Llc
Display device with animated graphical user interface
US10950055B2
( en )
2018-11-03
2021-03-16
Facebook Technologies, Llc
Video game controlled by player motion tracking
US11235245B1
( en )
2018-11-03
2022-02-01
Facebook Technologies, Llc
Player-tracking video game
US11361517B1
( en )
2018-11-03
2022-06-14
Facebook Technologies, Llc
Video game controlled by player motion tracking
US11701590B2
( en )
2018-11-03
2023-07-18
Meta Platforms Technologies, Llc
Player-tracking video game
US12489815B1
( en )
*
2020-05-11
2025-12-02
Apple Inc.
Toolbox and context for user interactions
US20210394068A1
( en )
*
2020-06-23
2021-12-23
Nintendo Co., Ltd.
Computer-readable non-transitory storage medium having instructions stored therein, game apparatus, game system, and game processing method
US11498004B2
( en )
*
2020-06-23
2022-11-15
Nintendo Co., Ltd.
Computer-readable non-transitory storage medium having instructions stored therein, game apparatus, game system, and game processing method
US20230419627A1
( en )
*
2022-06-24
2023-12-28
Lowe's Companies, Inc.
Object modeling based on properties and images of an object
Also Published As
Publication number
Publication date
US20200139226A1
( en )
2020-05-07
US11701590B2
( en )
2023-07-18
US20200139240A1
( en )
2020-05-07
US20220105433A1
( en )
2022-04-07
US11235245B1
( en )
2022-02-01
Similar Documents
Publication
Publication Date
Title
US11701590B2
( en )
2023-07-18
Player-tracking video game
US11361517B1
( en )
2022-06-14
Video game controlled by player motion tracking
JP4567805B2
( en )
2010-10-20
Method and apparatus for providing a gearing effect to an input based on one or more visual, acoustic, inertial and mixed data
US10220303B1
( en )
2019-03-05
Gesture-based music game
JP5439367B2
( en )
2014-03-12
How to change game gearing
US10328339B2
( en )
2019-06-25
Input controller and corresponding game mechanics for virtual reality systems
US9933851B2
( en )
2018-04-03
Systems and methods for interacting with virtual objects using sensory feedback
JP6910809B2
( en )
2021-07-28
Simulation system, program and controller
JP7081921B2
( en )
2022-06-07
Programs and game equipment
JP2025018335A
( en )
2025-02-06
GAME PROGRAM, GAME SYSTEM, GAME DEVICE, AND GAME PROCESSING METHOD
CN102047201A
( en )
2011-05-04
Controlling virtual reality
CN104258555A
( en )
2015-01-07
RGBD vision sensing type double-fist ball hitting fitness interaction system
JP4883759B2
( en )
2012-02-22
Program, information storage medium, and image generation system
JP2009508581A
( en )
2009-03-05
Intensive computer image and sound processing and input device for interfacing with computer programs
CN105413147B
( en )
2017-08-08
Recognition methods, identifying system and the billiards playing device of game of billiards shot
EP4434597A2
( en )
2024-09-25
Player-tracking video game editor
JP6419268B1
( en )
2018-11-07
Information processing method, apparatus, and program for causing computer to execute information processing method
JP4806608B2
( en )
2011-11-02
Program, information storage medium, and image generation system
JP5558008B2
( en )
2014-07-23
Program, information storage medium, and game system
CN205581786U
( en )
2016-09-14
Handle device of simulate reality action
JP2017060611A
( en )
2017-03-30
System, method and program
JP7734608B2
( en )
2025-09-05
Method, recording medium and information processing device
TW201526960A
( en )
2015-07-16
Method for switching game screens according to waving range of player
JP6307651B1
( en )
2018-04-04
GAME PROGRAM, METHOD, AND INFORMATION PROCESSING DEVICE
JP2025025784A
( en )
2025-02-21
GAMING SYSTEM, GAMING DEVICE, PROGRAM AND GAMING METHOD
Legal Events
Date
Code
Title
Description
2018-11-19
FEPP
Fee payment procedure
Free format text : ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY
2018-12-10
FEPP
Fee payment procedure
Free format text : ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY
2020-05-08
STPP
Information on status: patent application and granting procedure in general
Free format text : RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER
2020-08-12
FEPP
Fee payment procedure
Free format text : ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY
2020-08-21
STPP
Information on status: patent application and granting procedure in general
Free format text : PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED
2020-09-02
STCF
Information on status: patent grant
Free format text : PATENTED CASE
2021-05-24
AS
Assignment
Owner name : FACEBOOK TECHNOLOGIES, LLC, CALIFORNIA
Free format text : ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HRINCAR, VLADIMIR;ILAVSKY, JAN;SIGNING DATES FROM 20200612 TO 20200714;REEL/FRAME:056335/0269
2024-02-26
MAFP
Maintenance fee payment
Free format text : PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY
Year of fee payment : 4
<script src="/sw/null_l