ConceptioArchiveGoogle Patents
Google Patentsopen access

Methods and systems for spectating characters in follow-mode for virtual … — Sony Interactive Entertainment Inc. (US11865447B2)

Sony Interactive Entertainment Inc. · Google Patents
Google Patents · Patents · License: Open Access
Open Source ↗
mahdiazmandiansonyinteractiveentertainmentinc.
patent, google patents, intellectual property, US11865447B2, Sony Interactive Entertainment Inc., Mahdi Azmandian, en, 2024

ABSTRACT

Abstract

Methods and systems for spectating a live video game are presented. In one embodiment, a method for performing an automated catch-up to a player is provided. The method includes providing an interface for presenting a first view of a video game on a client device where the first view has a first vantage point and includes a game player. The method includes an operation for providing a portal within the interface for presenting a second view of the game object, the second view having a second vantage point. The method further includes an operation for moving the second vantage point toward the game object within the portal. Additionally, the method provides an operation for removing the portal.

Description

CLAIM OF PRIORITY

This application is a Continuation of U.S. patent application Ser. No. 16/355,668, filed on Mar. 15, 2019 (U.S. Pat. No. 10,918,945, issued on Feb. 16, 2021), entitled “M ETHODS AND S YSTEMS FOR S PECTATING C HARACTERS IN F OLLOW -M ODE FOR V IRTUAL R EALITY V IEWS ,” which is herein incorporated by reference.

RELATED APPLICATION

This Application is related to U.S. patent application Ser. No. 16/355,635, entitled “METHODS AND SYSTEMS FOR SPECTATING CHARACTERS IN VIRTUAL REALITY VIEWS,” filed Mar. 15, 2019, which is herein incorporated by reference.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to virtual reality applications, and more particularly, to methods and systems for providing spectating views.

BACKGROUND

Virtual reality is becoming an increasingly popular way for consumers to interact with content. This is especially true in the context of video games. Currently, both players and spectators are able to interact with a video game in virtual reality (VR) via a head mounted display (HMD). A spectator is typically given a spectator view that is generated by introducing a camera within the environment of the game. The spectator may be able to navigate the environment of the video game via a controller to view the game action of the video game. For example, a spectator may choose to follow a certain player to view the performance of that player.

Current methods of spectating video games via HMD have certain drawbacks in terms of navigability, usability, comfort, and functionality. For example, currently it may be difficult for a spectator to navigate a game environment in a desired manner to view the various happenings that are of interest to the spectator. Additionally, current methods of spectating do not allow spectators to follow or catch-up to a target player in an effective and comfortable way.

It is in this context that embodiments arise.

SUMMARY

Embodiments of the present disclosure relate to improved methods and systems for enabling a spectator to follow a target player.

In one embodiment, a method is provided. The method includes an operation for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The method also includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. Further, the method includes an operation for moving the second vantage point toward the target object such that a virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside the portal. Moreover, the method includes an operation for wiping away the portal during at least a portion of said moving the second vantage point, said wiping away the portal includes expanding a size of the portal such that the second view replaces the first view in the interface.

In another embodiment, a method includes an operation for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The method also includes an operation for determining that the target object has moved beyond a first pre-defined threshold away from the first vantage point and executing a rubber-banding function, the rubber-banding function renders a band for display in the interface that connects the spectator to the target object. Additionally, the method includes an operation for determining that the target object has moved beyond a second pre-defined threshold away from the first vantage point and executing a catch-up function, the catch-up function includes. In various embodiments, the catch-up function includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. The catch-up function also includes an operation for moving the second vantage point toward the target object to a third vantage point such that the virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside of the portal.

In another embodiment, a non-transitory computer-readable storage medium storing a computer program executable by a processor-based system for transporting a spectator within an environment of a video game is provided. The non-transitory computer-readable storage medium includes program instructions for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The non-transitory computer-readable storage medium also includes program instructions for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. Additionally, the non-transitory computer-readable storage medium includes program instructions for moving the second vantage point toward the target object such that a virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside the portal. Moreover, the non-transitory computer-readable storage medium includes program instructions for wiping away the portal during at least a portion of said moving the second vantage point, said wiping away the portal includes expanding a size of the portal such that the second view replaces the first view in the interface.

Other aspects of the disclosure will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure may best be understood by reference to the following description taken in conjunction with the accompanying drawings in which:

FIG. 1 A shows a conceptual diagram of a camera used to capture an overhead view shown in FIG. 1 B , according to one embodiment.

FIG. 1 B shows an illustration of an interface having an overhead view of an interactive environment of a video game generated by camera of FIG. 1 A , according to one embodiment.

FIGS. 2 A and 2 B show conceptual illustrations of a camera placement diagram and a resulting third-person view, respectively, according to one embodiment.

FIGS. 3 A and 3 B show an embodiment of a rubber-banding function that serves to assist the spectator in following the player, according to one embodiment.

FIGS. 4 A- 4 C show conceptual illustrations of the properties of the rubber-banding function that connects the spectator to a target player, according to one embodiment.

FIGS. 5 A- 5 C show conceptual illustrations of the properties of the rubber-banding function, according to another embodiment.

FIGS. 6 A and 6 B show a camera placement diagram and a resulting catch-up function, respectively, according to one embodiment.

FIGS. 7 A and 7 B show a camera placement diagram and a resulting view towards the tail-end of the catch-up function, respectively, according to one embodiment.

FIGS. 8 A- 8 H show a sequence of events occurring during a catch-up function, according to one embodiment.

FIGS. 9 A- 9 D show a timeline of events attendant to the catch-up function transporting the spectator, according to one embodiment.

FIGS. 10 A- 10 C illustrate a yaw-correction function that may be executed during execution of the catch-up function, according to various embodiments.

FIGS. 11 A- 11 C illustrate a yaw-correction function that may be executed during execution of the catch-up function when the target player makes a turn, according to various embodiments.

FIG. 12 shows a sequence of catch-up events for continually following a player, according to one embodiment.

FIG. 13 illustrates components of an example device that can be used to perform aspects of the various embodiments of the present disclosure, according to various embodiments.

DETAILED DESCRIPTION

Embodiments of the present disclosure relate to improved methods and systems for spectating video games. Some embodiments of the present disclosure relate to methods of providing seamless transitions between various third-person views of a player. Embodiments of the present disclosure also relate to methods for providing a catch-up function that enables a spectator to automatically follow a player of interest. In some embodiments, the methods can by implemented via one or more head mounted displays (HMDs). It will be obvious, however, to one skilled in the art, that the present disclosure may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order to not unnecessarily obscure the present disclosure.

Video game spectating is an important component in the video game ecosystem and provides users with an opportunity to derive entertainment from a video game without having to play it. Just as spectating a sports game, a race, or a concert is entertaining for spectators, the same is true of video games. A video game need not be played first-hand to be a source of entertainment, just as a bobsledding race need not be raced first-hand to be a source of entertainment. Video games, however, can offer a spectating experience that is more immersive, engaging, and customized than that of other activities. Because video game action takes place in a virtual interactive environment, virtual cameras that capture spectator views are not limited in the ways real-life cameras are when capturing real-life action. For example, real-life cameras for capturing real-life spectating activities are limited by the costs of camera equipment, camera operation and broadcast, as well the impracticability of placing cameras at various areas on interest.

Spectating video games are confined by none of these. For example, it is possible to introduce cameras at virtually any location within a virtual interactive environment and to move them in a desired way to provide immersive and user-controlled spectator views. For example, it is possible to obtain overhead or top-down views for spectating the overall happenings of a video game by placing a virtual camera at an elevated position above the virtual interactive environment. It is also possible to obtain third-person views and over-the-shoulder views that are relatively close to a selected player to see in greater detail that player's actions. Moreover, it is possible to enable a spectator to control a virtual camera used to generate a spectator view, such as to move a camera location or to pan the camera.

However, while a greater number of views are possible with video game spectating, current methods are lacking in the way they manage the greater number of views as well as how comfortable the spectating experience is within a virtual reality setting. For example, current methods do not provide ways to seamlessly transition between various viewpoints, such as between different third-person views having differing vantage points. Current methods transport a spectator within a virtual environment by providing translational movement to a virtual camera used to capture the spectator view. However, such movements can be disorienting and hard to follow, especially when the view is supplied to a VR view in an HMD. It has been observed that when spectators are moved translationally or rotationally within a VR scene without a sense of agency over the movement, disorientation may result.

Current methods also do not address a way to allow a spectator to automatically catch-up or follow a player of interest. For example, current methods either require a spectator to manually follow a player or provide fixed views that follow a player. The former method can become tiring and distracting for a spectator, especially during complex multiplayer games sessions of extended length. The latter method has been observed to cause disorientation because of the jerky nature of the fixed spectator view. The embodiments contemplated here address these and other shortcomings associated with current video game spectating technology.

Embodiments described here solve current problems related to spectator viewing technology in the computer-related arts by providing computer-implemented “follow assist” functions that enable a spectator to seamlessly follow a target player. The follow-assist functions include a rubber-banding function that enables the spectator to manually follow the target player as well as a catch-up function that automatically transports the spectator using portal-mediated transitions.

Portal-mediated transitions are contemplated to be used when a vantage point of a spectator is to be moved such that the spectator experiences translational and rotational movements via a portal rather than experiencing the translational and rotational movement in a full field of view. The portal-mediated transitions include providing a portal that initially appears larger in size and constricts to a smaller size to restrict the spectator's field of view. The spectator's vantage point is then provided with translational and rotational movement to a desired destination within the portal while the area outside of the portal remains relatively static. In this manner, the spectator is made to focus on the area within the HMD display where movement occurs while the spectator's peripheral vision is not stimulated by movement. Portal-mediated transitions have been observed to result in more comfortable virtual movements with less disorientation for HMD spectators.

FIG. 1 A shows a conceptual diagram of a camera 102 used to capture an overhead view 101 shown in FIG. 1 B , according to one embodiment. The camera 102 is placed at an elevated altitude in the z-axis to capture overall game action occurring in an interactive environment 100 of a video game. As such, the altitude, or z-coordinate, of the <figure-callout id="102" label="camera" file

CLAIM OF PRIORITY

This application is a Continuation of U.S. patent application Ser. No. 16/355,668, filed on Mar. 15, 2019 (U.S. Pat. No. 10,918,945, issued on Feb. 16, 2021), entitled “M ETHODS AND S YSTEMS FOR S PECTATING C HARACTERS IN F OLLOW -M ODE FOR V IRTUAL R EALITY V IEWS ,” which is herein incorporated by reference.

RELATED APPLICATION

This Application is related to U.S. patent application Ser. No. 16/355,635, entitled “METHODS AND SYSTEMS FOR SPECTATING CHARACTERS IN VIRTUAL REALITY VIEWS,” filed Mar. 15, 2019, which is herein incorporated by reference.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to virtual reality applications, and more particularly, to methods and systems for providing spectating views.

BACKGROUND

Virtual reality is becoming an increasingly popular way for consumers to interact with content. This is especially true in the context of video games. Currently, both players and spectators are able to interact with a video game in virtual reality (VR) via a head mounted display (HMD). A spectator is typically given a spectator view that is generated by introducing a camera within the environment of the game. The spectator may be able to navigate the environment of the video game via a controller to view the game action of the video game. For example, a spectator may choose to follow a certain player to view the performance of that player.

Current methods of spectating video games via HMD have certain drawbacks in terms of navigability, usability, comfort, and functionality. For example, currently it may be difficult for a spectator to navigate a game environment in a desired manner to view the various happenings that are of interest to the spectator. Additionally, current methods of spectating do not allow spectators to follow or catch-up to a target player in an effective and comfortable way.

It is in this context that embodiments arise.

SUMMARY

Embodiments of the present disclosure relate to improved methods and systems for enabling a spectator to follow a target player.

In one embodiment, a method is provided. The method includes an operation for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The method also includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. Further, the method includes an operation for moving the second vantage point toward the target object such that a virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside the portal. Moreover, the method includes an operation for wiping away the portal during at least a portion of said moving the second vantage point, said wiping away the portal includes expanding a size of the portal such that the second view replaces the first view in the interface.

In another embodiment, a method includes an operation for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The method also includes an operation for determining that the target object has moved beyond a first pre-defined threshold away from the first vantage point and executing a rubber-banding function, the rubber-banding function renders a band for display in the interface that connects the spectator to the target object. Additionally, the method includes an operation for determining that the target object has moved beyond a second pre-defined threshold away from the first vantage point and executing a catch-up function, the catch-up function includes. In various embodiments, the catch-up function includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. The catch-up function also includes an operation for moving the second vantage point toward the target object to a third vantage point such that the virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside of the portal.

In another embodiment, a non-transitory computer-readable storage medium storing a computer program executable by a processor-based system for transporting a spectator within an environment of a video game is provided. The non-transitory computer-readable storage medium includes program instructions for providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a target object. The non-transitory computer-readable storage medium also includes program instructions for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view. Additionally, the non-transitory computer-readable storage medium includes program instructions for moving the second vantage point toward the target object such that a virtual position of the spectator is brought closer to the target object within the portal, while the first view remains at the first vantage point outside the portal. Moreover, the non-transitory computer-readable storage medium includes program instructions for wiping away the portal during at least a portion of said moving the second vantage point, said wiping away the portal includes expanding a size of the portal such that the second view replaces the first view in the interface.

Other aspects of the disclosure will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure may best be understood by reference to the following description taken in conjunction with the accompanying drawings in which:

FIG. 1 A shows a conceptual diagram of a camera used to capture an overhead view shown in FIG. 1 B , according to one embodiment.

FIG. 1 B shows an illustration of an interface having an overhead view of an interactive environment of a video game generated by camera of FIG. 1 A , according to one embodiment.

FIGS. 2 A and 2 B show conceptual illustrations of a camera placement diagram and a resulting third-person view, respectively, according to one embodiment.

FIGS. 3 A and 3 B show an embodiment of a rubber-banding function that serves to assist the spectator in following the player, according to one embodiment.

FIGS. 4 A- 4 C show conceptual illustrations of the properties of the rubber-banding function that connects the spectator to a target player, according to one embodiment.

FIGS. 5 A- 5 C show conceptual illustrations of the properties of the rubber-banding function, according to another embodiment.

FIGS. 6 A and 6 B show a camera placement diagram and a resulting catch-up function, respectively, according to one embodiment.

FIGS. 7 A and 7 B show a camera placement diagram and a resulting view towards the tail-end of the catch-up function, respectively, according to one embodiment.

FIGS. 8 A- 8 H show a sequence of events occurring during a catch-up function, according to one embodiment.

FIGS. 9 A- 9 D show a timeline of events attendant to the catch-up function transporting the spectator, according to one embodiment.

FIGS. 10 A- 10 C illustrate a yaw-correction function that may be executed during execution of the catch-up function, according to various embodiments.

FIGS. 11 A- 11 C illustrate a yaw-correction function that may be executed during execution of the catch-up function when the target player makes a turn, according to various embodiments.

FIG. 12 shows a sequence of catch-up events for continually following a player, according to one embodiment.

FIG. 13 illustrates components of an example device that can be used to perform aspects of the various embodiments of the present disclosure, according to various embodiments.

DETAILED DESCRIPTION

Embodiments of the present disclosure relate to improved methods and systems for spectating video games. Some embodiments of the present disclosure relate to methods of providing seamless transitions between various third-person views of a player. Embodiments of the present disclosure also relate to methods for providing a catch-up function that enables a spectator to automatically follow a player of interest. In some embodiments, the methods can by implemented via one or more head mounted displays (HMDs). It will be obvious, however, to one skilled in the art, that the present disclosure may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order to not unnecessarily obscure the present disclosure.

Video game spectating is an important component in the video game ecosystem and provides users with an opportunity to derive entertainment from a video game without having to play it. Just as spectating a sports game, a race, or a concert is entertaining for spectators, the same is true of video games. A video game need not be played first-hand to be a source of entertainment, just as a bobsledding race need not be raced first-hand to be a source of entertainment. Video games, however, can offer a spectating experience that is more immersive, engaging, and customized than that of other activities. Because video game action takes place in a virtual interactive environment, virtual cameras that capture spectator views are not limited in the ways real-life cameras are when capturing real-life action. For example, real-life cameras for capturing real-life spectating activities are limited by the costs of camera equipment, camera operation and broadcast, as well the impracticability of placing cameras at various areas on interest.

Spectating video games are confined by none of these. For example, it is possible to introduce cameras at virtually any location within a virtual interactive environment and to move them in a desired way to provide immersive and user-controlled spectator views. For example, it is possible to obtain overhead or top-down views for spectating the overall happenings of a video game by placing a virtual camera at an elevated position above the virtual interactive environment. It is also possible to obtain third-person views and over-the-shoulder views that are relatively close to a selected player to see in greater detail that player&#39;s actions. Moreover, it is possible to enable a spectator to control a virtual camera used to generate a spectator view, such as to move a camera location or to pan the camera.

However, while a greater number of views are possible with video game spectating, current methods are lacking in the way they manage the greater number of views as well as how comfortable the spectating experience is within a virtual reality setting. For example, current methods do not provide ways to seamlessly transition between various viewpoints, such as between different third-person views having differing vantage points. Current methods transport a spectator within a virtual environment by providing translational movement to a virtual camera used to capture the spectator view. However, such movements can be disorienting and hard to follow, especially when the view is supplied to a VR view in an HMD. It has been observed that when spectators are moved translationally or rotationally within a VR scene without a sense of agency over the movement, disorientation may result.

Current methods also do not address a way to allow a spectator to automatically catch-up or follow a player of interest. For example, current methods either require a spectator to manually follow a player or provide fixed views that follow a player. The former method can become tiring and distracting for a spectator, especially during complex multiplayer games sessions of extended length. The latter method has been observed to cause disorientation because of the jerky nature of the fixed spectator view. The embodiments contemplated here address these and other shortcomings associated with current video game spectating technology.

Embodiments described here solve current problems related to spectator viewing technology in the computer-related arts by providing computer-implemented “follow assist” functions that enable a spectator to seamlessly follow a target player. The follow-assist functions include a rubber-banding function that enables the spectator to manually follow the target player as well as a catch-up function that automatically transports the spectator using portal-mediated transitions.

Portal-mediated transitions are contemplated to be used when a vantage point of a spectator is to be moved such that the spectator experiences translational and rotational movements via a portal rather than experiencing the translational and rotational movement in a full field of view. The portal-mediated transitions include providing a portal that initially appears larger in size and constricts to a smaller size to restrict the spectator&#39;s field of view. The spectator&#39;s vantage point is then provided with translational and rotational movement to a desired destination within the portal while the area outside of the portal remains relatively static. In this manner, the spectator is made to focus on the area within the HMD display where movement occurs while the spectator&#39;s peripheral vision is not stimulated by movement. Portal-mediated transitions have been observed to result in more comfortable virtual movements with less disorientation for HMD spectators.

FIG. 1 A shows a conceptual diagram of a camera 102 used to capture an overhead view 101 shown in FIG. 1 B , according to one embodiment. The camera 102 is placed at an elevated altitude in the z-axis to capture overall game action occurring in an interactive environment 100 of a video game. As such, the altitude, or z-coordinate, of the camera 102 used for capturing an overhead view will depend upon the video game and the size of the interactive environment 100 . For a smaller interactive environment 100 , the z-coordinate may be around 10 meters or less, while for a large interactive environment, the z-coordinate may be 100 meters or greater. The camera 102 is also angled at pitch 104 between 0° and −90° relative to the horizon 103 to capture the interactive environment 100 at a favorable angle. Additionally, because the overhead view is contemplated to be displayed as a VR scene within an HMD where the pitch 104 corresponds to spectator&#39;s real-world head pitch, the pitch 104 need not be vertical as to not strain the neck and head of the spectator.

FIG. 1 B shows an illustration of an interface 105 having an overhead view 101 of an interactive environment 100 of a video game generated by camera 102 of FIG. 1 A , according to one embodiment. The actions of a plurality of players 106 a - d are captured in overhead view 101 to provide an overview of the general happenings of the interactive environment 100 . For example, a spectator may choose to use the overhead view 101 to gain overall knowledge of the video game, such as where each of players 106 a - d are positioned and where they are moving, which of players 106 a - d are still active in the video game and which are eliminated, etc. However, the overhead view 101 may be less effective at conveying detailed game actions of the interactive environment 100 because the spectator is positioned relatively far away from individual players of the plurality of players 106 a - d.

The spectator may have a target player they want to spectate at a closer distance, for example player 106 b . Thus, they may choose to enter into a third-person view of player 106 b from the overhead view 101 . In some embodiments, the spectator may manually zoom into the overhead view 101 for the third-person view. In other embodiments, the spectator may use portal-mediated transitions to travel between the overhead view 101 and the third-person view as described. For example, the portal-mediated transitions may make use of a virtual magnifying glass that the spectator can enter into.

FIGS. 2 A and 2 B show conceptual illustrations of a camera placement diagram and a resulting third- person view 201 , respectively, according to one embodiment. In FIG. 2 A , the vantage point of camera 200 used to capture the third- person view 201 is shown to be placed in closer proximity to player 106 b than that of camera 100 . For example, camera 200 is less altitudinally elevated (e.g., lesser z-coordinate) from the plane of the interactive environment 100 camera 100 . As a result, the third- person view 201 offers a view that is more immersive and that appears “in” the video game. The camera 200 may be associated with a pitch 202 that is between about +45° to about −45°, or between about +30° to about −30° from the horizon 103 depending upon the z-coordinate of the camera 200 . The pitch 202 will also depend upon on a real-world pitch of the HMD of the user, according to some embodiments.

In various embodiments, the vantage point of camera 200 does not automatically follow the player 106 b . As a result, the vantage point of camera 200 is controlled by the spectator independently of the movements of player 106 b . Player 106 b is shown to be associated with boundary 204 that represents a predefined threshold within which the x- and y-coordinates of the camera 200 lie. For example, the boundary 204 is shown to be circular in shape with a radius 206 of a predefined length, while the distance 208 between the camera 200 and the player 106 b in a plane defined by the x- and y-axes is shown to be less than radius 206 . It is contemplated that when the distance 208 between camera 200 and player 106 b is less than the predefined threshold defined by radius 206 , the third-person view is not augmented with “follow assist” features as will be described with reference to FIGS. 3 A- 3 B and FIGS. 6 A- 6 B . The spectator may thus manually navigate the interactive environment 100 to follow the player 106 b.

FIG. 2 B shows an illustration of a third- person view 201 of player 106 b as captured by camera 200 , according to one embodiment. The third- person view 201 is roughly altitudinally level with the interactive environment 100 . For example, in the third- person view 201 shown, the spectator cannot necessarily see over the walls of the interactive environment 100 . However, in various embodiments, the spectator may be enabled to see through walls such that players that are on the other side of a wall are shown as if the wall is translucent. When the spectator fails to remain within boundary 204 , follow assist functions, such as a rubber-banding function or a catch-up function, will be executed to assist the spectator in following the player 106 b . The particular follow assist function that is triggered will depend upon the distance separating the spectator from the player 106 b.

FIGS. 3 A and 3 B show an embodiment of a follow-assist function that serves to assist the spectator in following the player 106 b once the player 106 b is beyond radius 206 away from the spectator. In particular, the follow-assist function shown in FIGS. 3 A and 3 B is the rubber-banding function which enables to spectator to discern an approximated path the spectator can take to catch up to the player 106 b . For example, the rubber-banding function provides a dynamic band that appears to connect the spectator to the player 106 b . In this fashion, the spectator may explore (e.g., look around) the interactive environment 100 without losing track of the position of player 106 b.

More particularly, FIG. 3 A shows that camera 200 is currently a distance 208 ′ away from the player 106 b . This may result from the player 106 b moving away from the spectator during the course of playing the video game or from the spectator moving away from the player 106 b , or both. In any case, distance 208 ′ is shown to be greater radius 206 . However, distance 208 ′ is shown to be less than radius 302 that defines a second circular boundary 300 . It is contemplated that when distance 208 ′ becomes greater than radius 206 but remains less than radius 302 (e.g., outside of boundary 204 but inside of boundary 300 ), the rubber-banding function is triggered. Once distance 208 ′ becomes greater than radius 302 , another follow-assist function called the catch-up function is activated or triggered. The catch-up function is described in greater detail with reference to FIGS. 6 A and 6 B .

FIG. 3 B shows an illustration of a third- person view 201 with the rubber-banding function activated, according to one embodiment. Within the third- person view 201 , a dynamic band 301 connects the spectator to the player 106 b . The band 301 has elastic properties and stretches depending on the distance 208 ′. In addition to stretching, the band 301 is shown to bend or curve in the direction of player 106 b . The direction the band 301 curves will depend upon where the player 106 b is relative to a forward direction 304 of the spectator. In some embodiments, the band 301 may emanate from a bottom-center region of the interface 105 , for example at or near where the feet or legs of the spectator would be. In this manner, the band 301 would be fully visible to the spectator without inhibiting the spectator&#39;s field of view. The band 301 is shown to terminate at player 106 b , and more specifically toward the lower extremities of player 106 b . Generally, the band 301 will emanate in the forward direction 304 initially for some distance before curving in the direction of the player 106 b . In various embodiments, the forward initial direction may be implemented even if the spectator is facing away from the player (e.g., the player 106 b is “behind” the spectator). In this instance, the band 301 will emanate in the forward direction 304 for a distance before curving to the left or right around the spectator to meet the player 106 b.

The band 301 may take on a variety of visual effects. For example, the band 301 may be translucent or opaque or highlighted. Further, the band 301 may be color-coded to match a color of the player 106 b . The band 301 may also project through walls, other players, and other in-game objects. Additionally, it is envisioned that the band 301 may be rendered to indicate that something interesting is happening at the target of the band 301 . For example, the band 301 may be made to change color, intensity, or shape if the target (e.g., player 106 b ) is under attack or low on health. In these and other embodiments, the band 301 could also indicate distance between the spectator and the player 106 b , for example, by a change in shape, intensity, or color. Further, it is contemplated that the rubber-banding function may selectively provide audio generated by the target that the spectator is connected to. For example, the spectator may be selectively communicated with audio generated by player 106 b , even when player 106 b travels far away from the spectator.

FIGS. 4 A- 4 C show conceptual illustrations of the properties of band 407 of a rubber-banding function that connects the spectator 400 to a target player 405 , according to one embodiment. In FIG. 4 A , the spectator 400 , and by extension the HMD 402 , is facing direction 404 to the north. The camera 401 will also have a direction 403 facing the north. Since the target player 405 is positioned directly north of the camera 401 , the band 407 appears straight. In FIG. 4 B , the spectator 400 has turned toward the left to face direction 404 ′ toward the northwest while the player 405 remains in the same location. Accordingly, camera 401 faces direction 403 ′ that is similar to direction 404 ′. The band 407 ′ is shown to shoot-out in direction 403 ′ before curving to the right to meet player 405 . In FIG. 4 C , the spectator 400 has turned further to face a southerly direction 404 ″ while the player 405 remains at the same location. Camera 401 likewise faces a southerly direction 403 ″. In this scenario, the player 405 is located “behind” the spectator 400 . To illustrate the position of the player 405 relative to the spectator 400 , the band 407 ″ emanates in the southerly direction 403 ″ before curving 180° back toward the player 405 .

FIGS. 5 A- 5 C show conceptual illustrations of the properties of band 503 of a rubber-banding function that connects the spectator 400 to a target player 405 , according to another embodiment. In FIG. 5 A , the spectator 400 faces a northerly direction 500 . The camera 401 similarly faces a northerly direction 501 . Since player 405 is not directly in front of spectator 400 , the band 503 curves in the north-easterly direction to connect with player 405 . When spectator 400 turns to face player 405 to face direction 500 ′, the player 405 then appears to be directly in front of spectator 405 . As a result, the band 503 ′ is displayed to be straight. When spectator 400 further turns the HMD 402 to the right to face the easterly direction 500 ″, the band 503 ″ emanates in the easterly direction before curving to the left to meet player 405 .

FIGS. 6 A and 6 B show a camera placement diagram and a resulting catch-up function, respectively, according to one embodiment. The catch-up function is triggered when the player 106 b moves a certain distance away from the spectator or vice versa. During activation of the rubber-banding function, the spectator is given an opportunity to manually catch up to the player 106 b as long as the distance between the spectator and the player 106 b is less than radius 302 . As such, the spectator may use the band of the rubber-banding function as a guide to navigate the interactive environment 100 to catch up to the player 106 b . There are instances in which the distance between the spectator and the <figure-callout id="106b" label="player" filenames="US11865447-20240109-D00000.png,US11865447-20240109-D00001.png" sta

CLAIMS

Claims ( 8 )

What is claimed is:

1. A method of moving a view of a spectator within an environment of a video game, comprising:

generating an interface for presenting a view of the video game to the spectator of the video game, the view having a first vantage point and includes a game object;

providing a portal within the interface for presenting a second vantage point of the game object, the portal is overlaid to cover a portion of the view;

moving the second vantage point closer toward the game object such that the view is brought closer to the game object within the portal, while the view remains at the first vantage point outside the portal;

removing the portal during at least a portion of said moving the second vantage point; and

providing a new portal within the interface when the game object moves a predetermined distance away from a virtual position of the spectator.

2. The method of claim 1 , wherein removing the portal includes expanding a size of the portal.

3. A method of moving a view provided to a spectator within an environment of a video game, comprising:

providing an interface for presenting a first view of the video game on a client device of the spectator of the video game, the first view having a first vantage point and includes a game object;

providing a portal within the interface for presenting a second view of the game object, the second view having a second vantage point, the portal is overlaid to cover a portion of the first view; and

moving the second vantage point toward the game object to a third vantage point such that a virtual position of the spectator is brought closer to the game object within the portal, while the first view remains at the first vantage point outside the portal;

wherein the portal provides a pulling function for pulling the virtual position of the spectator as the game object moves.

4. The method of claim 3 , further comprising,

removing the portal during at least a portion of said moving the second vantage point, said moving of the portal includes expanding a size of the portal such that the second view replaces the first view in the interface.

5. The method of claim 4 , wherein during the pulling one or more additional portals are created, each of the one or more additional portals is triggered when the game object moves a predetermined distance away from the virtual position of the spectator.

6. Computer readable media having non-transitory program instructions for moving a view of a spectator within an environment of a video game, comprising:

program instructions for generating an interface for presenting a view of the video game to the spectator of the video game, the view having a first vantage point and includes a game object;

program instructions for providing a portal within the interface for presenting a second vantage point of the game object, the portal is overlaid to cover a portion of the view;

program instructions for moving the second vantage point closer toward the game object such that the view is brought closer to the game object within the portal, while the view remains at the first vantage point outside the portal;

program instructions for removing the portal during at least a portion of said moving the second vantage point; and

program instructions for providing one or more additional portals when the game object moves a predetermined distance away from a virtual position of the spectator.

7. The computer readable media of claim 6 , wherein removing the portal includes expanding a size of the portal.

8. The computer readable media of claim 7 , wherein when the game object moves away from a virtual position of the spectator, a series of one or more additional portals are created to repeatedly bring the virtual position of the spectator closer to the game object.

US17/177,157

2019-03-15

2021-02-16

Methods and systems for spectating characters in follow-mode for virtual reality views

Active

2040-03-14

US11865447B2

( en )

Priority Applications (1)

Application Number

Priority Date

Filing Date

Title

US17/177,157

US11865447B2

( en )

2019-03-15

2021-02-16

Methods and systems for spectating characters in follow-mode for virtual reality views

Applications Claiming Priority (2)

Application Number

Priority Date

Filing Date

Title

US16/355,668

US10918945B2

( en )

2019-03-15

2019-03-15

Methods and systems for spectating characters in follow-mode for virtual reality views

US17/177,157

US11865447B2

( en )

2019-03-15

2021-02-16

Methods and systems for spectating characters in follow-mode for virtual reality views

Related Parent Applications (1)

Application Number

Title

Priority Date

Filing Date

US16/355,668

Continuation

US10918945B2

( en )

2019-03-15

2019-03-15

Methods and systems for spectating characters in follow-mode for virtual reality views

Publications (2)

Publication Number

Publication Date

US20210178264A1

US20210178264A1 ( en )

2021-06-17

US11865447B2

true

US11865447B2 ( en )

2024-01-09

Family

ID=69771105

Family Applications (2)

Application Number

Title

Priority Date

Filing Date

US16/355,668

Active

US10918945B2

( en )

2019-03-15

2019-03-15

Methods and systems for spectating characters in follow-mode for virtual reality views

US17/177,157

Active

2040-03-14

US11865447B2

( en )

2019-03-15

2021-02-16

Methods and systems for spectating characters in follow-mode for virtual reality views

Family Applications Before (1)

Application Number

Title

Priority Date

Filing Date

US16/355,668

Active

US10918945B2

( en )

2019-03-15

2019-03-15

Methods and systems for spectating characters in follow-mode for virtual reality views

Country Status (2)

Country

Link

US

( 2 )

US10918945B2

( en )

WO

( 1 )

WO2020190399A1

( en )

Cited By (1)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20220258046A1

( en )

*

2021-02-15

2022-08-18

Nintendo Co., Ltd.

Storage medium, information processing system, information processing apparatus and information processing method

Families Citing this family (18)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

EP3345184A1

( en )

2015-09-02

2018-07-11

THOMSON Licensing

Method, apparatus and system for facilitating navigation in an extended scene

US11269580B2

( en )

*

2017-02-13

2022-03-08

Comcast Cable Communications, Llc

Guided collaborative viewing of navigable image content

JP6776400B1

( en )

*

2019-04-26

2020-10-28

株式会社コロプラ

Programs, methods, and information terminals

US11023729B1

( en )

*

2019-11-08

2021-06-01

Msg Entertainment Group, Llc

Providing visual guidance for presenting visual content in a venue

JP7101735B2

( en )

*

2020-10-20

2022-07-15

株式会社スクウェア・エニックス

Image generation program and image generation system

JP6928709B1

( en )

*

2020-12-28

2021-09-01

プラチナゲームズ株式会社

Information processing programs, information processing devices, and information processing methods

US11907415B2

( en )

*

2022-02-25

2024-02-20

Htc Corporation

Method, electronic device, and non-transitory computer readable storage medium for interacting with virtual reality environment

US12609990B2

( en )

*

2022-02-28

2026-04-21

CEO Vision, Inc

Systems and methods for providing secure portals between virtual worlds

US20250196003A1

( en )

*

2022-03-29

2025-06-19

Sony Interactive Entertainment Inc.

Image generating apparatus, image generating method, and program

WO2023188020A1

( en )

*

2022-03-29

2023-10-05

株式会社ソニー・インタラクティブエンタテインメント

Image generation device, image reproduction device, image generation method, and program

US12086301B2

( en )

2022-06-01

2024-09-10

Sphere Entertainment Group, Llc

System for multi-user collaboration within a virtual reality environment

US12449891B2

( en )

2022-08-31

2025-10-21

Snap Inc.

Timelapse re-experiencing system

US12417593B2

( en )

2022-08-31

2025-09-16

Snap Inc.

Generating immersive augmented reality experiences from existing images and videos

US12322052B2

( en )

2022-08-31

2025-06-03

Snap Inc.

Mixing and matching volumetric contents for new augmented reality experiences

US12519924B2

( en )

*

2022-08-31

2026-01-06

Snap Inc.

Multi-perspective augmented reality experience

US12267482B2

( en )

2022-08-31

2025-04-01

Snap Inc.

Controlling and editing presentation of volumetric content

US12282604B2

( en )

2022-08-31

2025-04-22

Snap Inc.

Touch-based augmented reality experience

US12051170B2

( en )

*

2022-09-23

2024-07-30

Apple Inc.

Visual techniques for 3D content

Citations (17)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US6304267B1

( en )

*

1997-06-13

2001-10-16

Namco Ltd.

Image generating system and information storage medium capable of changing angle of view of virtual camera based on object positional information

US20030210329A1

( en )

*

2001-11-08

2003-11-13

Aagaard Kenneth Joseph

Video system and methods for operating a video system

US20060146132A1

( en )

*

2005-01-05

2006-07-06

Hy Mayerson

Video system having multiple video cameras for capturing events

US20070188501A1

( en )

*

2006-01-30

2007-08-16

Yee Yangli H

Graphical computer simulation system and method

US20070279494A1

( en )

*

2004-04-16

2007-12-06

Aman James A

Automatic Event Videoing, Tracking And Content Generation

US20080079754A1

( en )

*

2006-07-27

2008-04-03

Yoshihiko Kuroki

Content Providing Method, a Program of Content Providing Method, a Recording Medium on Which a Program of a Content Providing Method is Recorded, and a Content Providing Apparatus

US20090290848A1

( en )

*

2007-01-11

2009-11-26

Michael James Brown

Method and System for Generating a Replay Video

US20100151943A1

( en )

*

2006-11-09

2010-06-17

Kevin Johnson

Wagering game with 3d gaming environment using dynamic camera

US20140184801A1

( en )

*

2013-01-02

2014-07-03

Samsung Electronics Co., Ltd.

Wearable video device and video system including the same

US20150352437A1

( en )

*

2014-06-09

2015-12-10

Bandai Namco Games Inc.

Display control method for head mounted display (hmd) and image generation device

US9327191B2

( en )

*

2006-05-08

2016-05-03

Nintendo Co., Ltd.

Method and apparatus for enhanced virtual camera control within 3D video games or other computer graphics presentations providing intelligent automatic 3D-assist for third person viewpoints

US20160320951A1

( en )

*

2015-04-30

2016-11-03

Pixia Corp.

Systems and methods of selecting a view from a plurality of cameras

US20170001118A1

( en )

*

2014-10-10

2017-01-05

Livebarn Inc.

System and method for optical player tracking in sports venues

US20170099441A1

( en )

*

2015-10-05

2017-04-06

Woncheol Choi

Virtual flying camera system

US20170269685A1

( en )

*

2016-03-17

2017-09-21

Sony Interactive Entertainment Inc.

Spectating Virtual (VR) Environments Associated With VR User Interactivity

US20180359427A1

( en )

*

2015-10-05

2018-12-13

Woncheol Choi

Virtual flying camera system

US20200145623A1

( en )

*

2018-11-07

2020-05-07

Avigilon Corporation

Method and System for Initiating a Video Stream

Family Cites Families (2)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US10376795B2

( en )

2015-06-30

2019-08-13

Amazon Technologies, Inc.

Game effects from spectating community inputs

US11284955B2

( en )

2017-06-29

2022-03-29

Verb Surgical Inc.

Emulation of robotic arms and control thereof in a virtual reality environment

2019

2019-03-15

US

US16/355,668

patent/US10918945B2/en

active

Active

2020

2020-02-04

WO

PCT/US2020/016666

patent/WO2020190399A1/en

not_active

Ceased

2021

2021-02-16

US

US17/177,157

patent/US11865447B2/en

active

Active

Patent Citations (17)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US6304267B1

( en )

*

1997-06-13

2001-10-16

Namco Ltd.

Image generating system and information storage medium capable of changing angle of view of virtual camera based on object positional information

US20030210329A1

( en )

*

2001-11-08

2003-11-13

Aagaard Kenneth Joseph

Video system and methods for operating a video system

US20070279494A1

( en )

*

2004-04-16

2007-12-06

Aman James A

Automatic Event Videoing, Tracking And Content Generation

US20060146132A1

( en )

*

2005-01-05

2006-07-06

Hy Mayerson

Video system having multiple video cameras for capturing events

US20070188501A1

( en )

*

2006-01-30

2007-08-16

Yee Yangli H

Graphical computer simulation system and method

US9327191B2

( en )

*

2006-05-08

2016-05-03

Nintendo Co., Ltd.

Method and apparatus for enhanced virtual camera control within 3D video games or other computer graphics presentations providing intelligent automatic 3D-assist for third person viewpoints

US20080079754A1

( en )

*

2006-07-27

2008-04-03

Yoshihiko Kuroki

Content Providing Method, a Program of Content Providing Method, a Recording Medium on Which a Program of a Content Providing Method is Recorded, and a Content Providing Apparatus

US20100151943A1

( en )

*

2006-11-09

2010-06-17

Kevin Johnson

Wagering game with 3d gaming environment using dynamic camera

US20090290848A1

( en )

*

2007-01-11

2009-11-26

Michael James Brown

Method and System for Generating a Replay Video

US20140184801A1

( en )

*

2013-01-02

2014-07-03

Samsung Electronics Co., Ltd.

Wearable video device and video system including the same

US20150352437A1

( en )

*

2014-06-09

2015-12-10

Bandai Namco Games Inc.

Display control method for head mounted display (hmd) and image generation device

US20170001118A1

( en )

*

2014-10-10

2017-01-05

Livebarn Inc.

System and method for optical player tracking in sports venues

US20160320951A1

( en )

*

2015-04-30

2016-11-03

Pixia Corp.

Systems and methods of selecting a view from a plurality of cameras

US20170099441A1

( en )

*

2015-10-05

2017-04-06

Woncheol Choi

Virtual flying camera system

US20180359427A1

( en )

*

2015-10-05

2018-12-13

Woncheol Choi

Virtual flying camera system

US20170269685A1

( en )

*

2016-03-17

2017-09-21

Sony Interactive Entertainment Inc.

Spectating Virtual (VR) Environments Associated With VR User Interactivity

US20200145623A1

( en )

*

2018-11-07

2020-05-07

Avigilon Corporation

Method and System for Initiating a Video Stream

Cited By (3)

* Cited by examiner, † Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20220258046A1

( en )

*

2021-02-15

2022-08-18

Nintendo Co., Ltd.

Storage medium, information processing system, information processing apparatus and information processing method

US12053698B2

( en )

*

2021-02-15

2024-08-06

Nintendo Co., Ltd.

Storage medium, information processing system, information processing apparatus and information processing method

US12370446B2

( en )

2021-02-15

2025-07-29

Nintendo Co., Ltd.

Storage medium, information processing system, information processing apparatus and information processing method

Also Published As

Publication number

Publication date

US10918945B2

( en )

2021-02-16

US20210178264A1

( en )

2021-06-17

US20200289935A1

( en )

2020-09-17

WO2020190399A1

( en )

2020-09-24

Similar Documents

Publication

Publication Date

Title

US10918945B2

( en )

2021-02-16

Methods and systems for spectating characters in follow-mode for virtual reality views

US12023579B2

( en )

2024-07-02

Methods and systems for spectating characters in virtual reality views

US12134037B2

( en )

2024-11-05

Method and system for directing user attention to a location based game play companion application

JP7531568B2

( en )

2024-08-09

Eye tracking with prediction and latest updates to the GPU for fast foveated rendering in HMD environments

US11662813B2

( en )

2023-05-30

Spectating virtual (VR) environments associated with VR user interactivity

US10740951B2

( en )

2020-08-11

Foveal adaptation of particles and simulation models in a foveated rendering system

US11037371B2

( en )

2021-06-15

Sensory stimulus management in head mounted display

US10401960B2

( en )

2019-09-03

Methods and systems for gaze-based control of virtual reality media content

JP7503122B2

( en )

2024-06-19

Method and system for directing user attention to a location-based gameplay companion application - Patents.com

US11128984B1

( en )

2021-09-21

Content presentation and layering across multiple devices

JP2019516159A

( en )

2019-06-13

Spectator view viewpoint in VR environment

JP2019511781A

( en )

2019-04-25

Audience View Tracking of VR Users in a Virtual Reality (VR) Environment

US11107183B2

( en )

2021-08-31

Adaptive mesh skinning in a foveated rendering system

JP2020520190A

( en )

2020-07-02

Video playback and data provision associated with virtual scenes

JP7349256B2

( en )

2023-09-22

Image generation device and information presentation method

CN114269442A

( en )

2022-04-01

How to adjust the camera view in video games

CN121693374A

( en )

2026-03-17

System and method for generating non-player characters based on game play characteristics

Legal Events

Date

Code

Title

Description

2021-02-16

FEPP

Fee payment procedure

Free format text : ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

2021-03-08

STPP

Information on status: patent application and granting procedure in general

Free format text : APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

2021-08-22

STPP

Information on status: patent application and granting procedure in general

Free format text : DOCKETED NEW CASE - READY FOR EXAMINATION

2023-04-25

STPP

Information on status: patent application and granting procedure in general

Free format text : NON FINAL ACTION MAILED

2023-08-29

STPP

Information on status: patent application and granting procedure in general

Free format text : RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

2023-09-05

STPP

Information on status: patent application and granting procedure in general

Free format text : NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

2023-12-05

STPP

Information on status: patent application and granting procedure in general

Free format text : PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

2023-12-13

STPP

Information on status: patent application and granting procedure in general

Free format text : PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

2023-12-20

STCF

Information on status: patent grant

Free format text : PATENTED CASE

Related documents

Record · ID 607619
Conceptio Open Knowledge Archive — every document is proof-bundled with source, license, and retrieval metadata.