ABSTRACT
Abstract
A method comprises displaying in virtual reality a computer-generated scene; obtaining a movement command from a real-world physical movement of a user, the movement command corresponding to a movement of a virtual body; and adjusting the movement of the virtual body in dependence on an effect of gravity in the computer-generated scene and/or in dependence on the presence of at least one object within the computer-generated scene that inhibits the movement of the virtual body, wherein the adjusting of the movement is such that the adjusted movement of the virtual body does not correspond with the real-world physical movement of the user.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 17/357,293, filed Jun. 24, 2021, entitled Virtual Reality System Obtaining Movement Command from Real-World Physical User, which is a continuation of U.S. patent application Ser. No. 15/784,718, filed Oct. 16, 2017, entitled: Virtual Reality System Obtaining Movement Command from Real-World Physical User, which claims the benefit of UK Patent Application No. 1617446.8 filed Oct. 14, 2016 and U.S. Provisional Patent Application No. 62/410,107, filed Oct. 19, 2016, all of which are entirely incorporated herein by reference.
FIELD
The present invention relates to virtual reality, for example to a system and method for viewing architectural structures in virtual reality.
BACKGROUND
Virtual reality may refer to a method of displaying a computer-generated three-dimensional environment such that a user perceives that they are interacting with that environment, for example walking through the environment. In some known virtual reality systems, a user wears a virtual reality headset (which may be called a head-mounted display). The virtual reality headset presents images on screens in front of the user's eyes. The images may create an impression of an immersive three-dimensional environment.
The user may interact with the computer-generated environment by, for example, moving his or her head, hands, or other body parts; or providing input via a hand-held device such as a games controller, wand, keyboard, or mouse.
The computer-generated environment may be representative of a real environment. For example, the computer-generated environment may be representative of a real building, street or natural environment.
In some circumstances, virtual reality may be used for architectural visualisation. The computer-generated environment may be representative of a structure (for example a building) that has not yet been constructed, or a structure that is being modified. A user may view a computer-generated image of the structure as if positioned inside the structure, for example as if moving from room to room within the structure or looking around a room of the structure.
SUMMARY
In a first aspect of the invention, there is provided a method comprising displaying in virtual reality a computer-generated scene representative of a structure; receiving a user input representative of a variation of a time or weather parameter; and updating the computer-generated scene in dependence on the variation of the time or weather parameter, thereby enabling the user to vary on command an appearance of at least part of the structure in the computer-generated scene to represent a change in time and/or weather conditions.
The computer-generated scene may be updated to show a different time, or different weather, from that initially represented in the computer-generated scene. Using the method, a user may view how a structure, for example a building, may look at different times or in different weathers. The user may comment on features of the structure and/or make changes in the structure. For example, the user may be an architectural client. By seeing a virtual representation of the structure as if viewed at different times and/or in different weather conditions, the user may approve or disapprove features of the structure, or suggest changes to the structure.
The updating of the computer-generated scene may comprise live updating of the computer-generated scene while the computer-generated scene is viewed in virtual reality by the user.
The user may vary time or weather while viewing the computer-generated scene. The variation of time or weather may be made in combination with other changes. For example, the user may vary the time or weather while moving around the computer-generated scene. The user may vary the time or weather while also varying a viewing position from which the user is viewing the computer-generated scene.
The user input representative of the variation of the time or weather parameter may be provided by the user via a handheld input device. The handheld input device may comprise at least one of a games controller, a wand.
The user input representative of the variation in the time or weather parameter may be provided by operating a user input tool. The user input tool may comprise a button, and the user input may comprise holding down the button. The user input tool may comprise a slider, and the user input may comprise sliding the slider. The user input tool may comprise a pressure-sensitive device, and the user input may comprise pressing the pressure-sensitive device. The user input tool may be real or virtual.
The user input representative of the variation in the time or weather parameter may be provided via the handheld input device by holding down a button on the handheld input device.
The handheld input device may provide a simple input mechanism that may be easy for the user to control. The handheld input device may be easy to control even when the user is simultaneously performing other actions, for example walking around the computer-generated scene. For example, the user may not have to select or type numerals in order to input a time. The handheld input device may be familiar and/or intuitive to the user.
The variation in the time or weather parameter may comprise an increment in time. The method may further comprise determining the increment in time in dependence on a length of time for which a or the user input tool is operated. The method may comprise determining the increment in time in dependence on a length of time for which a or the button is held down by the user.
The user may change time by using a single button control. Control via a single button may be simple for the user.
The computer-generated scene may be updated to represent a changed time without representing intermediate times between an initial time and the changed time. Updating without representing intermediate times may be fast and may provide the user with the information they have requested without providing other times which may be irrelevant to the user.
The computer-generated scene may be updated to represent intermediate times between an initial time and the changed time. Representing intermediate times may give the user an impression of time progressing. Representing intermediate times may provide a change that appears to be continuous. Representing intermediate times may provide a presentation that resembles a time-lapse video showing changes over time (for example, the effect of a succession of different sun positions).
The variation of the time or weather parameter comprises a variation in at least one of a time of day, a time of year, a type of weather.
The user may view the structure as if viewed at different times of day, at different times of year, and/or in different types of weather.
The method may comprise determining a sun position in dependence on a time of day and on a geographical location. The displaying and/or updating of the computer-generated scene may comprise generating the scene using the determined sun position.
The determining of the sun position may be further in dependence on a or the time of year.
The appearance of the structure at different sun positions may be particularly important to the user. For example, the user may be an architectural client. The user may want to see how much light is available in a particular room of the structure at a particular time of day, for example to see whether the lighting is inadequate or whether the lighting is excessive (for example, causing glare).
The at least one weather parameter may be determined based on at least one of the time of day, the time of year.
The variation of the weather parameter may comprise a variation of at least one of an extent of cloud coverage, a type of precipitation, a rate of precipitation, an amount of fog, an amount of smog.
The computer-generated scene may be representative of an interior of the structure. The variation of the time or weather parameter may comprise a variation of a sun position and/or type of weather visible from the interior of the structure via at least one door or window.
The method may further comprise displaying with the computer-generated scene a time display. The method may further comprise displaying with the computer-generated scene a calendar display. The method may further comprise displaying with the computer-generated scene a map display. The method may further comprise displaying with the computer-generated scene a weather display.
A time or calendar display may indicate to the user a time of day or year that is currently represented in the computer-generated scene. A map display may indicate to the user a geographical location of the structure and/or of the user. The weather display may indicate to the user a type of weather that is currently represented in the computer-generated scene.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: display in virtual reality on the at least one display screen a computer-generated scene representative of a structure; receive from the at least one user input device a user input representative of a variation of a time or weather parameter; and update the computer-generated scene in dependence on the variation of the time or weather parameter, thereby enabling the user to vary on command an appearance of at least part of the structure in the computer-generated scene to represent a change in time and/or weather conditions.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: receiving photographic data representative of a geographical area, wherein a second part of the geographical area is further from a structure of interest than a first part of the geographical area; processing the photographic data to obtain a three-dimensional representation of the first part of the geographical area and a two-dimensional representation of the second part of the geographical area; and displaying in virtual reality a computer-generated scene representative of the structure of interest, wherein the computer-generated scene comprises the three-dimensional representation of the first part of the geographical area and the two-dimensional representation of the second part of the geographical area.
The three-dimensional representation and two-dimensional representation may be obtained by processing the same photographic data.
The first part of the geographical area may comprise or be adjacent to the structure of interest.
By using photographic data, a realistic representation of the geographical area may be obtained. For example, the photographic data may comprise a plurality of realistic images.
The three-dimensional representation and two-dimensional representation may be obtained from the same photographic data or from closely matching photographic data, for example photographic data that is matched in time of day and/or camera settings. The three-dimensional representation and two-dimensional representation may be a close visual match to each other. Structures, for example buildings, in the three- and two-dimensional representations may have similar appearance in the computer-generated scene. For example, the three-dimensional and two-dimensional representations may have similar tone, lighting, resolution, hue, brightness, colour parameters, or other image qualities.
By using a two-dimensional representation of a part of the geographical area that is further from the structure of interest, in some circumstances better performance may be achieved than may be obtained if a three-dimensional representation of the whole of the geographic region were to be used. For example, an amount of processing power used may be reduced and/or a speed of image generation may be increased.
By using a combination of a three-dimensional representation for a part of the geographical area that is nearer to the structure of interest, a better representation of structures near to the structure of interest may be obtained than if a two-dimensional representation were to be used. For example, a position of nearby structures may be represented in an accurate manner.
The photographic data may comprise at least one of aerial data, drone data.
Aerial data (which may for example be drone data) may be used to create a representative view outside the structure of interest, for example a representative view outside a building. The use of drone data may allow up-to-date photographic data to be acquired at a moderate cost. For example, if the structure of interest is a building that has not yet been built or that is to be modified, photographic data of a geographical area around a site or proposed site of the building may be obtained specifically for the purpose of displaying the building in virtual reality. Alternatively aerial data may be used that has previously been acquired for another purpose, for example data that has been acquired for mapping, planning or surveying.
The two-dimensional representation of the second part of the geographical area may comprise at least one static two-dimensional image of the second part of the geographical area.
The computer-generated scene may be displayed as if viewed from a viewpoint within or near the structure of interest. The or each static two-dimensional image may be a two-dimensional image of at least part of the second part of the geographical area as viewed from a viewing position within or near the structure of interest, which may or may not be the same viewing position from which the computer-generated scene is displayed. In some circumstances, displaying the computer-generated scene from a different viewing position than the viewing position from which the static two-dimensional image or images are viewed may not cause significant inaccuracy in the view presented. The second part of the geographical area may be considered to include structures that are in the far distance. A small difference in viewing position may not make much difference to the positions of structures in the far distance as viewed from the structure
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 17/357,293, filed Jun. 24, 2021, entitled Virtual Reality System Obtaining Movement Command from Real-World Physical User, which is a continuation of U.S. patent application Ser. No. 15/784,718, filed Oct. 16, 2017, entitled: Virtual Reality System Obtaining Movement Command from Real-World Physical User, which claims the benefit of UK Patent Application No. 1617446.8 filed Oct. 14, 2016 and U.S. Provisional Patent Application No. 62/410,107, filed Oct. 19, 2016, all of which are entirely incorporated herein by reference.
FIELD
The present invention relates to virtual reality, for example to a system and method for viewing architectural structures in virtual reality.
BACKGROUND
Virtual reality may refer to a method of displaying a computer-generated three-dimensional environment such that a user perceives that they are interacting with that environment, for example walking through the environment. In some known virtual reality systems, a user wears a virtual reality headset (which may be called a head-mounted display). The virtual reality headset presents images on screens in front of the user's eyes. The images may create an impression of an immersive three-dimensional environment.
The user may interact with the computer-generated environment by, for example, moving his or her head, hands, or other body parts; or providing input via a hand-held device such as a games controller, wand, keyboard, or mouse.
The computer-generated environment may be representative of a real environment. For example, the computer-generated environment may be representative of a real building, street or natural environment.
In some circumstances, virtual reality may be used for architectural visualisation. The computer-generated environment may be representative of a structure (for example a building) that has not yet been constructed, or a structure that is being modified. A user may view a computer-generated image of the structure as if positioned inside the structure, for example as if moving from room to room within the structure or looking around a room of the structure.
SUMMARY
In a first aspect of the invention, there is provided a method comprising displaying in virtual reality a computer-generated scene representative of a structure; receiving a user input representative of a variation of a time or weather parameter; and updating the computer-generated scene in dependence on the variation of the time or weather parameter, thereby enabling the user to vary on command an appearance of at least part of the structure in the computer-generated scene to represent a change in time and/or weather conditions.
The computer-generated scene may be updated to show a different time, or different weather, from that initially represented in the computer-generated scene. Using the method, a user may view how a structure, for example a building, may look at different times or in different weathers. The user may comment on features of the structure and/or make changes in the structure. For example, the user may be an architectural client. By seeing a virtual representation of the structure as if viewed at different times and/or in different weather conditions, the user may approve or disapprove features of the structure, or suggest changes to the structure.
The updating of the computer-generated scene may comprise live updating of the computer-generated scene while the computer-generated scene is viewed in virtual reality by the user.
The user may vary time or weather while viewing the computer-generated scene. The variation of time or weather may be made in combination with other changes. For example, the user may vary the time or weather while moving around the computer-generated scene. The user may vary the time or weather while also varying a viewing position from which the user is viewing the computer-generated scene.
The user input representative of the variation of the time or weather parameter may be provided by the user via a handheld input device. The handheld input device may comprise at least one of a games controller, a wand.
The user input representative of the variation in the time or weather parameter may be provided by operating a user input tool. The user input tool may comprise a button, and the user input may comprise holding down the button. The user input tool may comprise a slider, and the user input may comprise sliding the slider. The user input tool may comprise a pressure-sensitive device, and the user input may comprise pressing the pressure-sensitive device. The user input tool may be real or virtual.
The user input representative of the variation in the time or weather parameter may be provided via the handheld input device by holding down a button on the handheld input device.
The handheld input device may provide a simple input mechanism that may be easy for the user to control. The handheld input device may be easy to control even when the user is simultaneously performing other actions, for example walking around the computer-generated scene. For example, the user may not have to select or type numerals in order to input a time. The handheld input device may be familiar and/or intuitive to the user.
The variation in the time or weather parameter may comprise an increment in time. The method may further comprise determining the increment in time in dependence on a length of time for which a or the user input tool is operated. The method may comprise determining the increment in time in dependence on a length of time for which a or the button is held down by the user.
The user may change time by using a single button control. Control via a single button may be simple for the user.
The computer-generated scene may be updated to represent a changed time without representing intermediate times between an initial time and the changed time. Updating without representing intermediate times may be fast and may provide the user with the information they have requested without providing other times which may be irrelevant to the user.
The computer-generated scene may be updated to represent intermediate times between an initial time and the changed time. Representing intermediate times may give the user an impression of time progressing. Representing intermediate times may provide a change that appears to be continuous. Representing intermediate times may provide a presentation that resembles a time-lapse video showing changes over time (for example, the effect of a succession of different sun positions).
The variation of the time or weather parameter comprises a variation in at least one of a time of day, a time of year, a type of weather.
The user may view the structure as if viewed at different times of day, at different times of year, and/or in different types of weather.
The method may comprise determining a sun position in dependence on a time of day and on a geographical location. The displaying and/or updating of the computer-generated scene may comprise generating the scene using the determined sun position.
The determining of the sun position may be further in dependence on a or the time of year.
The appearance of the structure at different sun positions may be particularly important to the user. For example, the user may be an architectural client. The user may want to see how much light is available in a particular room of the structure at a particular time of day, for example to see whether the lighting is inadequate or whether the lighting is excessive (for example, causing glare).
The at least one weather parameter may be determined based on at least one of the time of day, the time of year.
The variation of the weather parameter may comprise a variation of at least one of an extent of cloud coverage, a type of precipitation, a rate of precipitation, an amount of fog, an amount of smog.
The computer-generated scene may be representative of an interior of the structure. The variation of the time or weather parameter may comprise a variation of a sun position and/or type of weather visible from the interior of the structure via at least one door or window.
The method may further comprise displaying with the computer-generated scene a time display. The method may further comprise displaying with the computer-generated scene a calendar display. The method may further comprise displaying with the computer-generated scene a map display. The method may further comprise displaying with the computer-generated scene a weather display.
A time or calendar display may indicate to the user a time of day or year that is currently represented in the computer-generated scene. A map display may indicate to the user a geographical location of the structure and/or of the user. The weather display may indicate to the user a type of weather that is currently represented in the computer-generated scene.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: display in virtual reality on the at least one display screen a computer-generated scene representative of a structure; receive from the at least one user input device a user input representative of a variation of a time or weather parameter; and update the computer-generated scene in dependence on the variation of the time or weather parameter, thereby enabling the user to vary on command an appearance of at least part of the structure in the computer-generated scene to represent a change in time and/or weather conditions.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: receiving photographic data representative of a geographical area, wherein a second part of the geographical area is further from a structure of interest than a first part of the geographical area; processing the photographic data to obtain a three-dimensional representation of the first part of the geographical area and a two-dimensional representation of the second part of the geographical area; and displaying in virtual reality a computer-generated scene representative of the structure of interest, wherein the computer-generated scene comprises the three-dimensional representation of the first part of the geographical area and the two-dimensional representation of the second part of the geographical area.
The three-dimensional representation and two-dimensional representation may be obtained by processing the same photographic data.
The first part of the geographical area may comprise or be adjacent to the structure of interest.
By using photographic data, a realistic representation of the geographical area may be obtained. For example, the photographic data may comprise a plurality of realistic images.
The three-dimensional representation and two-dimensional representation may be obtained from the same photographic data or from closely matching photographic data, for example photographic data that is matched in time of day and/or camera settings. The three-dimensional representation and two-dimensional representation may be a close visual match to each other. Structures, for example buildings, in the three- and two-dimensional representations may have similar appearance in the computer-generated scene. For example, the three-dimensional and two-dimensional representations may have similar tone, lighting, resolution, hue, brightness, colour parameters, or other image qualities.
By using a two-dimensional representation of a part of the geographical area that is further from the structure of interest, in some circumstances better performance may be achieved than may be obtained if a three-dimensional representation of the whole of the geographic region were to be used. For example, an amount of processing power used may be reduced and/or a speed of image generation may be increased.
By using a combination of a three-dimensional representation for a part of the geographical area that is nearer to the structure of interest, a better representation of structures near to the structure of interest may be obtained than if a two-dimensional representation were to be used. For example, a position of nearby structures may be represented in an accurate manner.
The photographic data may comprise at least one of aerial data, drone data.
Aerial data (which may for example be drone data) may be used to create a representative view outside the structure of interest, for example a representative view outside a building. The use of drone data may allow up-to-date photographic data to be acquired at a moderate cost. For example, if the structure of interest is a building that has not yet been built or that is to be modified, photographic data of a geographical area around a site or proposed site of the building may be obtained specifically for the purpose of displaying the building in virtual reality. Alternatively aerial data may be used that has previously been acquired for another purpose, for example data that has been acquired for mapping, planning or surveying.
The two-dimensional representation of the second part of the geographical area may comprise at least one static two-dimensional image of the second part of the geographical area.
The computer-generated scene may be displayed as if viewed from a viewpoint within or near the structure of interest. The or each static two-dimensional image may be a two-dimensional image of at least part of the second part of the geographical area as viewed from a viewing position within or near the structure of interest, which may or may not be the same viewing position from which the computer-generated scene is displayed. In some circumstances, displaying the computer-generated scene from a different viewing position than the viewing position from which the static two-dimensional image or images are viewed may not cause significant inaccuracy in the view presented. The second part of the geographical area may be considered to include structures that are in the far distance. A small difference in viewing position may not make much difference to the positions of structures in the far distance as viewed from the structure of interest.
The two-dimensional representation of the second part of the geographical area may comprise a single panoramic image.
The single panoramic image may be easily stored and/or easily used. The single panoramic image may provide a convenient representation of structures further from the structure of interest, for example structures in the far distance. The single panoramic image may provide a photographic backdrop.
The three-dimensional representation of the first part of the geographical area may comprise a plurality of three-dimensional objects, wherein each of the plurality of three-dimensional objects representative of a respective structure in the first part of the geographical area.
By representing structures in the first part of the geographical area as three-dimensional objects, the apparent position of the structures in the first part of the geographical area may be made to change in dependence on viewing position. A relative position of structures in the first part of the geographical area may change with viewing position.
Displaying in virtual reality the computer-generated scene may comprise displaying the computer-generated scene as if viewed from a first viewing position and subsequently displaying the computer-generated scene as if viewed from a second viewing position. An appearance of the two-dimensional representation may be substantially unchanged between the first viewing position and the second viewing position. An appearance of the three-dimensional representation may be different when viewed from the second viewing position than when viewed from the first viewing position.
Changing the position from which the computer-generated scene is viewed from the first viewing position to the second viewing position may change an apparent position of at least one structure in the three-dimensional representation relative to structures in the two-dimensional representation. Changing the position from which the computer-generated scene is viewed from the first viewing position to the second viewing position may not change an apparent position of a structure in the two-dimensional representation relative to other structures in the two-dimensional representation. Changing the position from which the computer-generated scene is viewed from the first viewing position to the second viewing position may change an apparent position of a structure in the three-dimensional representation relative to other structures in the three-dimensional representation. Effects of parallax may be simulated. Providing apparent relative movement may provide a more accurate representation of structures that are near to the structure of interest.
The method may further comprising determining the first part of the geographical area and the second part of the geographical area.
The first part and the second part of the geographical area may be pre-defined. The first part and the second part of the geographical area may be determined manually. The first part and the second part of the geographical area may be determined automatically.
The determining of the first part of the geographical area and the second part of the geographical area may be based on distance from the structure of interest. The determining of the first part of the geographical area may comprise determining a part of the geographical area that is within a threshold distance from the structure of interest. The determining of the second part of the geographical area may comprise determining a part of the geographical area is above a threshold distance from the structure of interest.
The threshold distance may be defined manually. The threshold distance may be defined automatically. The threshold distance may be variable by a user. The photographic data may be re-processed using a different threshold distance. An updated computer-generated scene may be obtained using the re-processed photographic data.
The determining of the first part of the geographical area and the second part of the geographical area may comprise dividing a set of structures in the geographical area between the first part of the geographical area and the second part of the geographical area.
The dividing of the set of structures may comprise respectively allocating each structure of the set of structures to the first part or to the second part of the geographical area based on at least one of: a distance of the structure from the structure of interest, a size of the structure, an importance of the structure.
The first part of the geographical area is generally closer to the structure of interest than the second part of the geographical area. However, in some circumstances, there may be an individual structure in the second part of the geographical area that is closer to the structure of interest than an individual structure in the first part of the geographical area. Structures may be allocated based on a distance from the structure of interest and on a size of the structure and/or an importance of the structure. For example, large and/or important structures at a given distance from the structure may be included in the three-dimensional representation when smaller and/or less important structures at that distance. Certain structures may be prioritised for three-dimensional representation, for example landmark structures.
The dividing of the set of structures in the geographical area between the first part of the geographical area and the second part of the geographical area may comprises allocating to the first part of the geographical area structures at a distance to the structure of interest that is below a threshold distance, and allocating to the second part of the geographical area structures at a distance to the structure of interest that is above the threshold distance.
The processing of the photographic data may comprise processing the photographic data using at least one of map data, planning data, distance data, laser data.
The processing of the photographic data to obtain the three-dimensional representation may comprise processing the photographic data using photogrammetry.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: receive photographic data representative of a geographical area, wherein a second part of the geographical area is further from a structure of interest than a first part of the geographical area; process the photographic data to obtain a three-dimensional representation of the first part of the geographical area and a two-dimensional representation of the second part of the geographical area; and display in virtual reality on the at least one display screen a computer-generated scene representative of the structure of interest, wherein the computer-generated scene comprises the three-dimensional representation of the first part of the geographical area and the two-dimensional representation of the second part of the geographical area.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: displaying in virtual reality a computer-generated scene representative of a structure of interest, wherein the computer-generated scene comprises: a three-dimensional representation of a first part of a geographical area, and a two-dimensional representation of a second part of the geographical region, the second part of the geographical area being further from the structure of interest than the first part of the geographical area; wherein the three-dimensional representation of the first part of the geographical region and the two-dimensional representation of the second part of the geographical region are obtained from the same photographic data.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: display in virtual reality on the at least one display screen a computer-generated scene representative of a structure of interest, wherein the computer-generated scene comprises: a three-dimensional representation of a first part of a geographical area, and a two-dimensional representation of a second part of the geographical region, the second part of the geographical area being further from the structure of interest than the first part of the geographical area.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: displaying in virtual reality an initial computer-generated scene comprising a miniature model of a structure at a first, smaller scale; receiving from the user a selection of a location in the miniature model, the location in the miniature model corresponding to a location in the structure; and displaying in virtual reality a further computer-generated scene representative of at least part of the structure at a second, larger scale, wherein the further computer-generated scene is displayed as if viewed from a viewing position in the structure that is selected in dependence on the selected location in the miniature model.
Displaying a representation of a miniature model may provide an easy and/or intuitive method for a user to navigate the structure. The user may directly interact with the miniature model. The user may select, for example a particular room within the structure. The location in the structure may be a viewing position that is of interest to the user. Selecting a location on the miniature model may be more straightforward than navigating to the selected location using another method, for example walking through the structure in virtual reality to reach the selected location.
The initial computer-generated scene may be representative of at least part of the structure. The miniature model may be displayed in the initial computer-generated scene as if the miniature model were present in the at least part of the structure.
The initial computer-generated scene may be representative of a different part of the structure than is represented in the further computer-generated scene. At least part of the further computer-generated scene may be the same as at least part of the initial computer-generated scene.
Displaying the miniature model in the at least part of the structure may allow the user to interact with the structure at two scales simultaneously. The user may have the impression of being inside a part of the structure, while also looking at a scale model of the entire structure which is provided by the miniature model.
The initial computer-generated scene may be displayed as if viewed from an initial viewing position. The initial computer-generated scene may comprise an indicator indicating a location on the miniature model that corresponds to the initial viewing position.
By indicating a location from which the user appears to be viewing the scene, the user may understand their viewing position in context. For example, the user may understand which room of the structure they are currently viewing.
The displaying of the further computer-generated scene may comprise displaying a or the representation of the miniature model at a or the smaller scale, wherein the representation of the miniature model is displayed in or adjacent to the further computer-generated scene.
Displaying the miniature model in both the initial scene and the further scene may allow the user to understand in context a position from which they are viewing the further scene.
The initial computer-generated scene may comprise an indicator indicating the selected location in the miniature model. The further computer-generated scene may comprise an indicator indicating the selected location in the miniature model.
The indicator may have a different visual appearance in the initial computer-generated scene than in the further computer-generated scene. For example, the indicator may have a first colour in the initial computer-generated scene (which is not viewed from a location corresponding to the selected location in the miniature model) than in the further computer-generated scene (which is viewed from a location corresponding to the selected location in the miniature model).
In some embodiments, one indicator appearance (for example, one colour) is used for a location corresponding to a current viewing position, and another indicator appearance (for example, another colour) is used for a selected location from which the scene is not being viewed.
The provision of indicators having different appearance may help the user to distinguish where they are in the structure from where they have requested to move to.
A transition from the initial computer-generated scene to the further computer-generated scene may comprise teleporting the user to the location in the further computer-generated scene that corresponds to the selected location in the miniature model. Teleportation may provide a quick and simple way of moving around the structure.
The user may provide the selection of the location in the miniature model by pointing an input device at the location in the miniature model. The input device may comprise at least one of a handheld input device, a games controller, a wand.
Pointing an input device at the miniature model may provide a quick and convenient way of selecting a location to move to.
An apparent position of the miniature model may be the same in the further computer-generated scene as in the initial computer-generated scene. The display of the miniature model may persist when a movement is made. The miniature model may be permanently displayed.
The miniature model may be at least partially transparent. The miniature model may be placed in a corner of a screen.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: display in virtual reality on the at least one display screen an initial computer-generated scene comprising a miniature model of a structure at a first, smaller scale; receive from a user via the at least one user input device a selection of a location in the miniature model, the location in the miniature model corresponding to a location in the structure; and display in virtual reality on the at least one display screen a further computer-generated scene representative of at least part of the structure at a second, larger scale, wherein the further computer-generated scene is displayed from a viewing position in the structure that is selected in dependence on the selected location in the miniature model.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: displaying in virtual reality a computer-generated scene representative of a surface of interest and at least one further surface; receiving from a user an annotation input comprising a first part and a second part, wherein at least the second part extends beyond the surface of interest; and drawing the annotation in the computer-generated scene such that the first part is drawn on the surface of interest and the second part is drawn on an imaginary surface defined relative to the surface of interest.
The user may use an annotation that extends beyond one surface. By using an annotation that extends beyond one surface, the user may indicate an extension of the surface of interest, or to highlight the surface of interest by drawing around it. It may be recognised that the user wishes to continue to draw in a plane of the surface of interest rather than to jump to another surface. The annotation may be more versatile than an annotation that is restricted to a single surface. The method of providing the annotation may be intuitive to a user, who may expect an annotation that starts in one plane (the plane of the surface) to continue in that plane, rather than jumping to the plane of a different surface.
The annotation input may be provided by the user using a virtual annotation tool.
The virtual annotation tool may be operated using an input device, for example a handheld input device, controller, games controller, wand, mouse, or stylus. The annotation input may comprise an extended movement in space, for example a movement from left to right, right to left, up to down, or down to up. The annotation input may simulate drawing a line or shape, for example a geometrical shape.
The virtual annotation tool may comprise at least one of a virtual laser pointer, a virtual pencil, a virtual pen, a virtual spray can.
The virtual annotation tool may be configured to project a virtual substance from a first viewing position.
The virtual substance may comprise at least one of light, paint, ink. The virtual substance may be projected from the first viewing position so as to land on any surface in the line of sight of the virtual annotation tool.
The virtual annotation tool may provide a familiar effect, for example an effect similar to that of a laser pointer, which projects light onto the first object in its line of sight.
The method may further comprise selecting the surface of interest by projecting the virtual substance onto said surface of interest.
The computer-generated scene may comprise a plurality of surfaces. Before the user starts to provide the annotation input, the surface of interest may not have been identified. The surface of interest may be identified as the first surface that the user annotates using the virtual annotation tool. It may be assumed that the user wishes to continue in the plane of the first surface, for example to draw an extension to the first surface.
The method may further comprise determining a transition between the first part and the second part of the annotation. The transition between the first part and the second part may comprise a location at which the virtual substance ceases to be projected onto the surface of interest and starts to be projected onto a or the further surface.
If the annotation input jumps from one surface to another (for example, as the beam of a laser pointer may appear to jump when moving from one surface at a first distance from the laser pointer to another surface at a second distance from the laser pointer), the annotation input may be interpreted (and drawn) as if it had stayed in the plane of the first surface.
The determining of the transition may comprise determining the transition in dependence on a distance between the surface of interest and a further surface. The determining of the transition may be in dependence on a comparison between a threshold distance and the distance between the surface of interest and the further surface. If the distance between the surface of interest and the further surface is below the threshold distance, no transition may be determined. The annotation may be drawn on the surface of interest and on the further surface. If the distance between the surface of interest and the further surface is above the threshold distance, the part of the annotation in which the annotation tool projects onto the surface of interest may be drawn on the surface of interest, while the part of the annotation in which the annotation tool projects onto the further surface may be drawn on the imaginary surface defined relative to the surface of interest.
The defining of the imaginary surface may comprise defining the imaginary surface relative to a normal of the surface of interest. The normal may comprise a normal at an initial point of annotation on the surface of interest. The normal may comprise a normal at a final point of annotation on the surface of interest. The normal may be calculated as a vector perpendicular to a line connecting two previous annotation points.
The imaginary surface may be invisible in the computer-generated scene.
No representation of the plane may be rendered. The drawn annotation may appear to extend into free space.
The imaginary surface may comprise an imaginary plane. The imaginary plane may be aligned with at least part of the surface of interest.
The displaying of the computer-generated scene may comprise displaying the computer-generated scene as if viewed from the or a first viewing position.
The drawn annotation may appear to occupy the same position in three-dimensional space when viewed from the second viewing position as when viewed from the first viewing position.
The method may further comprise displaying the computer-generated scene and the drawn annotation from a second viewing position maintaining a position of the drawn annotation in the computer-generated scene, such that an appearance of the drawn annotation from the first viewing position is different from an appearance of the drawn annotation from the second viewing position.
The drawn annotation may maintain in the computer-generated scene a constant position relative to the surface of interest and the at least one further surface.
The method may further comprise displaying the computer-generated scene and the drawn annotation from a second viewing position such that the drawn annotation moves relative to the surface of interest and the at least one further surface. The drawn annotation may appear to occupy a different position in three-dimensional space when viewed from the second viewing position than when viewed from the first viewing position. The drawn annotation may rotate relative to the surface of interest and the at least one further surface to maintain a constant appearance relative to the viewer.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to: display in virtual reality on the at least one display screen a computer-generated scene representative of a surface of interest and at least one further surface; receive from a user via the at least one user input device an annotation input comprising a first part and a second part, wherein at least the second part extends beyond the surface of interest; and draw the annotation in the computer-generated scene such that the first part is drawn on the surface of interest and the second part are drawn on an imaginary surface defined relative to the surface of interest.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: displaying in virtual reality a computer-generated scene; obtaining a movement command from a real-world physical movement of a user, the movement command corresponding to a movement of a virtual body; and adjusting the movement of the virtual body in dependence on an effect of gravity in the computer-generated scene and/or in dependence on the presence of at least one object within the computer-generated scene that inhibits the movement of the virtual body, wherein the adjusting of the movement is such that the adjusted movement of the virtual body does not correspond with the real-world physical movement of the user.
Providing movement of a virtual body based on a user's real-world physical movement may provide an intuitive method of movement around the virtual scene. By including effects of gravity and/or interaction with objects in the scene, it may be possible to avoid making movements in the computer-generated scene that are not possible in the real-life environment represented in the scene. For example, a virtual head may not be able to float in mid-air, and a virtual body may not be able to walk through objects. Such constraints may provide increased realism in the scene.
A combination of a virtual head and virtual body may provide a movement that better simulates a physical movement than if only movement of virtual head were to be considered. For example, in some circumstances a virtual body or virtual body part may collide with an object in the scene, when the virtual head would not have collided with that object.
The virtual body may comprise at least one of a torso, an arm, a leg. The virtual body may represent at least part of a human form. The virtual body may be a simplified representation of at least part of a human form. The virtual body may comprise at least one geometrical shape. The virtual body may be one, two, or three-dimensional. The virtual body may be articulated.
If movement of only the virtual head (or a head and hands) were to be considered, it may be the case that a movement command would cause a virtual head and/or virtual body to become suspended in mid-air. For example, the user may request to step off a surface such as a table or balcony, and the system may allow them to do so. The virtual head and/or virtual body may be allowed to move to a viewing position which would not be possible in a real-life structure represented in the scene. By considering a virtual body, in some circumstances the user may not be allowed to perform some movements that would not be possible in the real-life structure.
A movement of a virtual head may be adjusted in dependence on the movement of the virtual body. Adjusting the movement of the virtual head in dependence on the movement of the virtual body may comprise at least one of reducing the movement of the virtual head, changing a trajectory of the virtual head, changing an angle of the virtual head.
The movement of the virtual body may comprise a movement from a first viewing position to a second viewing position.
The user may issue a movement command that requests the virtual head to move from a first viewing position to a second viewing position. In moving from the first viewing position to the second viewing position, the virtual body may be inhibited by an object in the computer-generated scene. Since the virtual body is coupled to the virtual head, the inhibition of the movement of the virtual body may reduce the movement of the virtual head. The resulting movement of the virtual head may terminate at or near the object that inhibited the movement of the virtual body.
By considering the movement of the virtual body, the user may be prevented from moving into a position that is impossible in real life by a representation of an object that would prevent them from doing so in real life, for example by interaction with a representation of a wall or balustrade in the computer-generated scene.
The virtual body may be deflected by the at least one object, causing a trajectory of the movement of the virtual head to change.
The first viewing position may be at a greater height in the scene than the second viewing position. The adjusting of the movement of the virtual head may comprise adjusting the movement of the virtual head to represent falling under gravity.
If the movement of the virtual body is affected by gravity, the movement of the virtual head may be adjusted to represent the action of gravity on the body. A position or orientation of the virtual head may be changed.
The first viewing position may be at an elevated part of the scene. For example the first viewing position may be representative of the user standing on a table or platform. The second viewing position may be at a less-elevated part of the scene. For example, the second viewing position may be representative of the user standing on the floor.
The adjusting of the movement of the virtual head may comprise adjusting the movement of the virtual head to represent a constraint on the virtual body due to the presence of the at least one object, the constraint preventing movement of the virtual head to the second viewing position.
The at least one object may comprise at least one of a wall, a balustrade, a rope, a barrier.
The movement of the virtual body may be in dependence on a movement of a virtual head. The movement of the virtual body may be in dependence on a movement of at least one virtual hand.
The real-world physical movement of the user may comprise a movement of the user's head.
The virtual head may be prevented from moving into a position that is impossible in real life. The virtual head may be prevented from moving by an object that interacts with the virtual body, but does not interact directly with the virtual head.
The user may walk in real life, and the user's walking may be translated into a movement command. The real-world movement may comprise a gesture. The real-world movement may comprise a movement of any appropriate part of the user's body, for example, a head, a torso, an arm, a leg, a hand or a foot.
The obtaining of the real-world physical movement may be via a user input device. The user input device may comprise at least one of a body suit, a tracking device, a camera, body recognition software.
The real-world movement may correspond to a movement that would not be possible in a structure that is represented in the computer-generated scene. For example, the real-world movement may correspond to stepping into thin air or walking through a wall. By adjusting the movement, a movement may be obtained that makes sense in the computer-generated scene. The movement may be adjusted to represent a movement that would be possible in the structure. For example, if the user attempts to move into mid-air, the user may fall. If the user attempts to cross a barrier such as the balustrade of a balcony, the user may be restrained. The user may be able to look over the balustrade, but may not be able to walk through the balustrade.
The movement command may comprise a teleport command from the first viewing position to the second viewing position.
In a further aspect of the invention, which may be provided independently, there is provided an apparatus comprising at least one display screen, at least one user input device and at least one processor configured to: display in virtual reality on the at least one display screen a computer-generated scene; obtain a movement command from a real-world physical movement of a user, the movement command corresponding to a movement of a virtual body; and adjust the movement of the virtual body in dependence on an effect of gravity in the computer-generated scene and/or in dependence on the presence of at least one object within the computer-generated scene that inhibits the movement of the virtual body, wherein the adjusting of the movement is such that the adjusted movement of the virtual body does not correspond with the real-world physical movement of the user.
In another aspect of the invention, which may be provided independently, there is provided a method comprising: displaying in virtual reality a computer-generated scene comprising an interactive virtual object, such that the interactive virtual object appears to be at a distance from a user; receiving from the user a remote selection of the interactive virtual object; in response to the remote selection, displaying a virtual manipulation indicator overlaid with or adjacent to the interactive virtual object, wherein the virtual manipulation indicator is indicative of the interactive virtual object being in an active mode in which the interactive virtual object can receive manipulation commands; receiving a manipulation command from the user; and in response to the manipulation command from the user, operating or moving the interactive virtual object, such that the interactive virtual object appears to be operated or moved at a distance from the user.
<div id="p-0127" num="0126" clas
CLAIMS
Claims ( 14 )
1 . A method comprising:
displaying in virtual reality a computer-generated scene representative of a structure of interest, wherein the computer-generated scene comprises: a three-dimensional representation of a first part of a geographical area, and a two-dimensional representation of a second part of the geographical region, the second part of the geographical area being further from the structure of interest than the first part of the geographical area, wherein displaying in virtual reality the computer-generated scene comprises displaying the computer-generated scene as if viewed from a first viewing position and subsequently displaying the computer-generated scene as if viewed from a second viewing position; and wherein an appearance of the two-dimensional representation is substantially unchanged between the first viewing position and the second viewing position, and an appearance of the three-dimensional representation is different when viewed from the second viewing position than when viewed from the first viewing position.
2 . The method of claim 1 , wherein the method further comprises receiving photographic data representative of the geographical area and processing the photographic data to obtain the three-dimensional representation of the first part of the geographical area and the two-dimensional representation of the second part of the geographical area.
3 . A method according to claim 2 , wherein the three-dimensional representation and two-dimensional representation are obtained by processing the same photographic data.
4 . A method according to any of claim 1 , wherein the photographic data comprises at least one of aerial data, drone data.
5 . A method according to claim 1 , wherein the two-dimensional representation of the second part of the geographical area comprises at least one static two-dimensional image of the second part of the geographical area.
6 . A method according to claim 1 , wherein the two-dimensional representation of the second part of the geographical area comprises a single panoramic image of the second part of the geographical area.
7 . A method according to claim 1 , further comprising determining the first part of the geographical area and the second part of the geographical area, wherein the determining of the first part of the geographical area and the second part of the geographical area is based on distance from the structure of interest.
8 . A method according to claim 7 , wherein the determining of the first part of the geographical area comprises determining a part of the geographical area that is within a threshold distance from the structure of interest, and the determining of the second part of the geographical area comprises determining a part of the geographical area is above a threshold distance from the structure of interest.
9 . A method according to claim 7 , wherein the determining of the first part of the geographical area and the second part of the geographical area comprises dividing a set of structures in the geographical area between the first part of the geographical area and the second part of the geographical area.
10 . A method according to claim 9 , wherein the dividing of the set of structures comprises respectively allocating each structure of the set of structures to the first part or to the second part of the geographical area based on at least one of: a distance of the structure from the structure of interest, a size of the structure, an importance of the structure.
11 . A method according to claim 1 , wherein the or a structure represented in the computer-generated scene comprises at least one of an architectural structure, a building, a house, an apartment building, a residential building, a commercial building, an office building.
12 . A computer program product comprising computer readable instructions that are executable by a processor to perform a method according to claim 1 .
13 . An apparatus comprising at least one display screen, at least one user input device, and at least one processor configured to:
display in virtual reality on the at least one display screen a computer-generated scene representative of a structure of interest, wherein the computer-generated scene comprises: a three-dimensional representation of a first part of a geographical area, and
a two-dimensional representation of a second part of the geographical region, the second part of the geographical area being further from the structure of interest than the first part of the geographical area, wherein displaying in virtual reality the computer-generated scene comprises displaying the computer-generated scene as if viewed from a first viewing position and subsequently displaying the computer-generated scene as if viewed from a second viewing position; and
wherein an appearance of the two-dimensional representation is substantially unchanged between the first viewing position and the second viewing position, and an appearance of the three-dimensional representation is different when viewed from the second viewing position than when viewed from the first viewing position.
14 . An apparatus as claimed in claim 13 , wherein the at least one processor is further configured to:
receive photographic data representative of the geographical area; process the photographic data to obtain the three-dimensional representation of the first part of the geographical area and the two-dimensional representation of the second part of the geographical area.
US18/073,001
2016-10-14
2022-12-01
Virtual reality system and method
Abandoned
US20230087230A1
( en )
Priority Applications (1)
Application Number
Priority Date
Filing Date
Title
US18/073,001
US20230087230A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
Applications Claiming Priority (6)
Application Number
Priority Date
Filing Date
Title
GB1617446.8A
GB2554914B
( en )
2016-10-14
2016-10-14
Virtual reality system and method
GB1617446.8
2016-10-14
US201662410107P
2016-10-19
2016-10-19
US15/784,718
US11068047B2
( en )
2016-10-14
2017-10-16
Virtual reality system obtaining movement command from real-world physical user
US17/357,293
US20210318752A1
( en )
2016-10-14
2021-06-24
Virtual reality system obtaining movement command from real-world physical user
US18/073,001
US20230087230A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
Related Parent Applications (1)
Application Number
Title
Priority Date
Filing Date
US17/357,293
Continuation
US20210318752A1
( en )
2016-10-14
2021-06-24
Virtual reality system obtaining movement command from real-world physical user
Publications (1)
Publication Number
Publication Date
US20230087230A1
true
US20230087230A1 ( en )
2023-03-23
Family
ID=57680887
Family Applications (7)
Application Number
Title
Priority Date
Filing Date
US15/784,718
Expired - Fee Related
US11068047B2
( en )
2016-10-14
2017-10-16
Virtual reality system obtaining movement command from real-world physical user
US17/357,293
Abandoned
US20210318752A1
( en )
2016-10-14
2021-06-24
Virtual reality system obtaining movement command from real-world physical user
US18/073,039
Abandoned
US20230089635A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/073,065
Abandoned
US20230093676A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/072,968
Abandoned
US20230090043A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/073,016
Abandoned
US20230095331A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/073,001
Abandoned
US20230087230A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
Family Applications Before (6)
Application Number
Title
Priority Date
Filing Date
US15/784,718
Expired - Fee Related
US11068047B2
( en )
2016-10-14
2017-10-16
Virtual reality system obtaining movement command from real-world physical user
US17/357,293
Abandoned
US20210318752A1
( en )
2016-10-14
2021-06-24
Virtual reality system obtaining movement command from real-world physical user
US18/073,039
Abandoned
US20230089635A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/073,065
Abandoned
US20230093676A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/072,968
Abandoned
US20230090043A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
US18/073,016
Abandoned
US20230095331A1
( en )
2016-10-14
2022-12-01
Virtual reality system and method
Country Status (2)
Country
Link
US
( 7 )
US11068047B2
( en )
GB
( 1 )
GB2554914B
( en )
Families Citing this family (20)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
DE102009037835B4
( en )
2009-08-18
2012-12-06
Metaio Gmbh
Method for displaying virtual information in a real environment
CN110379019A
( en )
*
2013-09-24
2019-10-25
è¹æå ¬å¸
The method and mobile device of point of interest are indicated in the view of true environment
US20180059812A1
( en )
*
2016-08-22
2018-03-01
Colopl, Inc.
Method for providing virtual space, method for providing virtual experience, program and recording medium therefor
US10297088B2
( en )
*
2017-09-26
2019-05-21
Adobe Inc.
Generating accurate augmented reality objects in relation to a real-world surface via a digital writing device
US11188144B2
( en )
*
2018-01-05
2021-11-30
Samsung Electronics Co., Ltd.
Method and apparatus to navigate a virtual content displayed by a virtual reality (VR) device
US11475175B2
( en )
*
2018-06-14
2022-10-18
International Business Machines Corporation
Intelligent design structure selection in an internet of things (IoT) computing environment
US11210816B1
( en )
*
2018-08-28
2021-12-28
Apple Inc.
Transitional effects in real-time rendering applications
US10740987B2
( en )
*
2018-10-12
2020-08-11
The Boeing Company
Augmented reality system for visualizing nonconformance data for an object
US11176696B2
( en )
*
2019-05-13
2021-11-16
International Business Machines Corporation
Point depth estimation from a set of 3D-registered images
US11775130B2
( en )
*
2019-07-03
2023-10-03
Apple Inc.
Guided retail experience
US11816800B2
( en )
*
2019-07-03
2023-11-14
Apple Inc.
Guided consumer experience
US12175010B2
( en )
*
2019-09-28
2024-12-24
Apple Inc.
Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11400376B2
( en )
*
2019-10-23
2022-08-02
Sony Interactive Entertainment Inc.
AI-generated internal environments based on external geometry
US11222475B2
( en )
2020-01-22
2022-01-11
Procore Technologies, Inc.
Computer systems and methods for navigating building information models in an augmented environment
EP3879501A1
( en )
*
2020-03-12
2021-09-15
InterDigital CE Patent Holdings
Method and apparatus for modelling a scene
US12014030B2
( en )
*
2021-08-18
2024-06-18
Bank Of America Corporation
System for predictive virtual scenario presentation
US11656835B1
( en )
*
2021-12-29
2023-05-23
Transmira, Inc.
Systems and methods for spatial conversion and synchronization between geolocal augmented reality and virtual reality modalities associated with real-world physical locations
CN116820290A
( en )
*
2022-03-22
2023-09-29
å京æç«¹å± ç½ç»ææ¯æéå ¬å¸
Display method, display device, terminal and storage medium for house three-dimensional model
US12461640B2
( en )
2022-09-21
2025-11-04
Apple Inc.
Devices, methods, and graphical user interfaces for displaying shadow and light effects in three-dimensional environments
US12322040B2
( en )
*
2022-12-29
2025-06-03
Skonec Entertainment Co., Ltd.
Virtual reality control system
Citations (6)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20120183204A1
( en )
*
2011-01-18
2012-07-19
NedSense Loft B.V.
3d modeling and rendering from 2d images
US20150049086A1
( en )
*
2013-08-16
2015-02-19
Genius Matcher Ltd.
3D Space Content Visualization System
US20150187136A1
( en )
*
2013-12-26
2015-07-02
Dassault Systemes
Diminished Reality
US20150269785A1
( en )
*
2014-03-19
2015-09-24
Matterport, Inc.
Selecting two-dimensional imagery data for display within a three-dimensional model
US9460561B1
( en )
*
2013-03-15
2016-10-04
Bentley Systems, Incorporated
Hypermodel-based panorama augmentation
US10824871B1
( en )
*
2015-05-19
2020-11-03
Hrl Laboratories, Llc
Method and apparatus for obtaining unique signatures for a space through compressed imaging and semi-repeated movements
Family Cites Families (34)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US5590062A
( en )
*
1993-07-02
1996-12-31
Matsushita Electric Industrial Co., Ltd.
Simulator for producing various living environments mainly for visual perception
US6144385A
( en )
*
1994-08-25
2000-11-07
Michael J. Girard
Step-driven character animation derived from animation data without footstep information
US5963891A
( en )
*
1997-04-24
1999-10-05
Modern Cartoons, Ltd.
System for tracking body movements in a virtual reality system
US6626728B2
( en )
*
2000-06-27
2003-09-30
Kenneth C. Holt
Motion-sequence activated toy wand
US7883415B2
( en )
*
2003-09-15
2011-02-08
Sony Computer Entertainment Inc.
Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
JP3700857B2
( en )
*
2004-03-03
2005-09-28
ã³ããæ ªå¼ä¼ç¤¾
GAME PROGRAM AND GAME DEVICE
US8179366B2
( en )
*
2004-12-06
2012-05-15
Naturalpoint, Inc.
Systems and methods for using a movable object to control a computer
US20130063477A1
( en )
*
2004-12-06
2013-03-14
James Richardson
Systems and methods for using a movable object to control a computer
US7864168B2
( en )
*
2005-05-25
2011-01-04
Impulse Technology Ltd.
Virtual reality movement system
US8564532B2
( en )
*
2005-12-06
2013-10-22
Naturalpoint, Inc.
System and methods for using a movable object to control a computer
US20080252640A1
( en )
*
2007-04-13
2008-10-16
Jeffrey Williams
Systems and methods for interactive real estate viewing
DE102007045835B4
( en )
*
2007-09-25
2012-12-20
Metaio Gmbh
Method and device for displaying a virtual object in a real environment
US20100066750A1
( en )
*
2008-09-16
2010-03-18
Motorola, Inc.
Mobile virtual and augmented reality system
US20100182340A1
( en )
*
2009-01-19
2010-07-22
Bachelder Edward N
Systems and methods for combining virtual and real-time physical environments
WO2010141076A1
( en )
*
2009-06-03
2010-12-09
Savant Systems Llc
Virtual room-based light fixture and device control
EP2715674A2
( en )
*
2011-05-23
2014-04-09
Blu Homes, Inc.
Method, apparatus and system for customizing a building via a virtual environment
CA2801512A1
( en )
*
2012-01-05
2013-07-05
Jeremy Mutton
System and method for virtual touring of model homes
US9552673B2
( en )
*
2012-10-17
2017-01-24
Microsoft Technology Licensing, Llc
Grasping virtual objects in augmented reality
KR102271198B1
( en )
*
2013-03-15
2021-06-29
ë§¤ì§ ë¦½, ì¸ì½í¬ë ì´í°ë
Display system and method
BR112015025869A2
( en )
*
2013-04-16
2017-07-25
Sony Corp
information processing and display apparatus, methods for information processing and display, and information processing system
CA2893586C
( en )
*
2014-06-17
2021-01-26
Valorisation-Recherche, Limited Partnership
3d virtual environment interaction system
US9589354B2
( en )
*
2014-06-17
2017-03-07
Chief Architect Inc.
Virtual model viewing methods and apparatus
US10162177B2
( en )
*
2014-07-11
2018-12-25
Sixense Entertainment, Inc.
Method and apparatus for self-relative body tracking for virtual reality systems using magnetic tracking
US10509865B2
( en )
*
2014-09-18
2019-12-17
Google Llc
Dress form for three-dimensional drawing inside virtual reality environment
US10062205B2
( en )
*
2014-10-16
2018-08-28
Trick 3D
Systems and methods for generating an interactive floor plan
US10062208B2
( en )
*
2015-04-09
2018-08-28
Cinemoi North America, LLC
Systems and methods to provide interactive virtual environments
FR3041804B1
( en )
*
2015-09-24
2021-11-12
Dassault Aviat
VIRTUAL THREE-DIMENSIONAL SIMULATION SYSTEM SUITABLE TO GENERATE A VIRTUAL ENVIRONMENT GATHERING A PLURALITY OF USERS AND RELATED PROCESS
US10146194B2
( en )
*
2015-10-14
2018-12-04
Hand Held Products, Inc.
Building lighting and temperature control with an augmented reality system
WO2017139509A1
( en )
*
2016-02-12
2017-08-17
Purdue Research Foundation
Manipulating 3d virtual objects using hand-held controllers
JP6689694B2
( en )
*
2016-07-13
2020-04-28
æ ªå¼ä¼ç¤¾ãã³ãã¤ãã ã³ã¨ã³ã¿ã¼ãã¤ã³ã¡ã³ã
Simulation system and program
US10147243B2
( en )
*
2016-12-05
2018-12-04
Google Llc
Generating virtual notation surfaces with gestures in an augmented and/or virtual reality environment
US11023109B2
( en )
*
2017-06-30
2021-06-01
Microsoft Techniogy Licensing, LLC
Annotation using a multi-device mixed interactivity system
US20200310561A1
( en )
*
2019-03-29
2020-10-01
Logitech Europe S.A.
Input device for use in 2d and 3d environments
IL291215B2
( en )
*
2019-09-11
2025-09-01
Savant Systems Inc
Three dimensional virtual room-based user interface for a home automation system
2016
2016-10-14
GB
GB1617446.8A
patent/GB2554914B/en
not_active
Expired - Fee Related
2017
2017-10-16
US
US15/784,718
patent/US11068047B2/en
not_active
Expired - Fee Related
2021
2021-06-24
US
US17/357,293
patent/US20210318752A1/en
not_active
Abandoned
2022
2022-12-01
US
US18/073,039
patent/US20230089635A1/en
not_active
Abandoned
2022-12-01
US
US18/073,065
patent/US20230093676A1/en
not_active
Abandoned
2022-12-01
US
US18/072,968
patent/US20230090043A1/en
not_active
Abandoned
2022-12-01
US
US18/073,016
patent/US20230095331A1/en
not_active
Abandoned
2022-12-01
US
US18/073,001
patent/US20230087230A1/en
not_active
Abandoned
Patent Citations (6)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20120183204A1
( en )
*
2011-01-18
2012-07-19
NedSense Loft B.V.
3d modeling and rendering from 2d images
US9460561B1
( en )
*
2013-03-15
2016-10-04
Bentley Systems, Incorporated
Hypermodel-based panorama augmentation
US20150049086A1
( en )
*
2013-08-16
2015-02-19
Genius Matcher Ltd.
3D Space Content Visualization System
US20150187136A1
( en )
*
2013-12-26
2015-07-02
Dassault Systemes
Diminished Reality
US20150269785A1
( en )
*
2014-03-19
2015-09-24
Matterport, Inc.
Selecting two-dimensional imagery data for display within a three-dimensional model
US10824871B1
( en )
*
2015-05-19
2020-11-03
Hrl Laboratories, Llc
Method and apparatus for obtaining unique signatures for a space through compressed imaging and semi-repeated movements
Also Published As
Publication number
Publication date
GB201617446D0
( en )
2016-11-30
US20230089635A1
( en )
2023-03-23
US20230093676A1
( en )
2023-03-23
US20180107269A1
( en )
2018-04-19
US11068047B2
( en )
2021-07-20
GB2554914A
( en )
2018-04-18
US20210318752A1
( en )
2021-10-14
US20230090043A1
( en )
2023-03-23
GB2554914B
( en )
2022-07-20
US20230095331A1
( en )
2023-03-30
Similar Documents
Publication
Publication Date
Title
US20230093676A1
( en )
2023-03-23
Virtual reality system and method
JP7560568B2
( en )
2024-10-02
Systems and methods for virtual and augmented reality
CN113096252B
( en )
2021-11-02
A multi-movement mechanism fusion method in hybrid enhanced teaching scenarios
US10049493B1
( en )
2018-08-14
System and methods for providing interaction with elements in a virtual architectural visualization
TWI567659B
( en )
2017-01-21
Theme-based augmentation of photorepresentative view
JP2023542846A
( en )
2023-10-12
Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
JP2022549853A
( en )
2022-11-29
Individual visibility in shared space
WO2024253976A1
( en )
2024-12-12
Devices, methods, and graphical user interfaces for displaying views of physical locations
JPH0785312A
( en )
1995-03-31
3D movie creation device
JPWO2019123729A1
( en )
2020-12-17
Image processing equipment, image processing methods, and programs
CN107656615A
( en )
2018-02-02
The world is presented in a large amount of digital remotes simultaneously
WO2014050957A1
( en )
2014-04-03
Display device, control method, and control program
CN103793060A
( en )
2014-05-14
User interaction system and method
Piekarski et al.
2004
Augmented reality working planes: A foundation for action and construction at a distance
CN107168534B
( en )
2021-05-07
Rendering optimization method and projection method based on CAVE system
KR20180059765A
( en )
2018-06-05
Information processing apparatus, information processing method, and program
CN110291577B
( en )
2023-03-28
Method, device and system for enhancing augmented reality experience of user
Singla
2021
Virtual reality based novel use case in remote sensing and GIS
JP2018013562A
( en )
2018-01-25
External control means in virtual reality system
Kreutzberg
2014
New virtual reality for architectural investigations
US11628374B2
( en )
2023-04-18
Virtual puppeteering using a portable device
GB2605302A
( en )
2022-09-28
Virtual reality system and method
GB2605298A
( en )
2022-09-28
Virtual reality system and method
JP2000090285A
( en )
2000-03-31
Video display device
GB2605299A
( en )
2022-09-28
Virtual reality system and method
Legal Events
Date
Code
Title
Description
2022-12-01
AS
Assignment
Owner name : VR-CHITECT LIMITED, UNITED KINGDOM
Free format text : ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BENZIES, LESLIE PETER;REEL/FRAME:061942/0549
Effective date : 20170611
2023-02-27
STPP
Information on status: patent application and granting procedure in general
Free format text : NON FINAL ACTION MAILED
2023-09-27
STCB
Information on status: application discontinuation
Free format text : ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION
2023-09-29
STCB
Information on status: application discontinuation
Free format text : ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION