ABSTRACT
Abstract
A method and system for linking a first virtual reality (VR) immersive space with a second VR immersive space. The method includes: generating a portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space; associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website; rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space; providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and virtually placing a user in the second VR immersive space when the portal is selected by the user.
Description
TECHNICAL FIELD
The following relates generally to virtual, augmented or mixed reality, and more specifically to methods and systems for linking a first virtual reality (VR) immersive space with a second VR immersive space.
BACKGROUND
The World Wide Web (âWWWâ, or just âwebâ) is a decentralized information space where documents, such as web pages, and other Web resources are identified by uniform resource locators (âURLsâ) and interlinked by hypertext links presented within Web pages and other documents. Web pages are documents that represent information and reference other documents and other web resources are identified by URLs, interlinked by hypertext links, and can be accessed via the Internet. Web pages are primarily text documents formatted and annotated with Hypertext Markup Language (âHTMLâ). In addition to formatted text, web pages may contain images, video, and software components that are rendered in a web browser as coherent pages of multimedia content. Embedded hyperlinks in web pages permit users to navigate to other web pages and resources. A web browser (hereinafter used interchangeably with âbrowserâ) is a software application for retrieving, rendering presenting, and traversing information resources, such as web pages, on the web. A web editor (hereinafter used interchangeably with âeditorâ) similarly is a software application for the creation and editing of web content that is presented by a browser.
While web pages may contain a variety of multimedia content, they were originally designed to represent real-world documents; that is, two-dimensional sheets of paper containing text and image content. In keeping with the document analogy, all media content is generally laid out in boxes or as regions on a two-dimensional or â2Dâ page using a declarative language HTML (Hypertext Markup Language). An important aspect of HTML allows content on webpages to be linked to content on other web pages. The links when activated by users cause typical web browsers to present the linked web page in place of the current page or an additional document in new tab or window.
SUMMARY
In an aspect, there is provided a computer implemented method of linking a first virtual reality (VR) immersive space with a second VR immersive space, the method comprising: generating a portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space; associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website; rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space; providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and virtually placing a user in the second VR immersive space when the portal is selected by the user.
In a particular case, selection by the user comprises having the user virtually walk through the portal.
In another case, a GL Shading Language defines the appearance of the portal.
The method of claim 1 , wherein generating the portal comprises defining position vectors and direction vectors for the portal in the first VR immersive space.
In yet another case, generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
In yet another case, the portal is generated only when the user selects the internet link in the first VR immersive space.
In yet another case, providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
In another aspect, there is provided a system for linking a first virtual reality (VR) immersive space with a second VR immersive space, the system comprising: a database storing data associated with the first VR immersive space and the second VR immersive space; and a processing unit in communication with the database, the processing unit executable to perform: generating a portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space; associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website; rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space; providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and virtually placing a user in the second VR immersive space when the portal is selected by the user.
In a particular case, selection by the user comprises having the user virtually walk through the portal.
In another case, a GL Shading Language defines the appearance of the portal.
In yet another case, generating the portal comprises defining position vectors and direction vectors for the portal in the first VR immersive space.
In yet another case, generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
In yet another case, the portal is generated only when the user selects the internet link in the first VR immersive space.
In yet another case, providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
In yet another case, the database is located on a webserver.
These and other aspects are contemplated and described herein. It will be appreciated that the foregoing summary sets out representative aspects of a method and system to assist skilled readers in understanding the following detailed description.
DESCRIPTION OF THE DRAWINGS
A greater understanding of the embodiments will be had with reference to the Figures, in which:
FIG. 1 is a block diagram illustrating a system for generating and navigating interactive linked virtual reality (VR) spaces;
FIG. 2 is a block diagram illustrating various physical components of a VR system;
FIG. 3 is a block diagram illustrating various definitions contained in a VR database;
FIG. 4 is a flowchart illustrating a method for generating and navigating interactive linked virtual reality (VR) spaces;
FIG. 5 is a flowchart illustrating an exemplary method 1300 of translating a conventional web page into an immersive 3D space;
FIG. 6 is an exemplary web page rendered as a 3D space;
FIG. 7 is an exemplary orientation of images for defining a 3D space; and
FIG. 8 illustrates top-down views of various exemplary space geometries.
DETAILED DESCRIPTION
For simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the Figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the embodiments described herein. Also, the description is not to be considered as limiting the scope of the embodiments described herein.
Various terms used throughout the present description may be read and understood as follows, unless the context indicates otherwise: âorâ as used throughout is inclusive, as though written âand/orâ; singular articles and pronouns as used throughout include their plural forms, and vice versa; similarly, gendered pronouns include their counterpart pronouns so that pronouns should not be understood as limiting anything described herein to use, implementation, performance, etc. by a single gender; âexemplaryâ should be understood as âillustrativeâ or âexemplifyingâ and not necessarily as âpreferredâ over other embodiments. Further definitions for terms may be set out herein; these may apply to prior and subsequent instances of those terms, as will be understood from a reading of the present description.
Any module, unit, component, server, computer, terminal, engine or device exemplified herein that executes instructions may include or otherwise have access to computer readable media such as storage media, computer storage media, or data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Computer storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, module, or both. Any such computer storage media may be part of the device or accessible or connectable thereto. Further, unless the context clearly indicates otherwise, any processor or controller set out herein may be implemented as a singular processor or as a plurality of processors. The plurality of processors may be arrayed or distributed, and any processing function referred to herein may be carried out by one or by a plurality of processors, even though a single processor may be exemplified. Any method, application or module herein described may be implemented using computer readable/executable instructions that may be stored or otherwise held by such computer readable media and executed by the one or more processors.
To provide a more flexible presentation space for emerging web content such as panoramic and stereo images and video, three dimensional (â3Dâ) objects, audio, animations, medical imaging, geographical and other spatial data, the following embodiments can interpret web pages as immersive spaces. As described herein, a link analogously can be represented by a portal, wormhole, or rip in the ether that connects two web spaces. The following embodiments describe the design and implementation of an immersive browser that allows the flexible multi-dimensional presentation of multimedia web content. A preferred embodiment of this browser is suitable for use with Virtual Reality (âVRâ), Augmented Reality (âARâ) or mixed reality displays.
Conventional solutions for VR experiences is simply to render web pages as traditionally laid out two-dimensional (â2Dâ) documents on a flat plane in front of the user's face on a VR or AR display. This is both unimaginative and an ineffective use of the spatial viewing capabilities of VR or AR technology. The present embodiments can provide a comprehensive solution for presenting web content in an immersive, social and collaborative VR or AR setting.
Additionally, conventional internet browsers, for example, have not changed fundamentally from their original design, around 20 year ago, whereby internet content was conceptualized as a document captured by the DOM (Document Object Model) from web pages authored using HTML and variants, with scripts for dynamic content. This type of design was pertinent for the time because internet content was mostly linked text and images. However, now as technology progresses, a technological problem arises in developing user experiences with richer 3D spatial content. For example, the internet of things makes even the physical location of web pages and programs meaningful spatially.
The present embodiments address the internet-related technological problem of developing spatial experiences by, for example, computationally interpreting webpages as spaces and links as portals. Conventional approaches to add spatiality to the internet are to essentially adapt Hypertext Markup Language (âHTMLâ) and Document Object Model (âDOMâ) to represent a 3D world. However these approaches lack markup that are more developer friendly and efficient for 3D space-time content. In the present embodiments, space-time representation of web pages are provided such that spaces automatically better lend themselves to a spatial and social setting; i.e., browsing art in a virtual art museum.
Applicant recognized the substantial advantages of having web pages, both previously developed (âlegacyâ) and developed in accordance with the present mark-up language, re-imagined as content presented as 3D space-time entities. In some cases, these entities can be advantageously linked together by portals, as described herein. For a legacy webpage, there is described herein a translator to re-interpret the document into a 3D experience.
In one aspect, a markup language that is a superset of HTML is provided, enabling the definition of web pages as immersive spaces that can be manipulated and reconfigured. The markup language comprises one or more asset definitions, spatial environment definitions and a layout instantiating the defined assets within the spatial environment, to altogether comprise the immersive space. Dynamic aspects of these spaces are controlled using a scripting language and events based on time and user interaction with the spaces. Immersive spaces may also be authored using pre-compiled modules and an API that provides functionality similar to that provided by the markup and scripting language. The physical location of the web pages may themselves have a meaningful location in the virtual world. An example of such a web page might be a webpage that illustrates the design and workings of smartphone. The web page itself can be physically hosted on a smartphone, allowing this web page to be presented in a virtual world with additional context of its physical location.
In another aspect, the markup and scripting can be used to define page âtranslatorsâ that ascribe semantics to pre-existing web pages, so that can they be re-interpreted as immersive 3D spaces instead of 2D documents as originally intended.
In a representative example, as shown in FIG. 8 , a virtual or immersive space is a 3D world housing virtual rooms within which internet content is made available and, more particularly, comprises a virtual environment that contains a 3D layout of a combination of links to other immersive spaces and assets or multidimensional media content such as 3D objects, lights, viewpoints, data for medical, scientific or information visualization, immersive sound and video, and even existing legacy 2D layouts of text and images. Most conventional approaches to accessing such web content in virtual real
TECHNICAL FIELD
The following relates generally to virtual, augmented or mixed reality, and more specifically to methods and systems for linking a first virtual reality (VR) immersive space with a second VR immersive space.
BACKGROUND
The World Wide Web (âWWWâ, or just âwebâ) is a decentralized information space where documents, such as web pages, and other Web resources are identified by uniform resource locators (âURLsâ) and interlinked by hypertext links presented within Web pages and other documents. Web pages are documents that represent information and reference other documents and other web resources are identified by URLs, interlinked by hypertext links, and can be accessed via the Internet. Web pages are primarily text documents formatted and annotated with Hypertext Markup Language (âHTMLâ). In addition to formatted text, web pages may contain images, video, and software components that are rendered in a web browser as coherent pages of multimedia content. Embedded hyperlinks in web pages permit users to navigate to other web pages and resources. A web browser (hereinafter used interchangeably with âbrowserâ) is a software application for retrieving, rendering presenting, and traversing information resources, such as web pages, on the web. A web editor (hereinafter used interchangeably with âeditorâ) similarly is a software application for the creation and editing of web content that is presented by a browser.
While web pages may contain a variety of multimedia content, they were originally designed to represent real-world documents; that is, two-dimensional sheets of paper containing text and image content. In keeping with the document analogy, all media content is generally laid out in boxes or as regions on a two-dimensional or â2Dâ page using a declarative language HTML (Hypertext Markup Language). An important aspect of HTML allows content on webpages to be linked to content on other web pages. The links when activated by users cause typical web browsers to present the linked web page in place of the current page or an additional document in new tab or window.
SUMMARY
In an aspect, there is provided a computer implemented method of linking a first virtual reality (VR) immersive space with a second VR immersive space, the method comprising: generating a portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space; associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website; rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space; providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and virtually placing a user in the second VR immersive space when the portal is selected by the user.
In a particular case, selection by the user comprises having the user virtually walk through the portal.
In another case, a GL Shading Language defines the appearance of the portal.
The method of claim 1 , wherein generating the portal comprises defining position vectors and direction vectors for the portal in the first VR immersive space.
In yet another case, generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
In yet another case, the portal is generated only when the user selects the internet link in the first VR immersive space.
In yet another case, providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
In another aspect, there is provided a system for linking a first virtual reality (VR) immersive space with a second VR immersive space, the system comprising: a database storing data associated with the first VR immersive space and the second VR immersive space; and a processing unit in communication with the database, the processing unit executable to perform: generating a portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space; associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website; rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space; providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and virtually placing a user in the second VR immersive space when the portal is selected by the user.
In a particular case, selection by the user comprises having the user virtually walk through the portal.
In another case, a GL Shading Language defines the appearance of the portal.
In yet another case, generating the portal comprises defining position vectors and direction vectors for the portal in the first VR immersive space.
In yet another case, generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
In yet another case, the portal is generated only when the user selects the internet link in the first VR immersive space.
In yet another case, providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
In yet another case, the database is located on a webserver.
These and other aspects are contemplated and described herein. It will be appreciated that the foregoing summary sets out representative aspects of a method and system to assist skilled readers in understanding the following detailed description.
DESCRIPTION OF THE DRAWINGS
A greater understanding of the embodiments will be had with reference to the Figures, in which:
FIG. 1 is a block diagram illustrating a system for generating and navigating interactive linked virtual reality (VR) spaces;
FIG. 2 is a block diagram illustrating various physical components of a VR system;
FIG. 3 is a block diagram illustrating various definitions contained in a VR database;
FIG. 4 is a flowchart illustrating a method for generating and navigating interactive linked virtual reality (VR) spaces;
FIG. 5 is a flowchart illustrating an exemplary method 1300 of translating a conventional web page into an immersive 3D space;
FIG. 6 is an exemplary web page rendered as a 3D space;
FIG. 7 is an exemplary orientation of images for defining a 3D space; and
FIG. 8 illustrates top-down views of various exemplary space geometries.
DETAILED DESCRIPTION
For simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the Figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the embodiments described herein. Also, the description is not to be considered as limiting the scope of the embodiments described herein.
Various terms used throughout the present description may be read and understood as follows, unless the context indicates otherwise: âorâ as used throughout is inclusive, as though written âand/orâ; singular articles and pronouns as used throughout include their plural forms, and vice versa; similarly, gendered pronouns include their counterpart pronouns so that pronouns should not be understood as limiting anything described herein to use, implementation, performance, etc. by a single gender; âexemplaryâ should be understood as âillustrativeâ or âexemplifyingâ and not necessarily as âpreferredâ over other embodiments. Further definitions for terms may be set out herein; these may apply to prior and subsequent instances of those terms, as will be understood from a reading of the present description.
Any module, unit, component, server, computer, terminal, engine or device exemplified herein that executes instructions may include or otherwise have access to computer readable media such as storage media, computer storage media, or data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Computer storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, module, or both. Any such computer storage media may be part of the device or accessible or connectable thereto. Further, unless the context clearly indicates otherwise, any processor or controller set out herein may be implemented as a singular processor or as a plurality of processors. The plurality of processors may be arrayed or distributed, and any processing function referred to herein may be carried out by one or by a plurality of processors, even though a single processor may be exemplified. Any method, application or module herein described may be implemented using computer readable/executable instructions that may be stored or otherwise held by such computer readable media and executed by the one or more processors.
To provide a more flexible presentation space for emerging web content such as panoramic and stereo images and video, three dimensional (â3Dâ) objects, audio, animations, medical imaging, geographical and other spatial data, the following embodiments can interpret web pages as immersive spaces. As described herein, a link analogously can be represented by a portal, wormhole, or rip in the ether that connects two web spaces. The following embodiments describe the design and implementation of an immersive browser that allows the flexible multi-dimensional presentation of multimedia web content. A preferred embodiment of this browser is suitable for use with Virtual Reality (âVRâ), Augmented Reality (âARâ) or mixed reality displays.
Conventional solutions for VR experiences is simply to render web pages as traditionally laid out two-dimensional (â2Dâ) documents on a flat plane in front of the user's face on a VR or AR display. This is both unimaginative and an ineffective use of the spatial viewing capabilities of VR or AR technology. The present embodiments can provide a comprehensive solution for presenting web content in an immersive, social and collaborative VR or AR setting.
Additionally, conventional internet browsers, for example, have not changed fundamentally from their original design, around 20 year ago, whereby internet content was conceptualized as a document captured by the DOM (Document Object Model) from web pages authored using HTML and variants, with scripts for dynamic content. This type of design was pertinent for the time because internet content was mostly linked text and images. However, now as technology progresses, a technological problem arises in developing user experiences with richer 3D spatial content. For example, the internet of things makes even the physical location of web pages and programs meaningful spatially.
The present embodiments address the internet-related technological problem of developing spatial experiences by, for example, computationally interpreting webpages as spaces and links as portals. Conventional approaches to add spatiality to the internet are to essentially adapt Hypertext Markup Language (âHTMLâ) and Document Object Model (âDOMâ) to represent a 3D world. However these approaches lack markup that are more developer friendly and efficient for 3D space-time content. In the present embodiments, space-time representation of web pages are provided such that spaces automatically better lend themselves to a spatial and social setting; i.e., browsing art in a virtual art museum.
Applicant recognized the substantial advantages of having web pages, both previously developed (âlegacyâ) and developed in accordance with the present mark-up language, re-imagined as content presented as 3D space-time entities. In some cases, these entities can be advantageously linked together by portals, as described herein. For a legacy webpage, there is described herein a translator to re-interpret the document into a 3D experience.
In one aspect, a markup language that is a superset of HTML is provided, enabling the definition of web pages as immersive spaces that can be manipulated and reconfigured. The markup language comprises one or more asset definitions, spatial environment definitions and a layout instantiating the defined assets within the spatial environment, to altogether comprise the immersive space. Dynamic aspects of these spaces are controlled using a scripting language and events based on time and user interaction with the spaces. Immersive spaces may also be authored using pre-compiled modules and an API that provides functionality similar to that provided by the markup and scripting language. The physical location of the web pages may themselves have a meaningful location in the virtual world. An example of such a web page might be a webpage that illustrates the design and workings of smartphone. The web page itself can be physically hosted on a smartphone, allowing this web page to be presented in a virtual world with additional context of its physical location.
In another aspect, the markup and scripting can be used to define page âtranslatorsâ that ascribe semantics to pre-existing web pages, so that can they be re-interpreted as immersive 3D spaces instead of 2D documents as originally intended.
In a representative example, as shown in FIG. 8 , a virtual or immersive space is a 3D world housing virtual rooms within which internet content is made available and, more particularly, comprises a virtual environment that contains a 3D layout of a combination of links to other immersive spaces and assets or multidimensional media content such as 3D objects, lights, viewpoints, data for medical, scientific or information visualization, immersive sound and video, and even existing legacy 2D layouts of text and images. Most conventional approaches to accessing such web content in virtual reality (most typically accessed through a wearable VR Head Mounted Display (âHMDâ)) comprise first embedding all content within boxes or regions of a traditional document layout of a 2D web browser, and then visualizing the browser in the HMD and, perhaps, incorporating head movements and other gestures as an aide to navigation. However, such an approach can be considered as no more than bringing a traditional computer screen closer to the user's eyes via the wearable VR display.
In the present systems and methods, an application enables the user to be advantageously immersed in a virtual world, having a plurality of programmed virtual spaces, which is navigable in 3D, and is able to represent 3D content as well as legacy 2D content. The application can further enable the user to reconfigure spaces by dynamically and interactively manipulating the environment and assets in the environment.
The embodiments described herein provide methods and systems for generating and navigating interactive linked virtual reality spaces. FIG. 1 shows an overall architecture of various aspects of the present disclosure. A VR system 20 for providing an interactive virtual reality space in accordance with an embodiment and its operational setting is shown. VR system 20 stores a downloadable computer program product (referred to herein as an âapplicationâ) that can be provided to client computers 24 . VR system 20 further stores VR experience definitions (referred to herein as âdefinitionsâ) that define the space-time interpretation of web pages, termed VR experiences (referred to herein as âexperiencesâ). The application, once downloaded and executed by client computers 24 , permits the generation and navigation of VR experiences, which comprises retrieving the definitions from VR system 20 .
The definitions for an experience comprise a declaration of the environment of the VR experience, assets within the environment, space, avatar definitions, as well as links to other experiences. The linking between experiences enables user navigation in a VR world. In particular embodiments, navigation between experiences is carried out via virtual portals present in their environments and specified in the definitions.
The assets may comprise portals, media assets, and decorative assets. The media assets could be any of text, image, video, audio, 3D objects or other consumable information-based data. Decorative assets are similar in type to media assets, the difference being that role of the assets in the environments is more cosmetic than content intended to communicate some information.
In FIG. 1 , a client computing device 24 is in communication with VR system 20 over the Internet 28 . Client computing device 24 can be any type of computing device that is able to execute a VR application that causes client computing device 24 to connect to VR system 20 over a communications network to retrieve VR content, and then render the VR content to present a VR space on a display device. Examples of suitable computing devices include personal computers, laptop computers, tablet computers, smartphones with sufficient processing/graphical power, game consoles, etc. The viewing of the VR content may be through a traditional computer monitor, tablet display, smartphone display or linked or standalone visor 32 (also referred to as a head mounted display). The content may also be viewed in AR using transparent or translucent head mounted displays, lightfield projectors or other holographic displays. Users interact with the AR or VR content within the application via a variety of input devices including mouse, keyboard, microphone, gamepad, multiple degree of freedom game controller, and devices that track and recognize free-form hand, face and body gestures.
For the purposes of ease of understanding, and without limiting the scope of the functionality of the application, the application may comprise browsing and editing modes. The browsing mode may be understood as a VR browser. It will be understood that such an application may be equipped with a 3D rendering engine, which may for example be a third-party 3D rendering engine, for example OpenGL, WebGL, Unity⢠or Unrealâ¢, and the client computing device 24 can be configured to execute such a 3D rendering engine to provide a 3D rendered display to a user.
FIG. 2 shows various physical components of VR system 20 of FIG. 1 . As will be appreciated, while VR system 20 is illustrated as being a single physical computing device, it can alternatively be two or more computing devices acting cooperatively to provide the functionality described.
As shown, VR system 20 has a number of physical and logical components, including a central processing unit (âCPUâ) 60 , random access memory (âRAMâ) 64 , an input interface 68 , an output interface 72 , a network interface 76 , non-volatile storage 80 , and a local bus 84 enabling CPU 60 to communicate with the other components. CPU 60 executes an operating system and other software. In some cases, the CPU 60 could include more than one CPU or other processing units such as a graphical processing unit (âGPUâ). RAM 64 provides relatively responsive volatile storage to CPU 60 . Input interface 68 enables an user to interact with the VR system 20 via a keyboard, a mouse, a microphone, a gamepad controller, a touchpad, visual trackers for in-air human gestures (for example a Kinectâ¢), pressure and haptic sensors, or the like. Output interface 72 enables VR system 20 to output information in audio, visual haptic or other forms, such as via a speaker, a display, and a force generating device. Network interface 76 permits wired or wireless communication with other systems, such as client computing device 24 . Non-volatile storage 80 stores computer readable instructions for implementing the operating system, and other components, as well one or more versions of the application for execution on client computing devices, a VR database 84 , and any data used by other elements.
VR database 84 contains a number of definitions that are illustrated in FIG. 3 that can be combined in 3D space and time to create web pages presented as VR experiences as shown in FIG. 6 . In particular, VR database 84 stores a set of VR environment definitions 104 , a set of asset definitions 108 , and avatar definitions 105 . Each of the VR definitions 104 defines a VR environment, which includes a space-time framework, and an instantiation and layout of objects, lights, viewpoints, zones, semantic groups, links or portals to other VR spaces, images, text, audio, haptics, multimedia content, and other virtual entities that are to be used in the VR environment. The space-time framework defines the physical parameters and 3D constraints of the environment. Physical parameters such as a gravity, friction and atmosphere govern the virtual physics of objects and users navigating the immersive VR experience, and a temporal clock that relates the inception and passage of time in a VR experience, relative to other VR spaces. Physical constraints include bounds such as terrains, horizons, encompassing skies, and can include walls, floors, ceilings, pillars, steps and other geometry that typically define a static background or virtual set for the VR experience. Links between webpages can be represented as portals, wormholes or rips in the ether and are used to link and navigate between VR experiences. Portals have a number of attributes that define their shape, visual appearance and controls that determine the space-time entry and exit into and from linked VR experiences. Avatar definitions 105 define the parameters and characteristics of avatars represented in the 3D space.
Navigation via links between webpages, which can be represented in the VR space as rooms, is accomplished by accessing portals, wormholes, specialized doors, rips in the ether, or the like (collectively called âportalsâ) (as further described herein with respect to the description of the mark-up language). The placement of portals within rooms permits navigation between rooms. Each portal is assigned a destination. As an example, a portal may be defined by a URL of the destination room. When a user steps into or selects the portal, the user may be virtually transported to the destination room. An exemplary portal 1202 is shown in FIG. 6 linking the exemplary space 1204 to another destination space 1206 .
This is accomplished by the method 1100 of FIG. 4 . At block 1102 , the user steps into or selects the portal. At block 1104 , the application associates the user action with the URL and at block 1106 obtains the destination room definition from a source, for example a web server. The application renders the destination room at block 1108 and places the user at the destination room entrance with the orientation defined in the destination room definition at block 1110 .
Asset definitions 108 , typically relate to content stored in external files that are instantiated one or more times within a VR space. Assets can be 3D objects, shaders, particles, animations, images, video, audio, text, traditional 2D web pages, program scripts or other multimedia content types.
Avatars are 3D objects that are a representation of users in VR experiences. Loosely, like a cursor on a 2D page, an avatar typically marks the current location of a user in a VR space. In a preferred embodiment, an avatar is typically rendered as an articulated anthropomorphic character, with a range of gestures and movements to echo physical user interaction. In one embodiment a user may choose to be invisible or manifest virtually as multiple avatars. Avatars that are controlled programmatically and do not correspond to human users are referred to as Bots. Avatars whose behavior over space and time is recorded and played back in VR spaces are referred to as Ghosts. Avatars, Bots and Ghosts can further populate VR experiences and are the medium of interaction between users and programs on web pages. Two exemplary avatars 1208 are shown in the space 1204 of FIG. 6 .
The distinction between 3D geometry or other multimedia that defines a VR environment, an asset, or an avatar is more a matter of intended purpose in a VR experience, rather than a property of the 3D geometry or multimedia content itself. For example a pillar in the form of a statue of a Greek God could be incorporated into a VR experience as any of the VR Environment, an Asset, or an Avatar.
VR experiences are configured to permit real-time manipulation programmatically, or through user interaction with the application. In the former, VR experiences can be manipulated by editing and saving markup language, asset or script files, or directly using a 2D text editor in the application itself. In the latter, one or more input devices such as a mouse, keyboard, game controller, or tracked user gestures, can be used within the application to directly select and manipulate in space and time, the VR environment, assets and avatars. For example, the âwâ key can be used to move forwards in the space, the âaâ key can be used to strafe left, the âsâ key can be used to move backwards, the âdâ key can be used to strafe right, the âspaceâ key can be used to jump, and the like.
The VR experience markup language and scripting definitions described herein advantageously allow web pages (including existing HTML web pages) to be laid out as 3D spaces interconnected by portals.
Examples of applications of such VR experiences can include, for example, computer games, virtual expos and meeting rooms, virtual theaters and sporting arenas for streaming live immersive events, virtual buildings and spaces, built and staged to present various architectural and design options, virtual malls to provide a virtual extension to a typical e-commerce shopping site, or the like.
As described herein, an application to, for example, interactively view, annotate, inspect and edit the VR experiences, defined using the markup and scripting languages described herein, can be built as a stand-alone application, or as one that works within an existing browser (for example, Chromeâ¢, Firefox⢠or Safariâ¢).
In a further aspect, a VR translator is provided to translate conventional webpages into an immersive 3D space (as further described herein with respect to the description of the mark-up language). For example, one version of a VR translation translates or converts traditional web pages into a space that has a web-surface (a surface that represents a functional 2D web page, that can be embedded in 3D by rendering it on a flat plane or texture mapped onto the surface of an arbitrary 3d object) on which the HTML document is displayed. In further embodiments, more complex translators can use a script to access various elements from the document object model of a conventional webpage, and map these elements to meaningful assets embedded in a 3D space. Finally a web page can be authored with our markup along with (or without) traditional HTML content, to provide a dual document-experience representation allowing content to be presented as optimally desired using a mix of 2D and 3D, that appears differently on a conventional browser and a space-time browser as described in this invention.
As an example of a translation, a site translator can convert or reinterpret the content at a video hosting site (such as a âyoutube.comâ) so it is dynamically presented as videos playing on the virtual screen of a 3D movie theater. FIG. 5 illustrates a flowchart of an exemplary method 1300 of translating a conventional web page into an immersive 3D space. At 1302 , the content or elements of the conventional web page are analyzed or inspected for type, such as determining whether there are Document Object Model (âDOMâ) elements of interest worth translating and extracting those elements. Such elements may include, for example, embedded videos, audio, images or text. At 1304 , the VR system 20 automatically determines the optimum 3D space to represent such elements. For example, determining that a conventional webpage with image and video content can be presented as a space (room) resembling an art gallery. At 1306 , the VR system 20 then generates that determined space. At 1308 , the VR system 20 automatically places the DOM elements in the space congruent with the space to make an immersive experience. In the above example, placing 2D elements of the conventional images and videos along walls of the room for hosting the image or video content. At 1310 , the user's avatar is placed inside the generated space.
As described in the following exemplary embodiments, certain mark-up, scripting and shading language definitions may be used to implement the VR experience described herein.
The following is an exemplary VR experience definition which is particularly suitable for presenting web content in an immersive VR setting. However, a person of skill will recognize that the definition is not limited to the display of web content.
In this embodiment, the VR experiences 104 are coded using an eXtensible Markup Language (âXMLâ) like structure that is an extension of HyperText Markup Language (âHTMLâ). The VR experience is comprised of environmental geometry, physical space-time parameters like gravity or friction, and other configuration parameters. The other parameters can include, for example, zones of interest in space and time, a predetermined maximum number of avatars allowed at any time in the space or within a zone, assets such as 3D objects, images, and other media content presented in the space, or links or portals to other spaces and avatars that populate the VR experience. Shading languages such as the GL Shading Language (âGLSLâ) can define the appearance of rendered content, and a scripting language such as a JavaScript (âJSâ) can define dynamic behavior of the VR space over time and in response to user input such as a mouse click.
In one aspect, the application may be configured to automatically generate a 3D rendered version of legacy 2D HTML web pages. The application may read the content of ordinary HTML web pages, and arrange the content in particular patterns on pre-defined geometry. However, in another aspect and as will now be further described, specified VR definition tags provided by the XML like specification can be added to an HTML web page source code or file to create user authored 3D VR experiences. Preferably, the specified VR definition tag is configured to be ignored by incompatible browsers, such as legacy 2D browsers, such that a single version of the web page source file is readable by 2D browsers and the application described herein.
Virtual environments are defined by embedding an HTML-like XML within an existing HTML file. A barebones HTML file has the following structure, with a head and a body:
<html>
<head>
</head>
<body>
</body>
</html>
In the present system, the head is important for two reasons. The first is because it is used as the title for the experience. The second purpose of the head tag is that it can optionally be placed with a âmetaâ tag to cause the application to display a particular alternate traditional web page at the request of the user.
<html>
<head>
<title>Example title</title>
<meta http-equiv=ârefreshâ content=â0; url=http://janusvr.com/
index2.htmlâ />
</head>
<body>
</body>
</html>
The XML importantly comprises a specified VR definition tag indicating that a virtual experience is being specified. In the present disclosure, the specified VR definition tag and resulting VR space are referred to as an âexperienceâ. Within the âexperienceâ tag, aspects of the immersive space, can be specified, including the environment, space-time configuration parameters, and contents which instantiate the assets. It will be appreciated that the nomenclature âexperienceâ is trivial and could be replaced by any other suitable term that is not already defined in the XML.
An experience is created within an existing HTML page by placing the experience tag within the body tag, as in the following example:
<html>
<head>
<title>Example title</title>
</head>
<body>
<experience> </experience>
</body>
</html>
Elements within an experience may appear as text within the page. To suppress this, the experience tags can be encapsulated using standard HTML comment tags. The application will still detect the VR experience, but other existing browsers will ignore this content. An example is:
<html>
<head>
<title>Example title</title>
</head>
<body>
<!--
<experience> </experience>
-->
</body>
</html>
The experience tag enables the inclusion of various assets. URLs may be specified which inform the application where different assets can be obtained. These assets may be stored on a web server or any other storage that is network accessible. Assets and content typically stored in other files such as 3D objects, images, video, and legacy web pages presented using a 2D document layout, can be pre-defined using asset tags, for instantiation and reuse in an experience, or directly incorporated within the experience.
Additionally, pre-defined assets can be used as a content palette within the application for building or editing an experience, by interactively creating and manipulating instances of these assets directly within the experience.
All assets may be defined within an assets tag as in the following:
<html>
<head>
<title>Example title</title>
</head>
<body>
<experience>
<assets>
</assets>
</experience>
</body>
</html>
All assets regardless of type may be associated with an identifier and a source URL. Examples of assets include images, audio, video,
CLAIMS
Claims ( 29 )
The invention claimed is:
1. A computer implemented method of linking a first virtual reality (VR) immersive space with a second VR immersive space, the method comprising:
generating a portal in the first VR immersive space, the generating of the portal comprising defining position vectors for the portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space;
associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website;
rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space;
providing a preview of the second VR immersive space on a display surface of the portal located in the first VR immersive space; and
virtually placing a user in the second VR immersive space when the portal is selected by the user.
2. The method of claim 1 , wherein selection by the user comprises having the user virtually walk through the portal.
3. The method of claim 1 , wherein a GL Shading Language defines the appearance of the portal.
4. The method of claim 1 , wherein generating the portal further comprises defining direction vectors for the portal in the first VR immersive space.
5. The method of claim 1 , wherein generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
6. The method of claim 1 , wherein the portal is generated only when the user selects the internet link in the first VR immersive space.
7. The method of claim 1 , wherein providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
8. The method of claim 1 , wherein the portal is a two-dimensional object and the display surface is a surface of the two-dimensional object.
9. The method of claim 8 , wherein the two-dimensional object is in the shape of a square, oval, or circle.
10. The method of claim 1 , wherein the portal is a three-dimensional object and the display surface is at least one of the surfaces on the three-dimensional object.
11. The method of claim 1 , wherein the display surface has two or more hotspots each associated with separate respective regions of the display surface, and when selected, each hotspot associated with virtually placing the user in the second VR immersive space at a different virtual location in the second VR immersive space.
12. The method of claim 1 , wherein selection of the portal by the user comprises the user touching the portal.
13. The method of claim 1 , wherein selection of the portal by the user comprises the user performing a predetermined hand gesture.
14. The method of claim 1 , after virtually placing the user in the second VR immersive space, the method further comprising:
generating a return portal in the second VR immersive space;
providing a preview of the first VR immersive space on a display surface of the return portal located in the second VR immersive space; and
virtually placing the user in the first VR immersive space when the return portal is selected by the user.
15. A system for linking a first virtual reality (VR) immersive space with a second VR immersive space, the system comprising:
a database storing data associated with the first VR immersive space and the second VR immersive space; and
a processing unit in communication with the database, the processing unit executable to perform:
generating a portal in the first VR immersive space, the generating of the portal comprising defining position vectors for the portal in the first VR immersive space, the first VR immersive space having a first website displayed on a surface of the first VR immersive space;
associating an internet link to the second VR immersive space with the portal, the internet link being part of the first website to link to a second website;
rendering the second VR immersive space, the second VR immersive space having the second website displayed on a surface of the second VR immersive space;
providing a preview of the second VR immersive space on a surface of the portal located in the first VR immersive space; and
virtually placing a user in the second VR immersive space when the portal is selected by the user.
16. The system of claim 15 , wherein selection by the user comprises having the user virtually walk through the portal.
17. The system of claim 15 , wherein a GL Shading Language defines the appearance of the portal.
18. The system of claim 15 , wherein generating the portal further comprises defining direction vectors for the portal in the first VR immersive space.
19. The system of claim 15 , wherein generating the portal comprises defining a linking position in the second VR immersive space for the portal, and wherein virtually placing the user in the second VR immersive space comprises virtually placing the user at the linking position.
20. The system of claim 15 , wherein the portal is generated only when the user selects the internet link in the first VR immersive space.
21. The system of claim 15 , wherein providing the preview of the second VR immersive space comprises displaying at least a portion of the second website on at least portion of the surface of the portal.
22. The system of claim 15 , wherein the database is located on a webserver.
23. The system of claim 15 , wherein the portal is a two-dimensional object and the display surface is a surface of the two-dimensional object.
24. The system of claim 23 , wherein the two-dimensional object is in the shape of a square, oval, or circle.
25. The system of claim 15 , wherein the portal is a three-dimensional object and the display surface is at least one of the surfaces on the three-dimensional object.
26. The system of claim 15 , wherein the display surface has two or more hotspots each associated with separate respective regions of the display surface, and when selected, each hotspot associated with virtually placing the user in the second VR immersive space at a different virtual location in the second VR immersive space.
27. The system of claim 15 , wherein selection of the portal by the user comprises the user touching the portal.
28. The system of claim 15 , wherein selection of the portal by the user comprises the user performing a predetermined hand gesture.
29. The system of claim 15 , after virtually placing the user in the second VR immersive space, the processing unit further executable to perform:
generating a return portal in the second VR immersive space;
providing a preview of the first VR immersive space on a display surface of the return portal located in the second VR immersive space; and
virtually placing the user in the first VR immersive space when the return portal is selected by the user.
US15/801,927
2016-11-10
2017-11-02
Method and system for linking a first virtual reality (VR) immersive space with a second VR immersive space
Active
2038-02-08
US10593105B2
( en )
Priority Applications (1)
Application Number
Priority Date
Filing Date
Title
US15/801,927
US10593105B2
( en )
2016-11-10
2017-11-02
Method and system for linking a first virtual reality (VR) immersive space with a second VR immersive space
Applications Claiming Priority (2)
Application Number
Priority Date
Filing Date
Title
US201662420146P
2016-11-10
2016-11-10
US15/801,927
US10593105B2
( en )
2016-11-10
2017-11-02
Method and system for linking a first virtual reality (VR) immersive space with a second VR immersive space
Publications (2)
Publication Number
Publication Date
US20190005717A1
US20190005717A1 ( en )
2019-01-03
US10593105B2
true
US10593105B2 ( en )
2020-03-17
Family
ID=64738155
Family Applications (2)
Application Number
Title
Priority Date
Filing Date
US15/801,927
Active
2038-02-08
US10593105B2
( en )
2016-11-10
2017-11-02
Method and system for linking a first virtual reality (VR) immersive space with a second VR immersive space
US15/801,918
Abandoned
US20190005716A1
( en )
2016-11-10
2017-11-02
Method and system for translating a legacy web page into a three-dimensional virtual reality (vr) immersive space
Family Applications After (1)
Application Number
Title
Priority Date
Filing Date
US15/801,918
Abandoned
US20190005716A1
( en )
2016-11-10
2017-11-02
Method and system for translating a legacy web page into a three-dimensional virtual reality (vr) immersive space
Country Status (1)
Country
Link
US
( 2 )
US10593105B2
( en )
Cited By (4)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US11087556B2
( en )
*
2019-03-26
2021-08-10
Siemens Healthcare Gmbh
Transferring a state between VR environments
US11301110B2
( en )
*
2018-12-27
2022-04-12
Home Box Office, Inc.
Pull locomotion in a virtual reality environment
US11789602B1
( en )
*
2022-04-18
2023-10-17
Spatial Systems Inc.
Immersive gallery with linear scroll
US20240297978A1
( en )
*
2023-03-03
2024-09-05
International Business Machines Corporation
Cascading navigational parameter from parent to child volumetric video
Families Citing this family (63)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US9792957B2
( en )
2014-10-08
2017-10-17
JBF Interlude 2009 LTD
Systems and methods for dynamic video bookmarking
US10582265B2
( en )
2015-04-30
2020-03-03
JBF Interlude 2009 LTD
Systems and methods for nonlinear video playback using linear real-time video players
US10460765B2
( en )
2015-08-26
2019-10-29
JBF Interlude 2009 LTD
Systems and methods for adaptive and responsive video
US11128853B2
( en )
2015-12-22
2021-09-21
JBF Interlude 2009 LTD
Seamless transitions in large-scale video
US11856271B2
( en )
2016-04-12
2023-12-26
JBF Interlude 2009 LTD
Symbiotic interactive video
US10867445B1
( en )
*
2016-11-16
2020-12-15
Amazon Technologies, Inc.
Content segmentation and navigation
US11294533B2
( en )
*
2017-01-26
2022-04-05
Huawei Technologies Co., Ltd.
Method and terminal for displaying 2D application in VR device
US10987587B2
( en )
*
2017-12-22
2021-04-27
Take-Two Interactive Software, Inc.
System and method for game object and environment generation
US20190279438A1
( en )
*
2018-03-09
2019-09-12
Progress Rail Locomotive Inc.
Systems and methods for servicing a vehicle
CN108959392B
( en )
*
2018-05-31
2020-11-10
åæ°å è¿ææ¯æéå ¬å¸
Method, apparatus and apparatus for displaying rich text on 3D model
US11601721B2
( en )
2018-06-04
2023-03-07
JBF Interlude 2009 LTD
Interactive video dynamic adaptation and user profiling
EP3598284A1
( en )
*
2018-07-18
2020-01-22
Hololab Sp. z o.o.
A method and a system for generating a multidimensional graphical user interface
US10963205B2
( en )
*
2018-10-31
2021-03-30
Royal Caribbean Cruises Ltd.
Augmented reality state room
US10983662B2
( en )
*
2019-04-01
2021-04-20
Wormhole Labs, Inc.
Distally shared, augmented reality space
TWI704495B
( en )
2019-04-03
2020-09-11
å®ç¢è¡ä»½æéå ¬å¸
Chromebook computer and webvr execution method thereof
US11189097B2
( en )
*
2019-06-14
2021-11-30
In It Vr, Llc
Simulated reality transition element location
CN114127795A
( en )
2019-07-04
2022-03-01
å®å°¼æ´¾æ©æéå ¬å¸
Method, system, and non-transitory computer-readable recording medium for supporting experience sharing between users
CN110675211A
( en )
*
2019-08-16
2020-01-10
æµæ±éæå¤è½æºç§ææéå ¬å¸
Merchant virtual display method and system based on map database
EP4088439B1
( en )
*
2020-01-06
2025-09-10
Pixovr, Corp.
Methods and systems configured for distribution of vr/mr/ar/xr content to end user devices via logical relationships and related management of end user devices
US12096081B2
( en )
2020-02-18
2024-09-17
JBF Interlude 2009 LTD
Dynamic adaptation of interactive video players using behavioral analytics
US11550446B2
( en )
*
2020-04-06
2023-01-10
Samsung Electronics Co., Ltd.
Systems and methods for viewing webpages in extended reality environments
WO2021206408A1
( en )
*
2020-04-06
2021-10-14
Samsung Electronics Co., Ltd.
Electronic device and methods for viewing webpages in extended reality environments
US12047637B2
( en )
2020-07-07
2024-07-23
JBF Interlude 2009 LTD
Systems and methods for seamless audio and video endpoint transitions
CN111951156B
( en )
*
2020-08-24
2021-08-03
æå·å°å½±åæ°ç§æè¡ä»½æéå ¬å¸
Method for drawing photoelectric special effect of graph
US10979672B1
( en )
*
2020-10-20
2021-04-13
Katmai Tech Holdings LLC
Web-based videoconference virtual environment with navigable avatars, and applications thereof
US11714954B1
( en )
*
2020-12-11
2023-08-01
Amazon Technologies, Inc.
System for determining reliability of extracted data using localized graph analysis
US11689696B2
( en )
*
2021-03-30
2023-06-27
Snap Inc.
Configuring participant video feeds within a virtual conferencing system
EP4334804A1
( en )
2021-05-07
2024-03-13
Snap Inc.
Virtual tastings and guided tours for augmented reality experiences
WO2022251136A1
( en )
*
2021-05-27
2022-12-01
Peer Inc
System and method for using portal systems in augmented reality virtual environments
US11882337B2
( en )
2021-05-28
2024-01-23
JBF Interlude 2009 LTD
Automated platform for generating interactive videos
CN115423914A
( en )
*
2021-05-31
2022-12-02
å京åè·³ç½ç»ææ¯æéå ¬å¸
Particle rendering method and device
US11734893B2
( en )
*
2021-08-17
2023-08-22
Sony Interactive Entertainment LLC
Curating virtual tours
US12159352B2
( en )
*
2021-08-30
2024-12-03
Bsset Llc
Extended reality movement platform
US12155897B2
( en )
*
2021-08-31
2024-11-26
JBF Interlude 2009 LTD
Shader-based dynamic video manipulation
US12549818B2
( en )
2021-08-31
2026-02-10
JBF Interlude 2009 LTD
Shader-based dynamic video manipulation
US11934477B2
( en )
2021-09-24
2024-03-19
JBF Interlude 2009 LTD
Video player integration within websites
US11934569B2
( en )
*
2021-09-24
2024-03-19
Apple Inc.
Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12051169B2
( en )
*
2021-10-14
2024-07-30
Roblox Corporation
Interactive engagement portals within virtual experiences
US11783555B2
( en )
2021-11-16
2023-10-10
Peer Inc
System and method for transferring content from one virtual environment to another
US12238456B2
( en )
*
2022-01-24
2025-02-25
Zoom Video Communications, Inc.
Virtual expo booth previews
US11907415B2
( en )
*
2022-02-25
2024-02-20
Htc Corporation
Method, electronic device, and non-transitory computer readable storage medium for interacting with virtual reality environment
US12423927B2
( en )
*
2022-02-25
2025-09-23
Htc Corporation
Method and device for destination selection of virtual scenes
US20240177441A1
( en )
*
2022-03-16
2024-05-30
Build A Rocket Boy Games Ltd.
Informational interactive environment transition
US11836205B2
( en )
*
2022-04-20
2023-12-05
Meta Platforms Technologies, Llc
Artificial reality browser configured to trigger an immersive experience
CN114842109B
( en )
*
2022-04-25
2025-02-18
å京åç¿å®è¿æ°æ®ç§æè¡ä»½æéå ¬å¸
A method, device, electronic device and medium for implementing multi-dimensional analysis
EP4544382A1
( en )
*
2022-06-22
2025-04-30
Meta Platforms Technologies, LLC
Virtual personal interface for control and travel between virtual worlds
US11755180B1
( en )
2022-06-22
2023-09-12
Meta Platforms Technologies, Llc
Browser enabled switching between virtual worlds in artificial reality
US20230419617A1
( en )
2022-06-22
2023-12-28
Meta Platforms Technologies, Llc
Virtual Personal Interface for Control and Travel Between Virtual Worlds
US20230419627A1
( en )
*
2022-06-24
2023-12-28
Lowe's Companies, Inc.
Object modeling based on properties and images of an object
US20240037837A1
( en )
*
2022-07-28
2024-02-01
Katmai Tech Inc.
Automatic graphics quality downgrading in a three-dimensional virtual environment
WO2024035948A1
( en )
*
2022-08-11
2024-02-15
Peer Inc
System and method for enhanced portal systems in augmented reality virtual environments
US12277301B2
( en )
2022-08-18
2025-04-15
Meta Platforms Technologies, Llc
URL access to assets within an artificial reality universe on both 2D and artificial reality interfaces
US12506810B2
( en )
*
2022-09-12
2025-12-23
Bank Of America Corporation
System and method for integrating real-world interactions within a metaverse
US12175603B2
( en )
2022-09-29
2024-12-24
Meta Platforms Technologies, Llc
Doors for artificial reality universe traversal
US12218944B1
( en )
*
2022-10-10
2025-02-04
Meta Platform Technologies, LLC
Group travel between artificial reality destinations
US12547237B1
( en )
2022-10-24
2026-02-10
Meta Platforms Technologies, Llc
Artificial reality input for two-dimensional virtual objects
TWI856557B
( en )
2023-03-13
2024-09-21
è±å±¬ç¶ç¾äº¬ç¾¤å³¶åé£ææ·æè³è¡ä»½æéå ¬å¸
Immersive exhibition image arrangement system and immersive exhibition image arrangement preview method
US20240404177A1
( en )
*
2023-06-04
2024-12-05
Apple Inc.
Portal content for communication sessions
US20250086898A1
( en )
*
2023-09-08
2025-03-13
Meta Platforms Technologies, Llc
Methods Of Efficiently Navigating And Performing Persistent Interactions Within Different Metaverse Environments, And Systems And Devices Thereof
CN117311708B
( en )
*
2023-09-18
2024-04-05
ä¸æç 享ç§æè¡ä»½æéå ¬å¸
Dynamic modification method and device for resource display page in 3D scene of webpage end
CN117406867B
( en )
*
2023-12-15
2024-02-09
å°èçµååå¡æéè´£ä»»å ¬å¸
Webpage-based augmented reality interaction method and device
CN119337014A
( en )
*
2024-12-19
2025-01-21
å京è¹å®ç§ææéå ¬å¸
A browser web page spatialization method and device
CN119357499B
( en )
*
2024-12-23
2025-04-08
æ¹åèææ°æºèºæ¯ç§ææéè´£ä»»å ¬å¸
Website dynamic light and shadow rendering processing method, device, storage medium and electronic device
Citations (4)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20170160815A1
( en )
*
2015-12-03
2017-06-08
Google Inc.
Teleportation in an augmented and/or virtual reality environment
US20170169610A1
( en )
*
2015-12-09
2017-06-15
Microsoft Technology Licensing, Llc
Third party holographic portal
US20170228931A1
( en )
*
2016-02-08
2017-08-10
Google Inc.
Limited field of view in virtual reality
US20180061138A1
( en )
*
2016-08-31
2018-03-01
Factual VR, Inc.
Virtual reality system
2017
2017-11-02
US
US15/801,927
patent/US10593105B2/en
active
Active
2017-11-02
US
US15/801,918
patent/US20190005716A1/en
not_active
Abandoned
Patent Citations (4)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US20170160815A1
( en )
*
2015-12-03
2017-06-08
Google Inc.
Teleportation in an augmented and/or virtual reality environment
US20170169610A1
( en )
*
2015-12-09
2017-06-15
Microsoft Technology Licensing, Llc
Third party holographic portal
US20170228931A1
( en )
*
2016-02-08
2017-08-10
Google Inc.
Limited field of view in virtual reality
US20180061138A1
( en )
*
2016-08-31
2018-03-01
Factual VR, Inc.
Virtual reality system
Non-Patent Citations (2)
* Cited by examiner, â Cited by third party
Title
Oliveira et al., Synchronized World Embedding in Virtual Environments, Dec. 2004, IEEE Computer Society, 73-83 (Year: 2004).
*
Steinicke et al., Transitional Environments Enhance Distance Perception in Immersive Virtual Reality Systems, Oct. 2, 2009, ACM, 19-26 (Year: 2009).
*
Cited By (4)
* Cited by examiner, â Cited by third party
Publication number
Priority date
Publication date
Assignee
Title
US11301110B2
( en )
*
2018-12-27
2022-04-12
Home Box Office, Inc.
Pull locomotion in a virtual reality environment
US11087556B2
( en )
*
2019-03-26
2021-08-10
Siemens Healthcare Gmbh
Transferring a state between VR environments
US11789602B1
( en )
*
2022-04-18
2023-10-17
Spatial Systems Inc.
Immersive gallery with linear scroll
US20240297978A1
( en )
*
2023-03-03
2024-09-05
International Business Machines Corporation
Cascading navigational parameter from parent to child volumetric video
Also Published As
Publication number
Publication date
US20190005716A1
( en )
2019-01-03
US20190005717A1
( en )
2019-01-03
Similar Documents
Publication
Publication Date
Title
US20190005717A1
( en )
2019-01-03
Method and system for linking a first virtual reality (vr) immersive space with a second vr immersive space
CN113661471B
( en )
2023-11-24
Mixed rendering
US9934602B2
( en )
2018-04-03
System, method and device for three-dimensional modeling
Parisi
2014
Programming 3D Applications with HTML5 and WebGL: 3D Animation and Visualization for Web Pages
EP3719675A1
( en )
2020-10-07
Method, apparatus and device for displaying rich text on 3d model
MXPA06012368A
( en )
2007-01-17
Integration of three dimensional scene hierarchy into two dimensional compositing system.
Potenziani et al.
2018
Publishing and consuming 3D content on the web: A survey
Kersten et al.
2018
The historic wooden model of Solomonâs Temple: 3D recording, modelling and immersive virtual reality visualisation
Dirksen
2023
Learn Three. js: Program 3D animations and visualizations for the web with JavaScript and WebGL
KR20090000729A
( en )
2009-01-08
Web-based Cyber Model House Implementation System and Its Method
Baglivo et al.
2013
X3D/X3DOM, Blender Game Engine and OSG4WEB: open source visualisation for cultural heritage environments
Nemtinov et al.
2020
Development of virtual tours of memorable places associated with the residency and activities of famous personalities
CN120633605A
( en )
2025-09-12
Document processing method, device, equipment, medium and program product
CN114816411B
( en )
2025-10-24
Augmented reality model conversion method, device, equipment and storage medium
Champion
2023
Mixed histories, augmented pasts
Ko et al.
2008
Interactive web-based virtual reality with Java 3D
Perticarini
2024
From the virtual model to the visualization
Roberts
2023
The AR/VR Technology Stack: A Central Repository of Software Development Libraries, Platforms, and Tools
Ehtemami et al.
2021
Overview of visualizing historical architectural knowledge through virtual reality
Kim et al.
2000
Scene Graph for Dynamic Virtual Environment: Spangraph
Abate
2015
Graph Based Pre-Rendered Approach to Virtual Reality for Cultural Heritage Applications
Liu et al.
2009
A 3D display system for cloth online virtual fitting room
de Oliveira Monteiro et al.
2022
Department of Information Science and Technology
Georgiev et al.
2013
3D Environment for Virtual Collections
Pu et al.
2019
A Study of the 3D Animation Technology Based on the Internet
Legal Events
Date
Code
Title
Description
2017-11-02
FEPP
Fee payment procedure
Free format text : ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY
2018-01-24
FEPP
Fee payment procedure
Free format text : ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY
2019-03-19
STPP
Information on status: patent application and granting procedure in general
Free format text : NON FINAL ACTION MAILED
2019-10-28
STPP
Information on status: patent application and granting procedure in general
Free format text : RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER
2019-11-08
STPP
Information on status: patent application and granting procedure in general
Free format text : NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS
2020-01-24
AS
Assignment
Owner name : JANUS VR INC., CANADA
Free format text : ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SINGH, KARAN;MCCRAE, JAMES;SIGNING DATES FROM 20200110 TO 20200112;REEL/FRAME:051611/0945
Owner name : SINGH, KARAN, CANADA
Free format text : ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JANUS VR INC.;REEL/FRAME:051612/0229
Effective date : 20200112
2020-02-03
STPP
Information on status: patent application and granting procedure in general
Free format text : PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED
2020-02-26
STCF
Information on status: patent grant
Free format text : PATENTED CASE
2023-09-13
MAFP
Maintenance fee payment
Free format text : PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY
Year of fee payment : 4
<script ty