Conceptio › Archive › Google Patents

Google Patentsopen access

Display systems and methods for determining registration between a display and … — Magic Leap, Inc. (US11290706B2)

Magic Leap, Inc. · Google Patents

Google Patents · Patents · License: Open Access

Open Source ↗

lionelernestedwin magicleap

patent, google patents, intellectual property, US11290706B2, Magic Leap, Inc., Lionel Ernest Edwin, en, 2022

ABSTRACT

Abstract

A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

Description

PRIORITY CLAIM

This application is a continuation application of U.S. patent application Ser. No. 16/251,017, entitled âDISPLAY SYSTEMS AND METHODS FOR DETERMINING RESGISTRATION BETWEEN A DISPLAY AND A USER'S EYESâ filed on Jan. 17, 2019, which claims priority to: U.S. Patent Prov. App. 62/644,321, entitled âDISPLAY SYSTEMS AND METHODS FOR DETERMINING REGISTRATION BETWEEN A DISPLAY AND A USER'S EYESâ and filed on Mar. 16, 2018; U.S. Patent Prov. App. 62/618,559, entitled âEYE CENTER OF ROTATION DETERMINATION, DEPTH PLANE SELECTION, AND RENDER CAMERA POSITIONING IN DISPLAY SYSTEMSâ filed on Jan. 17, 2018; and U.S. Patent Prov. App. 62/702,849, entitled âEYE CENTER OF ROTATION DETERMINATION, DEPTH PLANE SELECTION, AND RENDER CAMERA POSITIONING IN DISPLAY SYSTEMSâ and filed on Jul. 24, 2018. Each of the above-recited applications is incorporated herein by reference in its entirety.

INCORPORATION BY REFERENCE

This application incorporates by reference the entirety of each of the following patent applications and publications: U.S. application Ser. No. 14/555,585 filed on Nov. 27, 2014, published on Jul. 23, 2015 as U.S. Publication No. 2015/0205126; U.S. application Ser. No. 14/690,401 filed on Apr. 18, 2015, published on Oct. 22, 2015 as U.S. Publication No. 2015/0302652; U.S. application Ser. No. 14/212,961 filed on Mar. 14, 2014, now U.S. Pat. No. 9,417,452 issued on Aug. 16, 2016; U.S. application Ser. No. 14/331,218 filed on Jul. 14, 2014, published on Oct. 29, 2015 as U.S. Publication No. 2015/0309263; U.S. Patent Publication No. 2016/0270656; U.S. Patent Publication No. 2015/0178939, published Jun. 25, 2015; U.S. Patent Publication No. 2015/0016777; U.S. patent application Ser. No. 15/274,823; U.S. patent application Ser. No. 15/296,869; U.S. patent application Ser. No. 15/717,747, filed Sep. 27, 2017; U.S. patent application Ser. No. 15/497,726, filed Apr. 26, 2017; U.S. Patent Publication No. 2017/0053165, published Feb. 23, 2017; U.S. Patent Publication No. 2017/0053166, published Feb. 23, 2017; U.S. application Ser. No. 15/341,760, filed on Nov. 2, 2016, published on May 4, 2017 as U.S. Publication No. 2017/0122725; U.S. application Ser. No. 15/341,822, filed on Nov. 2, 2016, published on May 4, 2017 as U.S. Publication No. 2017/0124928; U.S. Provisional Patent Application No. 62/618,559, filed Jan. 17, 2018; and U.S. Provisional Patent Application No. 62/642,761, filed Mar. 14, 2018.

FIELD

The present disclosure relates to display systems, including virtual reality and augmented reality display systems, and, more particularly, to systems and methods for evaluating fit of a display on a user.

BACKGROUND

Modern computing and display technologies have facilitated the development of systems for so called âvirtual realityâ, âaugmented realityâ, or âmixed realityâ experiences, wherein digitally reproduced images or portions thereof are presented to a user in a manner wherein they seem to be, or may be perceived as, real. A virtual reality, or âVRâ, scenario typically involves presentation of digital or virtual image information without transparency to other actual real-world visual input; an augmented reality, or âARâ, scenario typically involves presentation of digital or virtual image information as an augmentation to visualization of the actual world around the user; a mixed reality, or âMRâ, related to merging real and virtual worlds to produce new environments where physical and virtual objects co-exist and interact in real time. As it turns out, the human visual perception system is very complex, and producing a VR, AR, or MR technology that facilitates a comfortable, natural-feeling, rich presentation of virtual image elements amongst other virtual or real-world imagery elements is challenging. Systems and methods disclosed herein address various challenges related to VR, AR and MR technology.

SUMMARY

Various examples of registration observation and response in a mixed reality system are disclosed.

In some embodiments, a display system is provided for projecting light to an eye of a user to display virtual image content. The display system comprises a frame configured to be supported on a head of the user, a head-mounted display disposed on the frame, the display configured to project light into the user's eye to display virtual image content with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths at different periods of time, one or more eye-tracking cameras configured to image the user's eye, and processing electronics in communication with the display and the one or more eye-tracking cameras. The processing electronics are configured to determine a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras, determine whether the position of the eye is within a display registration volume of the head-mounted display system, and provide a notification based on determining whether the position of the eye is within the display registration volume, where the notification indicates at least that the display and the eye are not properly registered.

In some other embodiments, a display system is configured to project light to an eye of a user to display virtual image content. The display system comprises a frame configured to be supported on a head of the user; a head-mounted display disposed on the frame, the display configured to project light into the user's eye to display virtual image content with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths at different periods of time; one or more eye-tracking cameras configured to image the user's eye; and processing electronics in communication with the display and the one or more eye-tracking cameras. The processing electronics are configured to: determine a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras; determine whether the position of the eye is more than a first threshold distance outside of a viewing volume of the head-mounted display system; and in response to a determination that the position of the eye is more than the first threshold distance outside of the viewing volume of the head-mounted display system, provide feedback to the user indicating that the display and the eye are not properly registered for output.

In some other embodiments, a display system is provided for projecting light to an eye of a user to display virtual image content. The display system comprises a frame configured to be supported on a head of the user, a head-mounted display disposed on the frame, the display configured to project light into the user's eye to display virtual image content with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths at different periods of time, one or more eye-tracking cameras configured to image the user's eye, and processing electronics in communication with the display and the one or more eye-tracking cameras. The processing electronics are configured to determine whether the light projected by head-mounted display is properly registered by the eye of the user and provide feedback to the user if the head-mounted display is not properly adjusted to fit the user to register the light projected by the display system.

In yet other embodiments, a method is provided for evaluating registration of virtual image content from a head-mounted display system by a user's eye. The method comprises determining a first position of the eye, determining whether the first position of the eye is within a display registration volume of the head-mounted display system, where the display registration volume is an imaginary volume associated with proper fit of the head-mounted display system relative to the user's eye, and providing a notification based on determining whether the position of the eye is within the display registration volume, where the notification indicates at least that the display and the eye are not properly registered.

Additional examples of embodiments are enumerated below.

Example 1. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

a frame configured to be supported on a head of the user; a head-mounted display disposed on the frame, the display configured to project light into the user's eye to display virtual image content with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths at different periods of time; one or more eye-tracking cameras configured to image the user's eye; and processing electronics in communication with the display and the one or more eye-tracking cameras, the processing electronics configured to:

determine a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras; determine whether the position of the eye is within a display registration volume of the head-mounted display system; and provide a notification based on determining whether the position of the eye is within the display registration volume, where the notification indicates at least that the display and the eye are not properly registered.

Example 2. The display system of Example 1, wherein the processing electronics are further configured to, upon determining that the position of the eye is outside of the display registration volume, provide feedback to the user that the head-mounted display is not properly adjusted to fit the user, wherein the feedback is the notification provided based on determining whether the position of the eyes within the display registration volume.

Example 3. The display system of Example 1, further comprising at least one interchangeable fit piece removably mounted to the frame and configured to adjust a fit of the frame.

Example 4. The display system of Example 3, wherein the interchangeable fit piece comprises an interchangeable nose bridge configured to adjust the fit of the frame between the frame and a nose bridge of the user.

Example 5. The display system of Example 3 or 4, wherein the interchangeable fit piece comprises an interchangeable forehead pad configured to adjust the fit of the frame between the frame and a forehead of the user.

Example 6. The display system of any of Examples 3 to 5, wherein the interchangeable fit piece comprises an interchangeable back pad configured to adjust the fit of the frame between the frame and a back of the head of the user.

Example 7. The display system of any of Examples 2 to 6, wherein the processing electronics is further configured such that providing the notification comprises providing feedback to the user that the head-mounted display is not properly adjusted to fit the user comprises providing a suggestion to the user to swap out a currently-installed interchangeable fit piece for another interchangeable fit piece.

Example 8. The display system of any of Examples 1 to 7, further comprising one or more light sources disposed on the frame with respect to the user's eye to illuminate the user's eye, the one or more eye-tracking cameras forming images of the eye using the light from the one or more light sources.

Example 9. The display system of Example 8, wherein the one or more light sources comprises at least two light sources disposed on the frame with respect to the user's eye to illuminate the user's eye.

Example 10. The display system of any of Examples 8 to 9, wherein the one or more light sources comprises infrared light emitters.

Example 11. The display system of any of Examples 8 to 10, wherein one or more light sources form one or more glints on the eye and the processing electronics is configured to determine a location of the cornea based on the one or more glints.

Example 12. The display system of any of Examples 1 to 11, wherein the position of the eye it is a location of a center of rotation of the eye.

Example 13. The display system of any of Examples 1 to 11, wherein the cornea has associated therewith a cornea sphere having a center of curvature and the processing electronics is configured to determine a location of the center of curvature of the cornea sphere.

Example 14. The display system of Example 1, wherein the processing electronics is configured to provide the notification by providing instructions causing the display to boost a brightness of a plurality of pixels of the display relative to other pixels of the display, wherein the plurality of pixels with a boosted brightness comprise pixels expected to undergo perceived dimming under improper registration.

Example 15. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

determine a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras; determine whether the position of the eye is more than a first threshold distance outside of a viewing volume of the head-mounted display system; and in response to a determination that the position of the eye is more than the first threshold distance outside of the viewing volume of the head-mounted display system, provide feedback to the user indicating that the display and the eye are not properly registered for output.

Example 16. The display system of Example 15, wherein the processing electronics are configured to determine whether the position of the eye is more than the first threshold distance outside of a viewing volume by at least:

determining whether the position of the eye is less than a second threshold distance from the eyepiece; and in response to a determination that the position of the eye is less than the second threshold distance from the head-mounted display system, providing feedback to the user indicating that the display and the eye are not properly registered for output.

Example 17. The display system of Example 15, wherein the processing electronics are configured to determine whether the position of the eye is more than the first threshold distance outside of a viewing volume by at least:

determining whether the position of the eye is more than a second threshold distance from the eyepiece; and in response to a determination that the position of the eye is more than the second threshold distance from the head-mounted display system, providing feedback to the user indicating that the display and the eye are not properly registered for output.

Example 18. The display system of Example 15, wherein the processing electronics are configured to determine whether the position of the eye is more than the first threshold distance outside of a viewing volume by at least:

determining whether the position of the eye is more th

PRIORITY CLAIM

INCORPORATION BY REFERENCE

FIELD

BACKGROUND

SUMMARY

Various examples of registration observation and response in a mixed reality system are disclosed.

Additional examples of embodiments are enumerated below.

Example 1. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

Example 3. The display system of Example 1, further comprising at least one interchangeable fit piece removably mounted to the frame and configured to adjust a fit of the frame.

Example 10. The display system of any of Examples 8 to 9, wherein the one or more light sources comprises infrared light emitters.

Example 12. The display system of any of Examples 1 to 11, wherein the position of the eye it is a location of a center of rotation of the eye.

Example 15. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

determining whether the position of the eye is more than a second threshold distance outside of a subspace of a field of view of the eye tracking camera; and in response to a determination that the position of the eye is more than the second threshold distance outside of the subspace of the viewing volume of the eye tracking camera, providing feedback to the user indicating that the display and the eye are not properly registered for output.

Example 19. The display system of Example 15 wherein the viewing volume of the head-mounted display is a volume through which light representing every pixel of virtual image content presented by the head-mounted display is expected to pass.

Example 20. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

determine whether the light projected by head-mounted display is properly registered by the eye of the user; and provide feedback to the user if the head-mounted display is not properly adjusted to fit the user to register the light projected by the display system.

Example 21. The display system of Example 20, further comprising at least one interchangeable fit piece removably mounted to the frame and configured to adjust a fit of the frame.

Example 22. The display system of Example 21, wherein the interchangeable fit piece comprises an interchangeable nose bridge configured to adjust the fit of the frame between the frame and a nose bridge of the user.

Example 23. The display system of Example 20 or 22, wherein the interchangeable fit piece comprises an interchangeable forehead pad configured to adjust the fit of the frame between the frame and a forehead of the user.

Example 24. The display system of any of Examples 20 to 23, wherein the interchangeable fit piece comprises an interchangeable back pad configured to adjust the fit of the frame between the frame and a back of the head of the user.

Example 25. The display system of any of Examples 20 to 24, wherein the processing electronics is further configured such that providing feedback to the user that the head-mounted display is not properly adjusted to fit the user comprises providing a suggestion to the user to swap out a currently-installed interchangeable fit piece for another interchangeable fit piece.

Example 26. A method for evaluating registration of virtual image content from a head-mounted display system by a user's eye, the method comprising:

determining a first position of the eye; determining whether the first position of the eye is within a display registration volume of the head-mounted display system, wherein the display registration volume is an imaginary volume associated with proper fit of the head-mounted display system relative to the user's eye; and providing a notification based on determining whether the position of the eye is within the display registration volume, where the notification indicates at least that the display and the eye are not properly registered.

Example 27. The method of Example 26, wherein the head-mounted display system comprises an eye-tracking camera, wherein determining the first position of the eye comprises utilizing the eye-tracking camera to image the eye of the user.

Example 28. The method of Example 27, wherein the first position of the eye is a position of the center of rotation of the eye, and further comprising calculating a center of rotation of the eye based upon imaging of the eye by the eye-tracking camera.

Example 29. The method of Example 26, wherein the head-mounted display system is configured to project light into the eye to display virtual image content in the field of view of the user, and further comprising displaying an indication that the wearable system is properly fitted.

Example 30. The method of any of Examples 26 to 29, further comprising automatically tracking the center of rotation of the eye over time with the head-mounted display system and notify the user when the center of rotation of the eye moves outside of the registration display volume.

Example 31. The method of Examples 26 or 29, further comprising:

determining a second position of the eye; determining that the second position of the eye is within the display registration volume; and in response to determining that the second position of the eye is within the display registration volume, providing additional feedback to the user indicating that the wearable system is properly fitted to the user.

Example 32. The method of any of Examples 26 to 31, wherein, when the eye of the user is not within the display registration volume, at least some pixels of the head-mounted display system are dimmed or invisible to the user.

Example 33. The method of any of Examples 26 to 32, further comprising changing a field of view of the head-mounted display system when the position of the eye is outside the display registration volume,

wherein the head-mounted display system comprises at least one display having a first field of field when the position of the eye is inside the display registration volume, wherein the display has a second field of view when the position of the eye is outside the display registration volume, and wherein the second field of view is smaller than the first field of view.

Example 34. The method of Example 33, wherein providing the notification comprises providing feedback to the user within the second field of view.

Example 35. The method of any of Examples 26 to 34, wherein the wearable system comprises at least one interchangeable fit piece, and further comprising:

providing a notification to the user indicating that the wearable system is not properly fitted to the user, wherein the notification comprises a suggestion or an instruction to the user to replace a currently-installed interchangeable fit piece with an alternative interchangeable fit piece.

Example 36. The method of Example 35, wherein the interchangeable fit piece comprises at least one fit piece selected from the group consisting of: a nose bridge pad, a forehead pad, and a back pad that goes between the wearable system and a back of a user's head.

Example 37. The method of Example 36, wherein the wearable system comprises at least one interchangeable nose bridge pad, further comprising determining that a display of the head-mounted system is too low with respect to the eye, and wherein providing the notification to the user comprises prompting the user to install a larger nose bridge pad.

Example 38. The method of any of Examples 26 to 37, further comprising:

identifying a plurality of pixels of a display of the head-mounted display system that the user is expected to perceive as dimmed as a result of the first position of the eye being outside the display registration volume; and boosting brightness of the plurality of pixels of the display relative to other pixels in the display to mitigate the expected dimming.

Example 39. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

a frame configured to be supported on a head of the user; a head-mounted display disposed on the frame, the display configured to project light into the user's eye to display virtual image content as rendered by a virtual render camera with different amounts of wavefront divergence to present virtual image content appearing to be located at different depths at different periods of time; one or more eye-tracking cameras configured to image the user's eye; and processing electronics in communication with the display and the one or more eye-tracking cameras, the processing electronics configured to:

determine a distance away from the display at which the eye is located based on images of the eye obtained with the one or more eye-tracking cameras, and adjust a focal length of the virtual render camera based on the determined distance.

Example 40. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

determine a position of the eye relative to the display based on images of the eye obtained with the one or more eye-tracking cameras; determine an amount of pixels of virtual image content that the user is expected to perceive as dimmed based on the position of the eye relative to the display; and control operation of the display based on the determined amount of pixels.

Example 41. The display system of Example 40, wherein the processing electronics are configured to determine an amount of pixels of virtual image content that the user is not expected to perceive as dimmed based on the position of the eye relative to the display.

Example 42. The display system of Examples 40 or 41, wherein the processing electronics are configured to control operation of the display by:

boosting a brightness of the pixels of virtual image content that the user is expected to perceive as dimmed based on the position of the eye relative to the display.

Example 43. The display system of any of the Examples 40-42, wherein the amount of pixels of virtual image content comprises a percentage of pixels.

Example 44. The display system of any of the Examples 40-43, wherein the processing electronics are configured to compare the amount of pixels of virtual image content with one or more thresholds and, in response to a determination that the amount of pixels of virtual image content exceeds one or more thresholds, provide feedback to the user indicating that the display and the eye are not properly registered for output.

Example 45. A display system configured to project light to an eye of a user to display virtual image content, the display system comprising:

define a registration volume relative to the display based on one or more parameters; determine a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras; determine whether the position of the eye is within the registration volume of the head-mounted display system; and control operation of the display based on determining whether the position of the eye is within the display registration volume.

Example 46. The display system of Example 45, wherein the one or more parameters comprise a type of application that is running on the display system.

Example 47. The display system of any of Examples 45-46, wherein the one or more parameters comprise one or more physical parameters of the head-mounted display.

Example 48. The display system of any of Examples 45-47, wherein the one or more physical parameters of the head-mounted display comprise one or more of a display field of view, a display surface size, a shape of the display, an outer housing of the display, an amount of optical power imparted by the display to light representing virtual image content.

Example 49. The display system of any of Examples 45-48, wherein the processing electronics are configured to control operation of the display by presenting virtual image content to the user indicating at least that the display and the eye are not properly registered.

Example 50. The display system of Example 15, wherein the processing electronics are configured to determine whether the position of the eye is more than the first threshold distance outside of the viewing volume by at least:

determining whether the position of the eye is more than a second threshold distance outside of a subspace of the viewing volume of an outer housing of the head-mounted display; and in response to a determination that the position of the eye is more than the second threshold distance outside of the subspace of the viewing volume of the outer housing of the head-mounted display, providing feedback to the user indicating that the display and the eye are not properly registered for output.

Example 52. The display system of Example 15, wherein the processing electronics are further configured to:

identify an application running on the display system; and determine the first threshold distance based on the identified application.

Details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages will become apparent from the description, the drawings, and the claims. Neither this summary nor the following detailed description purports to define or limit the scope of the inventive subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an illustration of a mixed reality scenario with certain virtual reality objects, and certain physical objects viewed by a person.

FIG. 2 schematically illustrates an example of a wearable system.

FIG. 3 schematically illustrates example components of a wearable system.

FIG. 4 schematically illustrates an example of a waveguide stack of a wearable device for outputting image information to a user.

FIG. 5 schematically illustrates an example of an eye.

FIG. 6 is a schematic diagram of a wearable system that includes an eye tracking system.

FIG. 7A is a block diagram of a wearable system that may include an eye tracking system.

FIG. 7B is a block diagram of a render controller in a wearable system.

FIG. 7C is a block diagram of a registration observer in a head-mounted display system.

FIG. 8A is a schematic diagram of an eye showing the eye's corneal sphere.

FIG. 8B illustrates an example corneal glint detected by an eye-tracking camera.

FIGS. 8C-8E illustrate example stages of locating a user's corneal center with an eye tracking module in a wearable system.

FIGS. 9A-9C illustrate an example normalization of the coordinate system of eye tracking images.

FIGS. 9D-9G illustrate example stages of locating a user's pupil center with an eye tracking module in a wearable system.

FIG. 10 illustrates an example of an eye including the eye's optical and visual axes and the eye's center of rotation.

FIG. 11 is a process flow diagram of an example of a method for using eye tracking in rendering content and providing feedback on registration in a wearable device.

FIGS. 12A and 12B illustrate a nominal position of a display element relative to a user's eye and illustrate a coordinate system for describing the positions of the display element and the user's eye relative to one another.

FIGS. 13A and 13B illustrate nominal positioning and positioning tolerances of a display element relative to a user's eye in a head-mounted display system.

FIGS. 13C and 13D illustrate a display registration volume and a user's eye viewing content from a display.

FIG. 14 illustrates an example of the perceived dimming of a display for various positions of a user's eye relative to the display.

FIGS. 15A and 15B are exploded perspective views of a head-mounted display system having interchangeable pieces such as back pads, forehead pads, and nose bridge pads to adjust fit of a head-mounted display of the display system for different users.

FIG. 16 is a process flow diagram of an example of a method for observing registration and providing feedback on registration with a head-mounted display system.

FIGS. 17A-17H illustrate views of light fields projected by a display and how the intersections of the light fields may partly define a display registration volume.

FIG. 18 illustrates a top-down view of light fields projected by a display and how the intersections of the light fields may partly define a display registration volume.

FIG. 19A illustrates a registration volume derived from a display housing of a head-mounted display system.

FIG. 19B illustrates superimposed registration volumes of a display housing and a display of a head-mounted display system.

FIG. 19C illustrates an aggregate registration volume derived from the superimposed registration volumes of FIG. 19B .

Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. The drawings are provided to illustrate example embodiments described herein and are not intended to limit the scope of the disclosure.

DETAILED DESCRIPTION

The display portion of a display system may include a head-mounted display (HMD) which may display a three-dimensional (3D) virtual object such that the object appears to be located within the user's ambient environment. As a result, the 3D virtual object may be perceived by the user in a similar manner as real world objects.

The HMD may display images by outputting spatially modulated light to the user, with the light corresponding to the virtual object. The spatially modulated light may contain image information may be referred to as image light. To be perceived by the user, the image light travels from the HMD to an eye of the user, propagates through the pupil, and impinges on the eye's retina. It will be appreciated that if all or a portion of the image light for an image does not enter the pupil of the eye and/or does not impinge on the eye's retina, then the viewer would not see the image or the quality of the image may be degraded. As used herein, registration relates to the relative positioning of the display and the user's eyes. For example, a display may be said to be properly registered when the user's eyes and the display are positioned relative to one another for a desired amount of image light to enter the eye. A registration observer (e.g., a computer program) in the display device may be programmed to monitor whether the display is properly registered or positioned for the eye to receive the image light from the display.

In order to properly display content to users, e.g., by having the user's eyes positioned to receive image light, the user's eyes may need to be situated within a particular region or volume of space relative to the HMD. This volume may be referred to as the display registration volume. If the user's eyes are outside the display registration volume, display quality may be degraded (e.g., there may be dimming and/or displayed content that does not reach the users eyes). Various factors may combine to determine the positions of the user's eyes relative to the HMD and thus whether the user's eyes are situated within the desired display registration volume. As an example, anatomical variations between users may mean that the head-mounted display fits some users in a manner that places their eyes outside the display registration volume. As another example, the HMD may not be rigidly affixed to a user's head and may shift on the user's head over time, particularly when the user is moving around. As particular examples, the HMD may slip down the user's nose or tilt relative to a line (the interocular axis) between the user's eyes and, as a result, the HMD may not be able to provide desired virtual content (e.g., without some undesirable degradation) due to the shift of the display relative to the user's eyes.

Various systems and techniques described herein are at least in part directed to solving problems related to proper registration of a display to allow the viewer to view image content as desired. In some embodiments, a head-mounted display system may be configured to determine the position of an eye of the user. The display system may then determine whether the position of that eye is within a display registration volume of the head-mounted display system. Determining the position of the eye may include determining the position of a representative pointer volume associated with the eye e.g., the center of rotation of the eye. Determining whether the position of the eye is within the display registration volume may include determining whether the center of rotation of the eye is within the display registration volume. As discussed herein, the center of rotation of the eye may be determined using an inward-facing imaging system configured to image the eye. In addition, in some embodiments, the display registration volume is an imaginary volume associated with proper fit of the head-mounted display system relative to the user's eye. For example, the display registration volume may be a volume defined by a projection from the surface of the head-mounted display system outputting image light. More specifically, the display registration volume may be a three-dimensional geometric shape that tapers from a base towards an apex. The shape of the display registration volume's base may be defined at least in part by the geometry of the display, and the depth of the display registration volume (i.e., the distance from base to apex on the z-axis) may be at least in part defined by the field of view (FOV) of the display. For example, a round or circular display (e.g., the shape of the area on a surface from which image light is outputted to the viewer) may yield a conical display registration volume, and a polygonal display may yield a pyramidal display registration volume. As an additional example, a display with a larger FOV may yield a display registration volume having a smaller depth than a display with a smaller FOV. In some embodiments, the display registration volume may have the general shape of a truncated cone or pyramid. For example, the display registration volume may have the general shape of a frustum, e.g., a frustum of a pyramid such as a rectangular pyramid.

In some embodiments, an inward-facing imaging system of the head-mounted display system may acquire images of the user's face, including their eyes. The inward-facing imaging system may be an eye-tracking system, which may be mounted on a frame of the head-mounted display. The head-mounted display system may analyze the images to determine the relative position of the user's eyes and the HMD, and whether the position of each of the user's eyes falls within the display registration volume for that eye. Based on this information, the head-mounted display system may notify the user to adjust the fit of the HMD. For example, the notification may inform the user that the device has slipped and needs adjustment or a suggestion to make an adjustment of the HMD. In at least some embodiments, the head-mounted display system may take steps to mitigate any display degradation caused by misalignment of the HMD to the user, such as by boosting brightness or light output to the user in areas that would otherwise be dimmed by misalignment or by moving virtual content. Accordingly, such embodiments of the HMD may assist users with properly fitting the HMD and mitigating issues caused by improper fit of the HMD, such as when the HMD slips, moves, or tilts relative to the user's head. In some embodiments, it will be appreciated that the display system may be configured to notify the user of misalignment and to also take steps to mitigate display degradation caused by the misalignment. In some other embodiments, the display system may not provide a notification to the user; rather, the notification may simply be instructions or flags within the display system which trigger the display system to conduct actions to mitigate image degradation caused by misalignment.

Advantageously, the analysis of registration may be performed automatically utilizing images acquired from the inward-facing imaging system and information regarding the display registration volume stored or accessible by the display system. As a result, the fit of the HMD may be corrected upon first using the HMD, and optionally also during the course of continued usage of the HMD to ensure a high level of image quality in the use of the head-mounted display system.

Accordingly, a variety of implementations of systems and methods for observing registration of a head-mounted display system and taking action in response to the observed registration are provided herein.

Examples of 3D Display of a Wearable System

Reference will now be made to the drawings, in which like reference numerals refer to like parts throughout. Unless indicated otherwise, the drawings are schematic and not necessarily drawn to scale.

A wearable system (also referred to herein as a head-mounted display system or as an augmented reality (AR) system) may be configured to present 2D or 3D virtual images to a user. The images may be still images, frames of a video, or a video, in combination or the like. At least a portion of the wearable system may be implemented on a wearable device that may present a VR, AR, or MR environment, alone or in combination, for user interaction. The wearable device may be used interchangeably as an AR device (ARD). Further, for the purpose of the present disclosure, the term âARâ is used interchangeably with the term âMRâ.

FIG. 1 depicts an illustration of a mixed reality scenario with certain virtual reality objects, and certain physical objects viewed by a person. In FIG. 1 , an MR scene 100 is depicted wherein a user of an MR technology sees a real-world park- like setting 110 featuring people, trees, buildings in the background, and a concrete platform 120 . In addition to these items, the user of the MR technology also perceives that he âseesâ a robot statue 130 standing upon the real- world platform 120 , and a cartoon- like avatar character 140 flying by which seems to be a personification of a bumble bee, even though these elements do not exist in the real world.

In order for the 3D display to produce a true sensation of depth, and more specifically, a simulated sensation of surface depth, it may be desirable for each point in the display's visual field to generate an accommodative response corresponding to its virtual depth. If the accommodative response to a display point does not correspond to the virtual depth of that point, as determined by the binocular depth cues of convergence and stereopsis, the human eye may experience an accommodation conflict, resulting in unstable imaging, harmful eye strain, headaches, and, in the absence of accommodation information, almost a complete lack of surface depth.

VR, AR, and MR experiences may be provided by display systems having displays in which images corresponding to a plurality of depth planes are provided to a viewer. The images may be different for each depth plane (e.g., provide slightly different presentations of a scene or object) and may be separately focused by the viewer's eyes, thereby helping to provide the user with depth cues based on the accommodation of the eye required to bring into focus different image features for the scene located on different depth plane or based on observing different image features on different depth planes being out of focus. As discussed elsewhere herein, such depth cues provide credible perceptions of depth.

FIG. 2 illustrates an example of wearable system 200 which may be configured to provide an AR/VR/MR scene. The wearable system 200 may also be referred to as the AR system 200 . The wearable system 200 includes a display 220 , and various mechanical and electronic modules and systems to support the functioning of display 220 . The display 220 may be coupled to a frame 230 , which is wearable by a user, wearer, or viewer 210 . The display 220 may be positioned in front of the eyes of the user 210 . The display 220 may present AR/VR/MR content to a user. Because the display 220 may be configured to be worn on the head of the user 210 , it may also be referred to as a head-mounted display (HMD) and the wearable system 200 , comprising the <figure-callout id="220" label="displ

CLAIMS

Claims ( 20 )

What is claimed is:

1. A method for evaluating registration of virtual image content from a head-mounted display system by a user's eye, wherein the head-mounted display system comprises one or more eye-tracking cameras and at least one interchangeable fit piece, the method comprising:

determining a position of the eye based on images of the eye obtained with the one or more eye-tracking cameras;

determining whether the position of the eye is within a display registration volume of the head-mounted display system, wherein the display registration volume is an imaginary volume associated with proper fit of the head-mounted display system relative to the user's eye; and

providing a notification based on a determination that the position of the eye is outside the display registration volume, where the notification indicates at least that the display and the eye are not properly registered.

2. The method of claim 1 , wherein providing the notification comprises providing instructions causing the display system to boost a brightness of a plurality of pixels of the display relative to other pixels of the display, wherein the plurality of pixels with boosted brightness comprise pixels expected to undergo perceived dimming under improper registration.

3. The method of claim 1 , wherein providing the notification comprises providing feedback to the user that the head-mounted display system is not properly adjusted to fit the user and providing a suggestion to the user to swap out a currently-installed interchangeable fit piece for another interchangeable fit piece.

4. The method of claim 1 , wherein the head-mounted display system is configured to provide a first field of view when the position of the eye is inside the display registration volume and a second field of view when the position of the eye is outside the display registration volume, and further comprising changing a field of view of the head-mounted display system from the first field of view to the second field of view when the position of the eye is outside the display registration volume.

5. The method of claim 4 , wherein providing the notification comprises displaying feedback to the user within the second field of view.

6. The method of claim 1 , wherein the head-mounted display system comprises an eye-tracking camera, wherein determining the position of the eye comprises utilizing the eye-tracking camera to image the eye of the user.

7. The method of claim 6 , wherein the position of the eye is a position of a center of rotation of the eye, and further comprising calculating the center of rotation of the eye based upon imaging of the eye by the eye-tracking camera.

8. The method of claim 6 , further comprising continuously tracking the center of rotation of the eye while the head-mounted display system is in use and notifying the user when the center of rotation of the eye moves outside of the display registration volume.

9. The method of claim 1 , wherein the head-mounted display system is configured to project light into the eye to display virtual image content in a field of view of the user, and further comprising displaying an indication that the display system is properly fitted, wherein displaying the indication comprises providing feedback to the user that the head-mounted display system is positioned such that the user's eye is within the display registration volume.

10. The method of claim 1 , wherein, when the eye of the user is not within the display registration volume, dimming at least some pixels of the head-mounted display system, wherein the dimmed pixels correspond to portions of a possible field of view of the display system that are outside of a reduced field of view associated with the eye being outside the display registration volume.

11. A method for evaluating registration of virtual image content from a head-mounted display system by an eye of a user, wherein the head-mounted display system comprises a display disposed on a frame supported on a head of the user, the method comprising:

determining a position of the eye based on images of the eye obtained with one or more eye-tracking cameras attached to the frame;

determining whether the position of the eye is more than a first threshold distance outside of a viewing volume of the head-mounted display system; and

in response to determining that the position of the eye is more than the first threshold distance outside of the viewing volume of the head-mounted display system, providing feedback to the user indicating that the display and the eye are not properly registered.

12. The method of claim 11 , wherein determining whether the position of the eye is more than a first threshold distance outside of the viewing volume comprises:

determining whether the position of the eye is less than a second threshold distance from the head-mounted display system; and

in response to a determination that the position of the eye is less than the second threshold distance from the head-mounted display system, providing the feedback to the user indicating that the display and the eye are not properly registered.

13. The method of claim 11 , further comprising obtaining a fit tolerance, wherein the fit tolerance comprises information associated with changes in registration of the virtual image content caused by variances of the user's eyes from a nominal position relative to the display system.

14. The method of claim 11 , further comprising obtaining registration data, wherein obtaining the registration data comprises determining a spatial relationship between the display system and the user's eye.

15. The method of claim 11 , further comprising:

identifying an application running on the display system; and

determining the first threshold distance based on the identified application.

16. A method for evaluating registration of virtual image content from a head-mounted display system by an eye of a user, wherein the head-mounted display system comprises a frame and a head-mounted display and at least one interchangeable fit piece attached to the frame, the method comprising:

determining whether light projected by the head-mounted display is properly registered by the eye of the user, wherein the display is configured to project light into the user's eye to display the virtual image content with different amounts of wavefront divergence corresponding to different depth planes; and

providing feedback to the user if the light projected by the head-mounted display is determined to not be properly registered, wherein the feedback comprises a suggestion to the user to swap out a currently-installed interchangeable fit piece for another interchangeable fit piece.

17. The method of claim 16 , wherein the at least one interchangeable fit piece comprises an interchangeable nose bridge pad configured to adjust a fit between the frame and a nose bridge of the user.

18. The method of claim 17 , further comprising determining that the user's eye is above a display registration volume of the head-mounted display system, wherein the display registration volume is an imaginary volume associated with proper fit of the head-mounted display system relative to the user's eye, and wherein providing the feedback to the user comprises prompting the user to install a larger nose bridge pad.

19. The method of claim 16 , wherein the at least one interchangeable fit piece comprises an interchangeable forehead pad configured to adjust a fit of the frame and a forehead of the user.

20. The method of claim 16 , wherein the at least one interchangeable fit piece comprises an interchangeable back pad configured to adjust a fit of the frame and a back of the head of the user.

US17/125,932

2018-01-17

2020-12-17

Display systems and methods for determining registration between a display and a user's eyes

Active

US11290706B2

( en )

Priority Applications (5)

Application Number

Priority Date

Filing Date

Title

US17/125,932

US11290706B2

( en )

2018-01-17

2020-12-17

Display systems and methods for determining registration between a display and a user's eyes

US17/706,429

US11880033B2

( en )

2018-01-17

2022-03-28

Display systems and methods for determining registration between a display and a user's eyes

US18/521,613

US12196952B2

( en )

2018-01-17

2023-11-28

Display systems and methods for determining registration between a display and a user's eyes

US18/962,659

US12474575B2

( en )

2018-01-17

2024-11-27

Display systems and methods for determining registration between a display and a user's eyes

US19/362,422

US20260044001A1

( en )

2018-01-17

2025-10-19

Display systems and methods for determining registration between a display and a user's eyes

Applications Claiming Priority (5)

Application Number

Priority Date

Filing Date

Title

US201862618559P

2018-01-17

US201862344321P

2018-03-16

US201862702849P

2018-07-24

US16/251,017

US10917634B2

( en )

2018-01-17

2019-01-17

Display systems and methods for determining registration between a display and a user's eyes

US17/125,932

US11290706B2

( en )

2018-01-17

2020-12-17

Display systems and methods for determining registration between a display and a user's eyes

Related Parent Applications (1)

Application Number

Title

Priority Date

Filing Date

US16/251,017

Continuation

US10917634B2

( en )

2018-01-17

2019-01-17

Display systems and methods for determining registration between a display and a user's eyes

Related Child Applications (1)

Application Number

Title

Priority Date

Filing Date

US17/706,429

Continuation

US11880033B2

( en )

2018-01-17

2022-03-28

Display systems and methods for determining registration between a display and a user's eyes

Publications (2)

Publication Number

Publication Date

US20210105456A1

US20210105456A1 ( en )

2021-04-08

US11290706B2

true

US11290706B2 ( en )

2022-03-29

Family

ID=67301157

Family Applications (5)

Application Number

Title

Priority Date

Filing Date

US16/250,931

Active

US11112863B2

( en )

2018-01-17

2019-01-17

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

US17/125,932

Active

US11290706B2

( en )

2018-01-17

2020-12-17

Display systems and methods for determining registration between a display and a user's eyes

US17/465,715

Active

US11883104B2

( en )

2018-01-17

2021-09-02

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

US18/532,448

Active

US12102388B2

( en )

2018-01-17

2023-12-07

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

US18/809,146

Pending

US20240407646A1

( en )

2018-01-17

2024-08-19

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

Family Applications Before (1)

Application Number

Title

Priority Date

Filing Date

US16/250,931

Active

US11112863B2

( en )

2018-01-17

2019-01-17

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

Family Applications After (3)

Application Number

Title

Priority Date

Filing Date

US17/465,715

Active

US11883104B2

( en )

2018-01-17

2021-09-02

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

US18/532,448

Active

US12102388B2

( en )

2018-01-17

2023-12-07

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

US18/809,146

Pending

US20240407646A1

( en )

2018-01-17

2024-08-19

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

Country Status (9)

Country

Link

( 5 )

US11112863B2

( en )

( 2 )

EP4354207A3

( en )

( 4 )

JP7390297B2

( en )

( 2 )

KR102792495B1

( en )

( 2 )

CN120065536A

( en )

( 1 )

AU2019209930B2

( en )

( 1 )

CA3087333C

( en )

( 2 )

IL275822B2

( en )

( 1 )

WO2019143844A1

( en )

Cited By (6)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20220011998A1

( en )

2018-02-16

2022-01-13

Valve Corporation

Using detected pupil location to align optical components of a head-mounted display

US20220350399A1

( en )

2021-04-28

2022-11-03

Sony Interactive Entertainment Inc.

System and method of head mounted display personalisation

US11567336B2

( en )

2018-07-24

2023-01-31

Magic Leap, Inc.

Display systems and methods for determining registration between display and eyes of user

US11880033B2

( en )

2018-01-17

2024-01-23

Magic Leap, Inc.

Display systems and methods for determining registration between a display and a user's eyes

US11883104B2

( en )

2018-01-17

2024-01-30

Magic Leap, Inc.

Eye center of rotation determination, depth plane selection, and render camera positioning in display systems

WO2025079047A1

( en )

2023-10-10

2025-04-17

Meta Platforms Technologies, Llc

Displays with vergence distance for extended reality devices

Families Citing this family (65)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US11154203B2

( en )

2015-06-14

2021-10-26

Facense Ltd.

Detecting fever from images and temperatures

CN117369133A

( en )

2018-07-13

2024-01-09

å¥è·å¬å¸

Systems and methods for display binocular deformation compensation

US11966055B2

( en )

2018-07-19

2024-04-23

Magic Leap, Inc.

Content interaction driven by eye metrics

EP3830674A4

( en )

2018-08-03

2022-04-20

Magic Leap, Inc.

SELECTION OF DEPTH LEVELS FOR MULTI-LEVEL SCREEN DISPLAY SYSTEMS BY A USER CLASSIFICATION

JP2021536592A

( en )

2018-08-31

2021-12-27

ãã¸ãã¯ ãªã¼ã, ã¤ã³ã³ã¼ãã¬ã¤ãããMagic Leap, Inc.

Spatically decomposed dynamic dimming for augmented reality devices

CN111124103A

( en )

2018-10-31

2020-05-08

ææ¯è¡ä»½å¬å¸

Detecting repositioning of a head-mounted device

CN113544570B

( en )

2019-01-11

2025-02-14

å¥è·å¬å¸

Time-multiplexed display of virtual content at various depths

WO2020154524A1

( en )

2019-01-25

2020-07-30

Magic Leap, Inc.

Eye-tracking using images having different exposure times

GB2582657B

( en )

2019-03-29

2021-09-15

Sony Interactive Entertainment Inc

User tracking system using a camera mounted on the user and an external camera

US11315288B2

( en )

2019-05-20

2022-04-26

Magic Leap, Inc.

Systems and techniques for estimating eye pose

EP3979896B1

( en )

2019-06-05

2024-11-13

Pupil Labs GmbH

Devices, systems and methods for predicting gaze-related parameters

EP3999940A4

( en )

2019-07-16

2023-07-26

Magic Leap, Inc.

Eye center of rotation determination with one or more eye tracking cameras

US11836410B2

( en )

2019-08-06

2023-12-05

Universal City Studios Llc

Interactive headgear

US10972719B1

( en )

2019-11-11

2021-04-06

Nvidia Corporation

Head-mounted display having an image sensor array

JP6725121B1

( en )

2019-11-13

2020-07-15

æ ªå¼ä¼ç¤¾ã¹ã¯ãã¼ã¤ã³ãã¥ãã¼ã

Eye gaze detection method, eye gaze detection device, and control program

US11228745B2

( en )

2019-11-26

2022-01-18

Varjo Technologies Oy

Display apparatus and method of correcting image distortion therefor

CN114761859A

( en )

2019-11-26

2022-07-15

å¥è·å¬å¸

Augmented eye tracking for augmented or virtual reality display systems

KR102281927B1

( en )

2019-11-27

2021-07-26

ê³ íë°íí¬ëë¡ì§ ì£¼ìíì¬

Method for tracking pupil for eyes in different states and medical examination system using the same

CN115053270B

( en )

2019-12-09

2026-01-09

å¥è·å¬å¸

Systems and methods for operating a head-mounted display system based on user identity.

US11687778B2

( en )

2020-01-06

2023-06-27

The Research Foundation For The State University Of New York

Fakecatcher: detection of synthetic portrait videos using biological signals

US11410387B1

( en )

2020-01-17

2022-08-09

Facebook Technologies, Llc.

Systems, methods, and media for generating visualization of physical environment in artificial reality

US11210860B2

( en )

2020-01-27

2021-12-28

Facebook Technologies, Llc.

Systems, methods, and media for visualizing occluded physical objects reconstructed in artificial reality

US10950034B1

( en )

2020-01-27

2021-03-16

Facebook Technologies, Llc

Systems, methods, and media for generating visualization of physical environment in artificial reality

US11113891B2

( en )

2020-01-27

2021-09-07

Facebook Technologies, Llc

Systems, methods, and media for displaying real-time visualization of physical environment in artificial reality

US11200745B2

( en )

2020-01-27

2021-12-14

Facebook Technologies, Llc.

Systems, methods, and media for automatically triggering real-time visualization of physical environment in artificial reality

WO2021155047A1

( en )

2020-01-31

2021-08-05

Magic Leap, Inc.

Augmented and virtual reality display systems for oculometric assessments

US11451758B1

( en )

2020-02-12

2022-09-20

Meta Platforms Technologies, Llc

Systems, methods, and media for colorizing grayscale images

US12126937B2

( en )

2020-05-12

2024-10-22

Truemeeting, Ltd.

Method and system for virtual 3D communications having multiple participants per camera

US11907418B2

( en )

2020-06-12

2024-02-20

Magic Leap, Inc.

Eye tracking in near-eye displays

CN116033864A

( en )

2020-07-15

2023-04-28

å¥è·å¬å¸

Eye tracking using a non-spherical cornea model

JP7565428B2

( en )

2020-07-23

2024-10-10

ãã¸ãã¯ ãªã¼ãï¼ ã¤ã³ã³ã¼ãã¬ã¤ããã

Eye Tracking Using Alternating Sampling

US11836287B1

( en )

2020-09-22

2023-12-05

Apple Inc.

Light pattern-based alignment for retinal eye tracking

EP3985483A1

( en )

2020-10-19

2022-04-20

Carl Zeiss Vision International GmbH

Computer-implemented method for determining a position of a center of rotation of an eye using a mobile device, mobile device and computer program

CN112489138B

( en )

2020-12-02

2024-02-20

ä¸å½è¹è¶éå¢æéå¬å¸ç¬¬ä¸ä¸åç ç©¶æ

An intelligent acquisition system for target situation information based on wearable equipment

US11481960B2

( en )

2020-12-30

2022-10-25

Meta Platforms Technologies, Llc

Systems and methods for generating stabilized images of a real environment in artificial reality

EP4291973A4

( en )

2021-02-12

2024-08-14

Magic Leap, Inc.

Lidar simultaneous localization and mapping

US20240380876A1

( en )

2021-04-12

2024-11-14

Sony Group Corporation

Information processing apparatus, information processing method, and program

CN113538655B

( en )

2021-06-23

2023-08-04

èå¥½çç§æè¡ä»½æéå¬å¸

Virtual face generation method and equipment

WO2023031933A1

( en )

2021-08-31

2023-03-09

Spectralics Ltd.

Dynamic parallel monocular projection

US20230082420A1

( en )

2021-09-13

2023-03-16

Qualcomm Incorporated

Display of digital media content on physical surface

JP7760302B2

( en )

2021-09-21

2025-10-27

ãã¤ãã³æ ªå¼ä¼ç¤¾

Detection device, detection device control method and program

US11861805B2

( en )

2021-09-22

2024-01-02

Sony Group Corporation

Eyeball positioning for 3D head modeling

US12277725B2

( en )

2021-10-20

2025-04-15

Microsoft Technology Licensing, Llc

Enhanced eye tracking systems utilizing joint biological and hardware estimations

WO2023102500A1

( en )

2021-12-01

2023-06-08

Magic Leap, Inc.

Methods for controlling performance of extended reality display systems

WO2023111365A1

( en )

2021-12-15

2023-06-22

Neocortex Digital, S.L.

Gaze direction tracking system

KR20230113871A

( en )

2022-01-24

2023-08-01

(ì£¼) í´í¼ë¡ ì´ìì§

Construction method and structure of noise prevention between floors in buildings using foamed polyethylene mesh

JP2023111647A

( en )

2022-01-31

2023-08-10

å¯å£«ãã¤ã«ã ãã¸ãã¹ã¤ããã¼ã·ã§ã³æ ªå¼ä¼ç¤¾

Information processing device and information processing program

TWI826221B

( en )

2022-03-29

2023-12-11

å®éåéé»åè¡ä»½æéå¬å¸

Head mounted display device and control method for eye-tracking operation

US11762464B1

( en )

2022-04-20

2023-09-19

Htc Corporation

Method for inputting characters with eye gazes, host, and computer readable storage medium

KR102623083B1

( en )

2022-05-02

2024-01-10

(ì£¼) í´í¼ë¡ ì´ìì§

1st mortar casting type noise prevention construction method and construction structure without resonance space

US12058301B2

( en )

2022-06-03

2024-08-06

Apple Inc.

Electronic device that displays virtual objects

US12135742B1

( en )

2022-07-15

2024-11-05

Mobileye Vision Technologies, Ltd.

Systems and methods for searching an image database

EP4602796A1

( en )

2022-10-10

2025-08-20

Meta Platforms Technologies, LLC

Systems, methods, and media for generating visualization of physical environment in artificial reality

SE2251380A1

( en )

2022-11-28

2024-05-29

Tobii Ab

Method and system for improving perfomance of an eye tracking system

NL2033691B1

( en )

2022-12-08

2024-06-14

Dimenco Holding B V

Method for displaying a stereoscopic image on an autostereoscopic display device

SE2350314A1

( en )

2023-03-21

2024-09-22

Tobii Ab

An eye tracking system and methods of using an eye tracking system

CN118819283A

( en )

2023-04-19

2024-10-22

åäº¬åè·³ç½ç»ææ¯æéå¬å¸

Eye tracking module and extended reality device

CN121195203A

( en )

2023-07-11

2025-12-23

ä¾è§è·¯å½éå¬å¸

Methods and systems for determining the fitting parameters of ophthalmic lenses in an individual eyeglass frame.

US20250037621A1

( en )

2023-07-27

2025-01-30

Sony Interactive Entertainment Inc.

Systems and methods for providing sensing and lighting to maintain real nose perception in virtual reality

US12474771B2

( en )

2023-07-31

2025-11-18

Natela M. Shanidze

Oculomotor simulator for assessing eye-tracking accuracy

KR20250108410A

( en )

2024-01-08

2025-07-15

ì¼ì±ì ìì£¼ìíì¬

Electronic device and operating method thereof

US20250278830A1

( en )

2024-02-29

2025-09-04

Lemon Inc.

Reconstruction of entrance pupils using image data

WO2025196410A1

( en )

2024-03-22

2025-09-25

Sonda Technologies Limited

Eyewear device, system, and method and for controlling sensor activation

US12489881B1

( en )

2024-12-11

2025-12-02

Sony Group Corporation

Multi-user perspective projection in location-based entertainment

CN119987565B

( en )

2025-04-16

2025-07-25

é¿æ¥å¤§å¦

Imaging detection method and system of head-mounted display equipment

Citations (89)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US5844656A

( en )

1996-11-07

1998-12-01

Xybernaut Corporation

Head mounted display with adjustment components

US20030030597A1

( en )

2001-08-13

2003-02-13

Geist Richard Edwin

Virtual display apparatus for mobile activities

US20030184868A1

( en )

2001-05-07

2003-10-02

Geist Richard Edwin

Head-mounted virtual display apparatus with a near-eye light deflecting element in the peripheral field of view

US6771424B1

( en )

1999-08-31

2004-08-03

Shimadzu Corporation

Head-mounted display device

US20040174496A1

( en )

2003-03-06

2004-09-09

Qiang Ji

Calibration-free gaze tracking under natural head movement

US6850221B1

( en )

1995-09-05

2005-02-01

Interlink Electronics, Inc.

Trigger operated electronic device

US20060028436A1

( en )

1992-03-05

2006-02-09

Armstrong Brad A

Image controller

US20060250322A1

( en )

2005-05-09

2006-11-09

Optics 1, Inc.

Dynamic vergence and focus control for head-mounted displays

US20070081123A1

( en )

2005-10-07

2007-04-12

Lewis Scott W

Digital eyewear

US20070273983A1

( en )

2006-05-26

2007-11-29

Hebert Raymond T

Devices, methods, and systems for image viewing

US20080002262A1

( en )

2006-06-29

2008-01-03

Anthony Chirieleison

Eye tracking head mounted display

US20080106489A1

( en )

2006-11-02

2008-05-08

Brown Lawrence G

Systems and methods for a head-mounted display

US20080117289A1

( en )

2004-08-06

2008-05-22

Schowengerdt Brian T

Variable Fixation Viewing Distance Scanned Light Displays

US20090160872A1

( en )

2007-12-20

2009-06-25

Raytheon Company

Imaging System

US20090167673A1

( en )

2007-12-26

2009-07-02

Kerofsky Louis J

Methods and Systems for Display Source Light Management with Variable Delay

US20100283969A1

( en )

2007-10-23

2010-11-11

Mcgill University

Binocular vision assessment and/or therapy

US20120068913A1

( en )

2010-09-21

2012-03-22

Avi Bar-Zeev

Opacity filter for see-through head mounted display

US20120127062A1

( en )

2010-11-18

2012-05-24

Avi Bar-Zeev

Automatic focus improvement for augmented reality displays

US20120139817A1

( en )

2009-08-13

2012-06-07

Bae Systems Plc

Head up display system

US20120162549A1

( en )

2010-12-24

2012-06-28

Chunyu Gao

Ergonomic Head Mounted Display Device And Optical System

US20120212484A1

( en )

2010-02-28

2012-08-23

Osterhout Group, Inc.

System and method for display content placement using distance and location information

US20120293407A1

( en )

2011-05-19

2012-11-22

Samsung Electronics Co. Ltd.

Head mounted display device and image display control method therefor

US20130022220A1

( en )

2011-07-20

2013-01-24

Google Inc.

Wearable Computing Device with Indirect Bone-Conduction Speaker

US20130038510A1

( en )

2011-08-09

2013-02-14

Google Inc.

Laser alignment of binocular head mounted display

US20130050833A1

( en )

2011-08-30

2013-02-28

John R. Lewis

Adjustment of a mixed reality display for inter-pupillary distance alignment

US20130082922A1

( en )

2011-09-29

2013-04-04

Samuel A. Miller

Tactile glove for human-computer interaction

US20130083003A1

( en )

2011-09-30

2013-04-04

Kathryn Stone Perez

Personal audio/visual system

US20130117377A1

( en )

2011-10-28

2013-05-09

Samuel A. Miller

System and Method for Augmented and Virtual Reality

US20130125027A1

( en )

2011-05-06</

Display systems and methods for determining registration between a display and … — Magic Leap, Inc. (US11290706B2)

Related documents