Conceptio › Archive › Google Patents

Google Patentsopen access

Method, device and computer program for virtually adjusting a spectacle frame — Carl Zeiss Ag (US11915381B2)

Carl Zeiss Ag · Google Patents

Google Patents · Patents · License: Open Access

patent, google patents, intellectual property, US11915381B2, Carl Zeiss Ag, Oliver Schwarz, en, 2024

ABSTRACT

Abstract

A method for virtual spectacle adjustment and a corresponding computer program and computing device are disclosed. First measurement points are defined on a 3D model of a person's head, and a model of a frame is adjusted on the basis of the first measurement points. Defining the first measurement points includes defining second measurement points on a parametric head model, adjusting the parametric head model to the 3D model of the person's head, and determining the first measurement points on the basis of the second measurement points and the adjustment. In this way, the second measurement points only have to be defined once on the parametric model so that the first measurement points can be defined for a plurality of different 3D models of different heads.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of international patent application PCT/EP2018/067914, filed Jul. 3, 2018, designating the United States and claiming priority from European application 17179990.1, filed Jul. 6, 2017, and the entire content of both applications is incorporated herein by reference.

TECHNICAL FIELD

The present application relates to methods, apparatuses and computer programs for virtual fitting of spectacle frames.

BACKGROUND

Here, pursuant to DIN ESO 77998:2006-01 and DIN ESO 8624:2015-12, a spectacle frame should be understood to mean a frame or a holder by means of which spectacle lenses can be worn on the head. In particular, the term as used herein also includes rimless spectacle frames. Colloquially, spectacle frames are also referred to as frames. Within the scope of the present application, virtual donning of a spectacle frame denotes fitting a model of a spectacle frame to a model of a head on a computing device, usually connected with a graphical representation of the fitting of the spectacle frame to a head of a person on a display, for example a computer monitor.

Virtual donning of a spectacle frame on a head is known from US 2003/0123026 A1 or US 2002/0015530 A1, for example. In these documents, virtual donning of the spectacle frame predominantly serves to help a user to choose between different spectacle frames by virtue of a graphic representation of the head of the user being displayed together with the spectacle frame.

U.S. Pat. No. 9,286,715 B2, too, discloses a method for a virtual try-on of a pair of spectacles. Here, a plurality of points are defined, both on a spectacle frame and on a head. The spectacle frame is positioned on the head by virtue of selected points on the spectacle frame being brought into correspondence with selected points on the head. A position is changed by changing the selected points. This facilitates positioning with an accuracy that is sufficient for the purpose of U.S. Pat. No. 9,286,715 B2 of providing a virtual try-on for the purposes of obtaining a visual impression. Similarly, US 2005/0162419 A describes virtual donning of a spectacle frame with the aid of feature points. In this document, a frame is initially scaled and then positioned in different directions. Finally, earpieces of the spectacle frame are rotated about two spatial axes.

Volumental has made available a demonstration video for âVackerâ software at âwww.volumental.com/face-scanning/â, as of Mar. 5, 2017, in which a head with a donned pair of spectacles is presented and parameters of the pair of spectacles are modifiable by means of sliders, for example the seat of the pair of spectacles on the nose bridge, or else other parameters such as face form angle. A color of the spectacle frame or a color of the hinge of the spectacle frame can also be selected. The selected parameters are then output. In this video, different parameters of a parametric model of a spectacle frame are also adapted.

A further system for virtually fitting a pair of spectacles is known from US 2015/0055085 A1. Here, the pair of spectacles is automatically fitted by virtue of the size and fit of the spectacles on the head of a person being adapted. Moreover, form, style, and color of the pair of spectacles can be selected.

A method and an apparatus for constructing a fitted pair of spectacles, i.e., a pair of spectacles that have been fitted to the head of a person, are known from DE 10 2016 824 A1. In this method, head image data are recorded in two or three dimensions, a pair of specimen spectacles is selected and the pair of specimen spectacles is represented on the basis of construction parameters of the pair of specimen spectacles. The construction parameters are determined on the basis of the head image data.

US 2015/0277155 A1 discloses an individualization of the frame of a spectacle frame, within the scope of which distances are measured on the face of a person and the spectacle frame is created means of 3D printing on the basis of the measured distances.

US 2013/0088490 A1 discloses an iterative method for fitting a spectacle frame, wherein the spectacle frame is positioned by way of small steps and fitting is implemented on the basis of a collision detection, in which a check is carried out as to whether the spectacle frame overlaps with the head of the person.

U.S. Pat. No. 8,733,936 B1 discloses a method and a system for fitting a pair of spectacles to a person's head with the aid of image recordings of the head.

WO2014/037915 A1 likewise discloses a method and a system for fitting a pair of spectacles to a person's head, wherein characteristic points are identified in an image of the face of the person to whom the pair of spectacles is intended to be fitted.

Further methods and systems for fitting a pair of spectacles are known from U.S. Pat. No. 9,703,123 B2 or US2016/0062152 A1. fitted to a person's head, for example on the basis of anatomical data input into the system by an operator.

US 2015/0293382 A1 discloses a determination of parameters for a virtual pair of spectacles try-on by means of recordings of a person with a donned exemplary frame. The parameters determined by means of this exemplary frame are modified accordingly for a virtual try-on of a virtual frame. Since the person already wears a spectacle frame during the recording, no three-dimensional model of the head without a spectacle frame is used in this case.

In the article âVirtual Try-On of Eyeglasses using 3D-Model of the Head,â Institute for Infocomm Research, December 2011, DOI:10.1145/2087756.2087838, Niswar, Kahn, and Farbiz describe a method for virtual trying on of a pair of spectacles. This is based on four reference points, with two points lying on the nose and two points lying on the ears. Here, a 3D model of the head is adapted by deforming a generic model of the head on the basis of a few feature points.

US 2016/0327811 A1 describes a method that proceeds from a virtual model of a frame. The latter is fitted to a head by deformation. For the purposes of fitting the spectacle frame, fitting criteria can be implemented here, for example a maximization of a contact area between nose pads and the nose of the person, a maximization of a contact area of spectacle earpieces, a centration of a frame rim of the spectacle frame with respect to the eyes, an alignment of the spectacle frame or a minimization of the contact area of the frame rim with the cheekbones of the person and the eyebrows of the person.

Setting target values is specified as a possible extension to these criteria. By way of example, such target values may relate to a distance between the two spectacle earpieces of the spectacle frame, an âas-wornâ pantoscopic angle of the frame, a distance between the pads of the frame, a distance of an eye from the spectacle rim, a distance of the spectacle rim from eyebrows and cheekbones, an âas-wornâ pantoscopic angle of the spectacle frame or a face form angle of the spectacle frame. These parameters and target values flow into a cost function and an optimization is carried out by means of a conventional optimization process, for example a Levenberg-Marquardt algorithm. Then, the frame can still be deformed.

A problem in this process is that a global optimum need not necessarily be achieved using such an optimization process since optimization methods such as the Levenberg-Marquardt algorithm can generally only find a local minimum of the cost function. In the case of waviness of surfaces in employed 3D models for spectacle frames or the head, the optimization may âget stuckâ in such a surface wave far away from the optimum, and hence no optimal fitting is achieved.

Moreover, an optimization by means of such an optimization method requires much computational outlay if many parameters are used. This makes the use of parametric frame models in which a relatively large number of parameters should be optimized more difficult.

In a number of the documents cited above, for example U.S. Pat. No. 9,286,715 B2, US 2005/0162419 A1 or US 2016/0327811 A1, points are marked on the 3D model of the head and then used for the fitting of the model of the spectacle frame, for example points on the nose of the head. These points are essentially assumed to be given. In U.S. Pat. No. 9,286,715 B2, sweeping reference is made to image processing for acquiring these points; US 2016/0327811 A1, too, gives no detailed indications here and refers to a computer-aided determination.

US 2005/0162419 A1 discloses a method for defining points on a head model in which a 2D image of a person is recorded and in which 2D image points are marked. These points are then transferred to a standard head model. A spectacle frame is then fitted on the basis of these points.

Here, too, a user thus has to mark the corresponding points on the respective face of the person, which is time-consuming.

WO 2016/164859 A1 discloses two different possibilities for attaining 3D model of a person's head. In a first procedure, a generic parametric head model is fitted to the person for example on the basis of anatomical parameters input by a user. This fitting can also be done by specific features of the parametric model being brought into correspondence with image recordings of the person. In another procedure, a parametric model is generated anew on the basis of anatomical data of the person. In both cases, the parametric model may be particularly detailed in regions which are relevant to the positioning of spectacle frames. Measurement points which are relevant to fitting the pair of spectacles can likewise be defined here on the basis of image recordings in some other way. Additional image recordings are thus required here.

SUMMARY

It is an object of the present disclosure to provide a method for fitting of a pair of spectacles and also a corresponding computer program and an apparatus, wherein points can be defined on a 3D model of a person's head in an automated manner at least for some of the points, without a user having to mark the points individually on a face or on the model of the head of a person to whom a pair of spectacles is intended to be fitted, and without the need to carry out an analysis of image recordings as in WO2016/164859A1.

This object is achieved by means of a method, a computer program, a computer-readable storage medium, a computer-readable data medium, a data medium signal, and also an apparatus for virtual fitting of a pair of spectacles, as disclosed herein. Further exemplary embodiments are discussed below. A method for producing a spectacle frame that has been fitted with the aid of such methods is additionally provided.

The disclosure provides a computer-implemented method or a method carried out by a computer for virtual fitting of a pair of spectacles, wherein first measurement points are defined on a 3D model of a person's head and wherein a model of a spectacle frame is fitted to the 3D model of the person's head on the basis of the first measurement points. The method is characterized in that defining the first measurement points comprises:

fitting a parametric head model to the 3D model of the person's head, and

determining the first measurement points on the basis of second measurement points defined on the parametric head model, and fitting the parametric head model to the 3D model of the head.

Measurement points are understood here generally to mean points on a model which can be used for subsequent fitting of a pair of spectacles, in particular for measuring variables such as distances on the head.

By virtue of this method, the second measurement points on the parametric head model need only be defined once. This parametric head model with the second measurement points defined thereon can then be used for 3D models of the head of different persons in order to define the first measurement points on these 3D models. In contrast to the procedure in WO 2016/164859 A1, therefore, here no images of the person or other items of information are used, and two models are used, namely the parametric head model and the 3D model of the person's head, while only one model is used in WO 2016/164859 A1.

Defining the second measurement points on the parametric head model once as mentioned above can be effected in the context of the above method or else separately and/or beforehand, e.g., on a different computer. Accordingly, the above method can comprise a step of defining the second measurement points on a parametric head model, or the second measurement points can be defined and provided beforehand, e.g., by virtue of the fact that a method comprising the step of defining the second measurement points on a parametric head model is provided separately. The second measurement points can then be used for a multiplicity of different 3D models depending on the person, without the points having to be defined manually, for example, for each 3D model.

The terms used in the method mentioned above and described later are also explained below:

The fitting is âvirtualâ because the process is carried out on a computing device such as a personal computer (PC) and the real spectacle frame is not placed on the real head.

A model, in particular a 3D model, should be understood to mean a three-dimensional representation of real objects, which are available as a data record in a storage medium, for example a memory of a computer or a data medium. By way of example, such a three-dimensional representation can be a 3D mesh, consisting of a set of 3D points, which are also referred to as vertices, and connections between the points, which connections are also referred to as edges. In the simplest case, this connection form a triangle mesh. Such a representation as a 3D mesh only describes the surface of an object and not the volume. The mesh need not necessarily be closed. Thus, if the head, for example, is described in the form of a mesh, it appears like a mask. Details in respect of such 3D models are found in Rau J-Y, Yeh P-C, âA Semi-Automatic Image- Based Close Range 3D Modeling Pipeline Using a Multi-Camera Configuration.â Sensors (Basle, Switzerland). 2012; 12(8):11271-11293. doi:10.3390/s120811271; in particular page 11289, FIG. âFIG. 16â.

A voxel grid, which represents a volume-type representation, is a further option for representing a 3D model. Here, the space is divided into small cubes or cuboids, which are referred to as voxels. In the simplest case, the presence or absence of the object to be represented is stored in the form of a binary value (1 or 0) for each voxel. In the case of an edge length of the voxels of 1 mm and a volume of 300 mmÃ300 mmÃ300 mm, which represents a typical volume for a head, a total of 27 million such voxels is consequently obtained. Such voxel grids are described in, e.g., M. NieBner, M. Zollhofer, S. Izadi, and M. Stamminger, âReal- time 3D reconstruction at scale using voxel hashingâ. ACM Trans. Graph. 32, 6, Article 169 (November 2013), DOI: doi.org/10.1145/2508363.2508374.

In particular, the 3D model of the head and/or the 3D model of the spectacle frame can be a 3D model with texture. A 3D model with texture is understood to mean a 3D model which additionally contains the color information items of the surface points of the real object. The use of a 3D model with texture facilitates a true-color representation of the head and the spectacle frame.

CROSS REFERENCE TO RELATED APPLICATIONS

TECHNICAL FIELD

The present application relates to methods, apparatuses and computer programs for virtual fitting of spectacle frames.

BACKGROUND

U.S. Pat. No. 8,733,936 B1 discloses a method and a system for fitting a pair of spectacles to a person's head with the aid of image recordings of the head.

Here, too, a user thus has to mark the corresponding points on the respective face of the person, which is time-consuming.

SUMMARY

fitting a parametric head model to the 3D model of the person's head, and

determining the first measurement points on the basis of second measurement points defined on the parametric head model, and fitting the parametric head model to the 3D model of the head.

The terms used in the method mentioned above and described later are also explained below:

The fitting is âvirtualâ because the process is carried out on a computing device such as a personal computer (PC) and the real spectacle frame is not placed on the real head.

Here, the color information item can be contained directly in the vertices as an attribute, for example as an RGB (red green blue) color value, or a pair of texture coordinates is attached to each vertex as an attribute. Vertex denotes a point of the 3D model, as mentioned above. Here, an attribute generally denotes a feature, characteristic or the like, which is assigned to an object, a specific vertex in the present case (see also the German Wikipedia article âAttribut (Objekt)â [âAttribute (Object)â], as of Jul. 5, 2017). Then, these coordinates should be understood to be image coordinates (pixel positions) in an additional texture image. Then, the texture of the aforementioned triangles of the triangle mesh, for example, is generated by interpolation from the pixels of the texture image.

A parametric model is a 3D model having one or more variable parameters. Then, the geometry of the object described by the 3D model, in this case the spectacle frame, changes, e.g., in respect of size or form, by changing the parameter or parameters. Examples of such parameters include, for example, a bridge width or an earpiece length of the spectacle frame, or else a form of a frame rim of the spectacle frame. The type and number of these parameters depend on the spectacle frame represented by the parametric frame model. In particular, a manufacturer of the spectacle frame can set value ranges for the parameters, which then accordingly describe spectacle frames that are able to be manufactured. A free frame parameter is understood to mean a parameter of the parametric frame model, which parameter has not yet been set within the scope of the method, i.e., which parameter must still be fitted and determined.

Fitting guidelines are specifications relating to how the spectacle frame should be positioned relative to regions or points on the head, such as eyes, pupils, eyebrows or nose. These fitting guidelines that are specific to the parametric frame model are used, in particular, to ensure an esthetic impression that is desired by the manufacturer of the spectacle frame. The specific fitting guidelines can be provided together with the parametric frame model in electronic form, for example as appropriate files, by a respective manufacturer.

By contrast, the anatomical fitting relates to fitting that is intended to ensure a correct comfortable fit of the spectacle frame on the head. For this purpose, criteria are used which are not specific to the respective spectacle frame, but rather are generally applicable to a multiplicity of spectacle frames, such as a correct fit of the spectacle earpieces on the ears or a correct fit of nose pads of the pair of spectacles. The anatomical fitting can also comprise ensuring minimum distances to regions of the head, e.g., ensuring a minimum distance between the frame rims of the spectacle frame and the cheekbones and/or an eyebrow section of the head and/or ensuring a minimum distance to the eyelashes. A further example of anatomical fitting lies in the setting of an intended distance or an intended range for the distance between the spectacle lens and the eye, i.e., the vertex distance (German abbreviation HSA). Here, the vertex distance is the distance between the front surface of the cornea of the eye and the surface of the spectacle lens facing the eye. By way of example, anatomical fitting can ensure that an intended vertex distance of 12 mm or a vertex distance ranging from 12 mm to 17 mm is observed. The reason for this is that the spectacle lens should not be placed too close to the eye in order to avoid contacting by the eyelashes and to avoid condensation on the lens (sweating). Moreover, some opticians like to avoid a deviation of the vertex distance from a vertex distance that is preset in a phoropter used to measure the spherocylindrical refraction. Since a relatively large vertex distance modifies the optical power in the direction of positive diopter values, a relatively large vertex distance may possibly be preferred in the case of farsightedness, i.e., when so-called plus lenses are required. Therefore, an intended vertex distance based on the result of the refraction measurement can be used in advantageous fashion.

The fitting guidelines are typically available in text form, for example as a .xml or JSON file, which simplifies processing.

Within the scope of the present application, a âpersonâ denotes the person to whose head the spectacle frame should ultimately be fitted. A âuserâ denotes a person operating and carrying out the apparatus and the method for fitting spectacles. This may be the person themselves but also someone else, for example an optician.

Suitable parametric head models are described for example in A. Brunton, A. Salazar, T. Bolkart, S. Wuhrer, âReview of Statistical Shape Spaces for 3D Data with Comparative Analysis for Human Facesâ, Computer Vision and Image Understanding, 128:1-17, 2014, or else a head model as described in J. Booth, A. Roussos, S. Zafeiriou, A. Ponniahy and D. Dunaway, âA 3D Morphable Model Learnt from 10,000 Facesâ, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Nev., 2016 pages 5543-5552, doi:10.1109/CVPR.2016.598.

Typically, defining second measurement points on the parametric head model is effected by defining the second measurement points on a standard head of the parametric head model, or the second measurement points are defined beforehand on a standard head of the parametric head model. In this case, a standard head is a head of the parametric head model for which parameters of the parametric head model assume predefined values.

In the case of head models based on a principal component analysis, for example the average value of the data underlying the principal component can be the standard model.

In this way, it is possible to provide a defined starting point for the method.

The features defined on the standard head can then be transferred to the fitted parametric head model in accordance with the fitting, i.e., in accordance with the alteration of the standard head to form the fitted parametric head model, the second measurement points are also altered accordingly, such that they lie at corresponding locations on the fitted head model. In this regard, the second measurement points can be transferred to the fitted head model in a simple manner. Basic principles for such a transfer of points are explained in section 4.1 in the reference J. Booth et al. cited above.

The second measurement points transferred to the second head model can then be used directly as the first measurement points if the fitting of the head model is sufficiently accurate. What is sufficiently accurate depends on a desired accuracy for the subsequent fitting of spectacles and on the accuracy of the measurement system used to create the 3D model of the head. In this regard, by way of example, given an accuracy of the measurement system of 0.2 mm and a desired accuracy of the points of 0.5 mm, with the aid of the fitting of the parametric head model, an accuracy of likewise 0.5 mm would be achieved. If the measurement system has a significantly poorer accuracy, then the distribution of the errors is of importance: in the case of an error with a Gaussian distribution, a smoothing is obtained as a result of the fittingâthe accuracy in the sense of the maximum deviation is generally improved by fitting. Alternatively, determining the second measurement points can comprise projecting the transferred measurement points to the 3D model of the head. As a result of such a projection, the first measurement points can then be determined in a simple manner. For projection purposes, a point of intersection of a normal vector on the fitted parametric head model by the respective transferred second measurement point can be used for example as respective first measurement point.

The fitting can be carried out with the aid of conventional fitting algorithms (see the German Wikipedia article âAusgleichsrechnungâ [âCurve fittingâ], as of May 22, 2017).

The method can comprise combining a plurality of first measurement points to form a feature identifying a region of the 3D model of the head. With the aid of such features, spectacle frames can then be fitted efficiently if the features identify regions of the 3D model that are relevant to the fitting. Examples of features include for example nose wings, a curvature of the forehead or a base of the ear.

In this case, the combining can comprise fitting a geometric primitive or function to the plurality of measurement points. Examples of such geometric primitives are planes, segments of circles, segments of spheres or cylinders. Examples of functions include spline functions. As a result, a plurality of measurement points can be described with a small number of parameters (for example reference point and normal vector in the case of a plane, radius and midpoint in the case of the curvature of the forehead), which facilitates processing since fewer data are present. The frame model can comprise a parametric frame model.

With the nose wings as a feature, for example a bridge width of the parametric frame model can then be fitted in a simple manner by nose pads of the parametric frame model being brought to congruence with the nose wings. An earpiece length of the parametric frame model can be determined with a point at the base of the ear as measurement point or feature. The pantoscopic angle of the spectacle frame in accordance with DIN EN ISO 13666:2012 5.18, i.e., an inclination of the frame rim, can be determined by determining a distance between the frame rim and a feature describing the cheeks of the 3D model of the person. In this way, various parameters of a parametric frame model can be fitted in a simple manner.

The method can comprise a calculation of further measurement points for the 3D model of the head on the basis of first measurement points or the features explained above. Examples of such calculated further measurement points include a point at the base of the ear from first measurement points in the cheek region and/or first measurement points on the ear. In this case, the point at the base of the ear is a point on which a spectacle earpiece comes to rest during the fitting of the spectacle frame. In other exemplary embodiments, the point at the base of the ear can be one of the first measurement points that are determined on the basis of the second measurement points.

In such a method, a further measurement point like the point at the base of the ear can be calculated even when concealed by hair. In this case, the calculated further measurement point need not necessarily lie on the 3D model, but rather can also be at a distance therefrom.

For calculating a further measurement point, it is possible to use a predefined geometric relationship between first measurement points and such a further measurement point. In this case, a geometric relationship specifies how the further measurement point is situated with respect to the first measurement points. As an example thereof, the calculation of a further measurement point can comprise a linear combination of a set of first measurement points. As a further example, the calculation of a further measurement point can comprise an extrapolation on the basis of the first measurement points. In this case, it is possible to calculate a curve or area model, e.g., a curve or area with one or more free parameters, on the basis of the set of first measurement points by means of interpolation or approximation by means of an error function, for example in that the free parameters are determined by means of a fitting process.

By way of example, a polynomial curve can be fitted to the first measurement points lying on the cheek. In the course of the extrapolation, the polynomial curve is evaluated in the region lying in the direction of the ear and a further measurement point calculated in this way is determined.

Moreover, a computer program comprising a program code which, when executed on a processor, carries out one of the methods described above is also provided. Finally, provision is made of a corresponding apparatus comprising a processor comprising a memory, which stores the computer program, and a processor for executing the computer program.

Provision is also made of a computer program comprising instructions that, upon execution of the program by a computer, cause the latter to carry out the method as described above.

Provision is also made of a computer program comprising instructions that, upon execution of the program by a computer, cause the latter to carry out the following steps:

defining first measurement points on a 3D model of a person's head, wherein measurement points are points on a model which can be used for subsequent fitting of a pair of spectacles, and fitting a model of a spectacle frame to the 3D model of the head on the basis of the first measurement points, characterized in that defining the first measurement points comprises:

fitting a parametric head model to the 3D model of the person's head, and determining the first measurement points on the basis of second measurement points defined on the parametric head model, and fitting the parametric head model to the 3D model of the head.

In addition, further method steps from among those explained above can be carried out.

Provision is also made of an, in particular tangible, computer-readable storage medium comprising instructions that, upon execution by a computer, cause the latter to carry out the method as described above. Examples of storage media comprise optical storage media such as CDs or DVDs, magnetic storage media such as hard disk drives or solid-state storage such as flash memories or read-only memories (ROMs).

Provision is also made of an, in particular tangible, computer-readable storage medium comprising instructions that, upon execution by a computer, cause the latter to carry out the following steps:

In addition, further method steps from among those explained above can be carried out.

Provision is also made of an, in particular tangible, computer-readable data medium, on which the computer program as described above is stored.

Moreover, provision is made of a data medium signal (e.g., via a network such as the Internet), which transmits the computer program as described above.

Provision is also made of an apparatus for data processing and/or for fitting of a pair of spectacles, comprising means for carrying out the method as described above.

Provision is also made of an apparatus for data processing and/or for fitting of a pair of spectacles, comprising:

means for defining first measurement points on a 3D model of a person's head, wherein measurement points are points on a model which can be used for subsequent fitting of a pair of spectacles, and means for fitting a model of a spectacle frame ( 120 ) to the 3D model of the head on the basis of the first measurement points, characterized in that the means for defining the first measurement points comprises:

means for fitting a parametric head model to the 3D model of the person's head, and means for determining the first measurement points on the basis of second measurement points defined on the parametric head model, and fitting the parametric head model to the 3D model of the head.

For this purpose, optionally, further means can also additionally be provided for carrying out further steps of the methods described above.

Provision is also made of an apparatus for data processing and/or for fitting of a pair of spectacles, comprising a processor configured to carry out the method as described above.

The computer programs and apparatuses described above can have the same properties as described for the methods.

Moreover, provision is made of a method for producing a spectacle frame, comprising:

carrying out the method as described above, virtual fitting of a spectacle frame to the 3D model of the head using the first measurement points, and producing the fitted spectacle frame.

The 3D model comprising the first measurement points and provided by means of the method as described above is therefore initially used for virtual fitting of a spectacle frame.

Virtual fitting of the spectacle frame per se can be implemented as described in the prior art explained at the outset. Then, the spectacle frame virtually fitted in this way can be produced as a real spectacle frame, as likewise explained in the prior art cited at the outset. Producing can be implemented by means of an additive method such as 3D printing, for example; for an overview in this respect, see the German Wikipedia article âGeneratives Fertigungsverfahrenâ [âAdditive manufacturing methodâ], as of Jun. 25, 2018.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure will now be described with reference to the drawings wherein:

FIG. 1 shows an apparatus for virtual fitting of a pair of spectacles according to one exemplary embodiment;

FIG. 2 shows an example of an implementation of a camera device of FIG. 1 ;

FIG. 3 shows a flowchart that provides an overview of a method for fitting a pair of spectacles according to one exemplary embodiment;

FIG. 4 shows a flowchart of a method according to one exemplary embodiment, which is usable in the method of FIG. 3 ;

FIG. 5 shows a flowchart of a method according to one exemplary embodiment, which is usable within the scope of the method of FIG. 3 ;

FIG. 6 shows a view for elucidating features of a head that may be referred to in fitting guidelines;

FIG. 7 shows a detailed implementation of method step 40 in FIG. 4 or of step 54 in FIG. 5 ;

FIG. 8 shows a diagram for explaining auxiliary features;

FIG. 9 shows schematic views of a head for elucidating a fitting;

FIG. 10 A shows a schematic view of a head for elucidating a fitting on the basis of fitting guidelines for a relatively small interpupillary distance;

FIG. 10 B shows a schematic view of a head for elucidating a fitting on the basis of fitting guidelines for a mid interpupillary distance;

FIG. 10 C shows a schematic view of a head for elucidating a fitting for a relatively large distance;

FIG. 10 D shows a spectacle frame with a frame-circumscribing box;

FIG. 11 shows a flowchart of a method according to one exemplary embodiment, which is usable within the scope of the method of FIG. 3 ;

FIG. 12 shows a flowchart of a detailed implementation of the method of FIG. 11 ;

FIG. 13 A shows an illustration for elucidating a head model;

FIG. 13 B shows an illustration for elucidating a head model;

FIG. 13 C shows an illustration for elucidating a head model;

FIG. 13 D shows an illustration for elucidating a head model;

FIG. 14 shows an illustration for elucidating a head model;

FIG. 15 shows a diagram for elucidating a partial step of fitting a pair of spectacles in the method of FIG. 12 ; and

FIG. 16 shows a view of a frame model for elucidating a bridge width.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

FIG. 1 shows an exemplary embodiment of an apparatus for virtual fitting of a pair of spectacles according to one exemplary embodiment. The apparatus of FIG. 1 comprises a computing device 11 , which comprises a processor 12 and a memory 13 . The memory 13 serves to store data and, in the exemplary embodiment of FIG. 1 , comprises a random access memory (RAM), a read-only memory (ROM) and one or more mass storage media (hard disk, solid-state disk, optical drive, etc.). A program is stored in the memory 13 , the program, when executed on the processor 12 , being used to carry out a method for virtual fitting of a pair of spectacles, as already described above or as yet to be explained in more detail below.

The apparatus of FIG. 1 further comprises a display 16 which displays the head of a person together with a spectacle frame when the computer program is executed on the processor 12 . User inputs can be implemented by way of one or more input appliances 17 , for example keyboard and mouse. Additionally or alternatively, the display 16 can be a touch-sensitive screen (touchscreen) in order to be able to implement inputs.

The apparatus of FIG. 1 furthermore comprises an interface 14 to a network 18 , by means of which data can be received. In particular, it is possible to receive here parametric frame models of spectacle frames and associated fitting guidelines from manufacturers of spectacles. In some exemplary embodiments, data are also transmitted to a further computing device via the interface 14 in order to carry out, e.g., a portion of the calculation required for fitting this pair of spectacles. In order to create a 3D model of the head of a person, to which the pair of spectacles should be fitted, the apparatus of FIG. 1 optionally comprises a camera device 15 , by means of which a plurality of images of the person can be recorded from different directions and the 3D model can be determined thereby. Information in respect of such a determination of 3D models on the basis of image recordings is found in, e.g., H. Hirschmuller, âStereo Processing by Semiglobal Matching and Mutual Informationâ in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 328-341, February 2008. doi: 10.1109/TPAMI.2007.1166.

FIG. 2 shows an embodiment for the camera device 15 of FIG. 1 . In the exemplary embodiment of FIG. 2 , a semicircular arrangement 110 of cameras is fastened to a column 19 . A person can then position themselves in such a way that the head 111 of the person, as shown in FIG. 2 , is positioned in the semicircular arrangement 110 and can be recorded from different directions. Then, a 3D model of the head 111 can be created therefrom. A texture, i.e., information in respect of colors (as explained above) of the model, also emerges from the image recordings. Moreover, such an apparatus can be used for centration measurements, as described in the European patent application EP 3355100.

FIG. 3 shows a flowchart of an overall method for virtual fitting of a pair of spectacles according to one exemplary embodiment. The present disclosure relates, in particular, to partial steps of this method.

The method begins in step 30 . In step 31 , a 3D model of the head, including head model metadata, is loaded from a memory. The 3D model can be created with the aid of image recordings, as explained above with reference to FIGS. 1 and 2 , or it may be an already available 3D model, for example from an earlier fitting of a pair of spectacles to a certain person.

The head model metadata are data that contain information items about features of the 3D model but not the model itself. In particular, the metadata may supply additional information in respect of the 3D model of the head and/or contain certain points, curves or regions on the 3D model of the head. More details about the use of such metadata are also found in the European patent application EP 3410178.

A basic model of a spectacle frame described by a parametric frame model is selected in step 32 . The parametric frame model has free parameters, i.e., parameters to be determined. Examples of such free parameters have already been specified further above in the context of the description of the parametric frame model, specifically the bridge width or earpiece length of the spectacle frame, or else a form of a frame rim of the spectacle frame.

In step 312 , at least some of the parameters are then calculated on the basis of a fitting guideline associated with the frame model, as described above and explained in more detail below. Other parameters are determined on the basis of an anatomical fitting, as likewise already explained.

Then, there is virtual donning of the spectacles with more in-depth anatomical fitting in steps 33 to 310 . To this end, in step 33 there is approximate positioning on the basis of a placement point and a nose bridge resting point, as already described in the European patent application EP 3410178. The spectacle earpieces are bent open to the ears of the head and the earpieces are positioned, wherein there may be a rotation about an x-axis of the pair of spectacles, in steps

34 and 35 . Here, the x-axis corresponds to a direction that connects the eyes in the head, the z-direction corresponds substantially to the direction of the earpieces and the y-direction is perpendicular thereto. Contact areas of the pair of spectacles are optimized in step 36 by means of fine positioning in the xy-plane. Moreover, parameters not yet set in step 312 can be adapted further here. Steps 34 - 36 in this case correspond to the corresponding steps described in the European patent application EP 3410178. Within the scope of this fitting, the parametric spectacle model can be deformed and positioned, in particular, after the parameters have been determined in step 312 .

The frame and the head are then rendered in step 37 , i.e., there is an appropriate representation on the display 16 of FIG. 1 . This rendering, too, is already described in the European patent application EP 3410178. Here, rendering or image synthesis is understood to be the creation of an image (e.g., for display on a computer monitor) on the basis of raw data, from the respective models in this case.

Then, there is an interaction of the user with the model in step 38 which, as illustrated in step 39 , may have various consequences. Thus, there may simply be navigation, for example in order to observe the head from a different direction. In this case, there is new rendering in step 37 .

The interaction in step 39 also allows manual adaptation of the rotation of the frame about the x-axis. In this case, the method returns to step 35 , for example to determine the earpieces in accordance with the new position of the frame.

Moreover, by virtue of the interaction of the user with the model, the position of the spectacle frame on the nose bridge of the head model can also be adapted by a user of the apparatus. This substantially changes the position of the spectacle frame set in step 33 . Therefore, the method returns to step 33 in this case.

These previously described types of interaction, in particular navigation, for example for changing the observation angle, adapting the rotation and adapting the position of the pair of spectacles disposed on the nose bridge, have likewise already been explained in detail in the European patent application EP 3410178.

Moreover, one of the frame parameters of the parametric frame model can also be set by the user within the scope of the interaction. By way of example, the user can in this case modify the determination of parameters implemented by the automatic calculation in step 312 . In this case, this reduces the number of free frame parameters in step 310 and the method is continued in step 36 . If the user is finally satisfied with the fit following the interaction, the method is terminated in step 311 . In the process, there can still be a final check. The user (e.g., an optician)

CLAIMS

Claims ( 32 )

The invention claimed is:

1. A computer-implemented method for virtual fitting of a spectacle frame, the method comprising:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head by transferring the second measurement points on the parametric head model after the fitting to the 3D model of the person's head to corresponding locations on the 3D model of the person's head; and

fitting a model of the spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein determining the first measurement points comprises projecting the second measurement points onto the 3D model of the head.

2. The method as claimed in claim 1 , wherein the second measurement points are defined on a standard head of the parametric head model, and wherein determining the first measurement points includes transferring second features defined on the standard head to the fitted parametric head model in accordance with the fitting.

3. The method as claimed in claim 1 , further comprising:

combining a plurality of at least some of the first measurement points to form a feature identifying a region of the 3D model of the person's head.

4. The method as claimed in claim 3 , wherein the combining comprises fitting a geometric figure or a function to the plurality of the at least some of the first measurement points.

5. The method as claimed in claim 3 , wherein the region of the 3D model comprises a nose wing, a curvature of a forehead, an eyebrow, or a cheek region.

6. The method as claimed in claim 3 , wherein the model of the spectacle frame comprises a parametric frame model, and wherein the fitting includes determining one or more parameters of the parametric frame model based on at least one of the first measurement points or the feature.

7. The method as claimed in claim 1 , further comprising:

calculating at least one further measurement point for the 3D model based on the first measurement points.

8. The method as claimed in claim 1 , wherein the method further comprises:

defining the second measurement points on the parametric head model.

9. A computer-readable non-transitory data medium, on which instructions are stored that, upon execution by a computer, cause the computer to carry out the method as claimed in claim 8 .

10. A method for producing a spectacle frame, the method comprising:

carrying out the method as claimed in claim 1 ; and

producing a spectacle frame based on the fitted model of the spectacle frame.

11. The method as claimed in claim 1 , further comprising:

recording a plurality of images of the person's head from different directions to create the 3D model of the person's head.

12. A non-transitory storage medium storing a computer program having a program code which, when executed on a processor, carries out the method as claimed in claim 1 .

13. An apparatus comprising a memory, in which the computer program as claimed in claim 12 is stored, and a processor for executing the computer program.

14. An apparatus for data processing, the apparatus comprising:

a processor configured to carry out the method as claimed in claim 1 .

15. A computer-implemented method for virtual fitting of a spectacle frame, the method comprising:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head based on the second measurement points defined on the parametric head model;

wherein the second measurement points are defined on a standard head of the parametric head model, and

wherein determining the first measurement points comprises transferring second features defined on the standard head to the fitted parametric head model in accordance with the fitting; and

fitting a model of the spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein the parametric head model has a greater smoothness than the 3D model of the person's head.

16. The method as claimed in claim 15 , wherein the first measurement points are determined by calculating a point of intersection of a normal vector at a second measurement point with the 3D model of the person's head.

17. A computer-readable non-transitory storage medium comprising instructions that, upon execution by a computer, cause the computer to carry out the method as claimed in claim 15 .

18. A non-transitory storage medium storing a computer program having instructions that, upon execution of the program by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

transferring first measurement points on the 3D model of the head based on positions of the second measurement points defined on the parametric head model after the process of fitting the parametric head model to the 3D model of the person's head by projecting the second measurement points onto the 3D model of the head; and

performing at least one of a fitting based on fitting guidelines or an anatomical fitting to fit a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points.

19. A non-transitory storage medium comprising a computer program having instructions that, upon execution of the program by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head based on the second measurement points defined on the parametric head model,

wherein the second measurement points are defined on a standard head of the parametric head model, wherein determining the first measurement points comprises transferring a second features defined on the standard head to the fitted parametric head model in accordance with the fitting;

fitting a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein determining the first measurement points additionally includes utilizing the transferred second measurement points as the first measurement points or projecting the second measurement points onto the 3D model of the person's head; and

calculating at least one further measurement point for the 3D model based on the first measurement points,

wherein the calculation of the at least one further measurement point includes at least one of a linear combination of a set of first measurement points or am extrapolation based on the first measurement points, and

wherein the parametric head model has a greater smoothness than the 3D model of the person's head.

20. A computer-readable non-transitory storage medium comprising instructions that, upon execution by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

determining an accuracy of the fit of the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head by transferring the second measurement points defined on the parametric head model;

combining a plurality of at least some of the first measurement points to form a feature identifying a region of the 3D model of the person's head; and

fitting a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein the parametric head model has a greater smoothness than the 3D model of the person's head.

21. A computer-readable non-transitory storage medium comprising instructions that, upon execution by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

defining second measurement points on a standard head of a parametric head model;

fitting the parametric head model to the 3D model of the person's head;

transferring first measurement points on the 3D model of the person's head based on positions of the second measurement points defined on the parametric head model after the process of fitting the parametric head model to the 3D model of the person's head by projecting the second measurement points onto the 3D model of the head; and

fitting a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein the model of a spectacle frame is a parametric model.

22. An apparatus for data processing, the apparatus comprising:

means for providing a 3D model of a person's head;

means for defining second measurement points on a standard head of a parametric head model;

means for fitting the parametric head model to the 3D model of the person's head;

means for setting first measurement points on the 3D model of the head by transferring the second measurement points defined on the parametric head model after the process of fitting the parametric head model to the 3D model of the head;

providing fitting guidelines of the spectacle frame; and

means for fitting a model of the spectacle frame to the 3D model of the head based on the determined first measurement points and the fitting guidelines,

wherein the parametric head model has a greater smoothness than the 3D model of the person's head.

23. An apparatus for data processing, the apparatus comprising:

means for providing a 3D model of a person's head;

means for providing a parametric head model having second measurement points;

means for fitting a parametric head model to the 3D model of the person's head;

means for determining first measurement points based on the second measurement points defined on the parametric head model, and fitting the parametric head model to the 3D model of the head,

wherein the second measurement points are defined on a standard head of the parametric head model,

wherein the means for determining the first measurement points comprise means for transferring the second features defined on the standard head to the fitted parametric head model in accordance with the fitting,

wherein the means for determining the first measurement points additionally comprise means for projecting the second measurement points onto the 3D model of the head; and

means for fitting a model of a spectacle frame to the 3D model of the head based on the determined first measurement points.

24. A computer-implemented method for virtual fitting of a spectacle frame, the method comprising:

providing a 3D model of a person's head;

defining second measurement points on a standard head of a parametric head model;

fitting the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the head based on positions of the second measurement points defined on the parametric head model after the process of fitting the parametric head model to the 3D model of the head, wherein the first measurement points and the second measurement points have the same spatial coordinates, respectively;

determining an accuracy of the fit of the parametric head model to the 3D model of the person's head;

setting the first measurement points having the spatial coordinates of the second measurement points as the determined first measurement points if the accuracy of the fit is below a threshold value and setting the first measurement points having adjusted spatial coordinates as the determined first measurement points if the accuracy of the fit is or exceeds the threshold value;

providing fitting guidelines of the spectacle frame; and

fitting a model of the spectacle frame to the 3D model of the person's head based on the determined first measurement points.

25. The method as claimed in claim 24 , wherein setting the first measurement points includes transferring second features defined on the standard head to the fitted parametric head model in accordance with the fitting.

26. The method as claimed in claim 24 , wherein setting the first measurement points comprises transferring the second measurement points and utilizing the transferred second measurement points as the first measurement points.

27. The method as claimed in claim 24 , wherein setting the first measurement points comprises projecting the second measurement points onto the 3D model of the person's head.

28. A non-transitory storage medium storing a computer program having instructions that, upon execution of the program by a computer, cause the latter to carry out the method as claimed in claim 24 .

29. A non-transitory storage medium storing a computer program having instructions that, upon execution of the program by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

defining second measurement points on a standard head of a parametric head model;

fitting the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the head based on positions of the second measurement points defined on the parametric head model, wherein the first measurement points and the second measurement points have the same spatial coordinates, respectively;

determining an accuracy of the fit of the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head based on the second measurement points defined on the parametric head model;

providing fitting guidelines of the spectacle frame; and

fitting a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points.

30. An apparatus for data processing, comprising a memory, in which the computer program as claimed in claim 29 is stored, and a processor for executing the computer program.

31. A computer-readable non-transitory storage medium comprising instructions that, upon execution by a computer, cause the computer to carry out the following steps:

providing a 3D model of a person's head;

providing a parametric head model having second measurement points;

fitting the parametric head model to the 3D model of the person's head;

determining an accuracy of the fit of the parametric head model to the 3D model of the person's head;

determining first measurement points on the 3D model of the person's head based on second measurement points defined on the parametric head model, wherein the first measurement points and the second measurement points have the same spatial coordinates, respectively; and

fitting a model of a spectacle frame to the 3D model of the person's head based on the determined first measurement points,

wherein determining the first measurement points additionally comprises utilizing the transferred second measurement points as the first measurement points or projecting the second measurement points onto the 3D model of the person's head, and

wherein fitting the model of the spectacle frame to the 3D model of the person's head includes deforming the model of the spectacle frame.

32. An apparatus for data processing, the apparatus comprising:

means for providing a 3D model of a person's head,

means for providing a parametric head model having second measurement points;

means for fitting the parametric head model to the 3D model of the person's head;

means for determining first measurement points based on the second measurement points defined on the parametric head model, wherein the first measurement points and the second measurement points have the same spatial coordinates, respectively;

means for determining an accuracy of the fit of the parametric head model to the 3D model of the person's head;

means for setting the first measurement points having the spatial coordinates of the second measurement points as the determined first measurement points if the accuracy of the fit is below a threshold value and setting the first measurement points having adjusted spatial coordinates as the determined first measurement points if the accuracy of the fit is or exceeds the threshold value; and

means for fitting a model of a spectacle frame to the 3D model of the head based on the determined first measurement points.

US16/731,402

2017-07-06

2019-12-31

Method, device and computer program for virtually adjusting a spectacle frame

Active

2038-09-30

US11915381B2

( en )

Applications Claiming Priority (4)

Application Number

Priority Date

Filing Date

Title

EP17179990.1A

EP3425446B1

( en )

2017-07-06

Method, device and computer program for virtual adapting of a spectacle frame

EP17179990

2017-07-06

EP17179990.1

2017-07-06

PCT/EP2018/067914

WO2019007939A1

( en )

2017-07-06

2018-07-03

METHOD, APPARATUS AND COMPUTER PROGRAM FOR VIRTUALLY ADAPTING A GLASS MOUNT

Related Parent Applications (1)

Application Number

Title

Priority Date

Filing Date

PCT/EP2018/067914

Continuation

WO2019007939A1

( en )

2017-07-06

2018-07-03

METHOD, APPARATUS AND COMPUTER PROGRAM FOR VIRTUALLY ADAPTING A GLASS MOUNT

Publications (2)

Publication Number

Publication Date

US20200233239A1

US20200233239A1 ( en )

2020-07-23

US11915381B2

true

US11915381B2 ( en )

2024-02-27

Family

ID=59295060

Family Applications (1)

Application Number

Title

Priority Date

Filing Date

US16/731,402

Active

2038-09-30

US11915381B2

( en )

2017-07-06

2019-12-31

Method, device and computer program for virtually adjusting a spectacle frame

Country Status (9)

Country

Link

( 1 )

US11915381B2

( en )

( 2 )

EP3425446B1

( en )

( 2 )

JP6840889B2

( en )

( 1 )

KR102217887B1

( en )

( 2 )

CN111033364A

( en )

( 1 )

BR112020000106B1

( en )

( 1 )

CA3072117C

( en )

( 1 )

ES2845569T3

( en )

( 1 )

WO2019007939A1

( en )

Cited By (3)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

US20230020160A1

( en )

2019-12-19

2023-01-19

Essilor International

Method for determining a value of at least one geometrico-morphological parameter of a subject wearing an eyewear

US20230153479A1

( en )

2020-04-02

2023-05-18

Ocularex, Inc.

Real time augmented reality selection of user fitted eyeglass frames for additive manufacture

US12535699B2

( en )

2021-01-11

2026-01-27

Cubitts Kx Ltd

Frame adjustment system

Families Citing this family (22)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

JP6921768B2

( en )

2018-02-21

2021-08-18

æ ªå¼ä¼ç¤¾æ±è

Virtual fitting system, virtual fitting method, virtual fitting program, and information processing device

US10685457B2

( en )

2018-11-15

2020-06-16

Vision Service Plan

Systems and methods for visualizing eyewear on a user

EP3702831A1

( en )

2019-03-01

2020-09-02

Carl Zeiss Vision International GmbH

Dataset for use in a method for manufacturing an ophthalmic lens

EP3726474A1

( en )

2019-04-19

2020-10-21

Koninklijke Philips N.V.

Methods and systems for handling virtual 3d object surface interaction

US11238611B2

( en )

2019-07-09

2022-02-01

Electric Avenue Software, Inc.

System and method for eyewear sizing

CN114730101B

( en )

2019-09-24

2024-05-31

è´æ¯æ®å®¢æéå¬å¸D/B/Aææç¼é

System and method for adjusting stock eyeglass frames using 3D scanning of facial features

EP3809304A1

( en )

2019-10-18

2021-04-21

Carl Zeiss Vision International GmbH

Computer-implemented method for determining a parametric substitute model of a spectacle frame element, device and systems using such a method

US11250572B2

( en )

2019-10-21

2022-02-15

Salesforce.Com, Inc.

Systems and methods of generating photorealistic garment transference in images

EP3876026B1

( en )

2020-03-06

2025-09-03

Carl Zeiss Vision International GmbH

Method and devices for determining inclination angle

CN111461814B

( en )

2020-03-11

2024-03-26

æ·±å³å¸æ°éä»ç½ç»æéå¬å¸

Virtual glasses try-on method, terminal equipment and storage medium

JP7272985B2

( en )

2020-03-23

2023-05-12

ãã¤ ã¬ã³ãº ã¿ã¤ã©ã³ã ãªãããã

Virtual image generation device and virtual image generation method

EP3944004A1

( en )

2020-07-23

2022-01-26

Carl Zeiss Vision International GmbH

Computer-implemented method for generating data for producing at least one spectacle lens and method for manufacturing spectacles

DE112021003994A5

( en )

2020-07-31

2023-05-11

Tribe Gmbh

METHOD AND DEVICE FOR AUTOMATICALLY DETERMINING MANUFACTURING PARAMETERS FOR EYEGLASSES

DE102020131580B3

( en )

2020-11-27

2022-04-14

Fielmann Ventures GmbH

Computer-implemented method for preparing and placing a pair of glasses and for centering lenses of the pair of glasses

FR3118821B1

( en )

2021-01-13

2024-03-01

Fittingbox

Method for detecting and tracking in a video stream the face of an individual wearing a pair of glasses

EP4086693A1

( en )

2021-05-07

2022-11-09

Carl Zeiss Vision International GmbH

Method, processing device and system for determining at least one centration parameter for aligning spectacle lenses in a spectacle frame to eyes of a wearer

CA3220180A1

( en )

2021-05-25

2022-12-01

Lionel LE CARLUER

System and method for providing personalized transactions based on 3d representations of user physical characteristics

FR3124069A1

( en )

2021-06-18

2022-12-23

Acep France

Process for trying on virtual glasses

IT202100030014A1

( en )

2021-11-26

2023-05-26

Luxottica Group S P A

ENTIRELY VIRTUAL PROCEDURE FOR MEASUREMENTS OF OPTOMETRIC QUANTITIES.

US12136178B2

( en )

2022-02-09

2024-11-05

Google Llc

Validation of modeling and simulation of virtual try-on of wearable device

EP4227732A1

( en )

2022-02-14

2023-08-16

Carl Zeiss Vision International GmbH

Method for head image recording and corresponding mobile device

KR102890366B1

( en )

2024-12-17

2025-11-21

ê¶íì²

System for providing online eyeglasses fitting customizing service using three dimensional head shape

Citations (30)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

JPH06118349A

( en )

1992-10-02

1994-04-28

Seiko Epson Corp

Eyewear wearing simulation device

US20020015530A1

( en )

2000-07-25

2002-02-07

Felix Henry

Method and device for alerting during progressive decoding of a digital image coded with a region of interest

US20020105530A1

( en )

2001-02-06

2002-08-08

Roman Waupotitsch

Interactive try-on platform for eyeglasses

US20030123026A1

( en )

2000-05-18

2003-07-03

Marc Abitbol

Spectacles fitting system and fitting methods useful therein

WO2003081536A1

( en )

2002-03-26

2003-10-02

So-Woon Kim

System and method for 3-dimension simulation of glasses

US6792401B1

( en )

2000-10-31

2004-09-14

Diamond Visionics Company

Internet-based modeling kiosk and method for fitting and selling prescription eyeglasses

JP2011060100A

( en )

2009-09-11

2011-03-24

Tokyo Univ Of Agriculture & Technology

Eyeglass fitting simulation system, eyeglass fitting simulation method and program

FR2971873A1

( en )

2011-02-22

2012-08-24

Fittingbox

METHOD FOR DETECTING A PREDEFINED SET OF FACE CHARACTERISTIC POINTS

JP2013008137A

( en )

2011-06-23

2013-01-10

Tokyo Univ Of Agriculture & Technology

Data transmission device for three-dimensional shape modeling, data reception device for three-dimensional shape modeling, three-dimensional shape modeling system, data transmission program for three-dimensional shape modeling, and data reception program for three-dimensional shape modeling

US20130088490A1

( en )

2011-04-04

2013-04-11

Aaron Rasmussen

Method for eyewear fitting, recommendation, and customization using collision detection

US20130188128A1

( en )

2011-09-28

2013-07-25

Fabien Divo

Method of measuring morpho-geometrical parameters of a person wearing eyeglasses

WO2013177456A1

( en )

2012-05-23

2013-11-28

1-800 Contacts, Inc.

Systems and methods for adjusting a virtual try-on

US20140043329A1

( en )

2011-03-21

2014-02-13

Peng Wang

Method of augmented makeover with 3d face modeling and landmark alignment

CA2884576A1

( en )

2012-09-07

2014-03-13

Tipheret

Method and device for preparing a spectacle frame

US8733936B1

( en )

2012-01-30

2014-05-27

Ditto Technologies, Inc.

Fitting glasses frames to a user

US20140160123A1

( en )

2012-12-12

2014-06-12

Microsoft Corporation

Generation of a three-dimensional representation of a user

CN104168817A

( en )

2012-03-08

2014-11-26

åè¥¿åå½ééç¨åå¦å¬å¸

Method for estimating distance separating a pair of glasses and eye of the wearer of the pair of glasses

US20150055085A1

( en )

2013-08-22

2015-02-26

Bespoke, Inc.

Method and system to create products

FR3016052A1

( en )

2014-01-02

2015-07-03

Essilor Int

METHOD FOR DETERMINING A GEOMETRIC DEFINITION OF A CUSTOM OPTICAL EQUIPMENT

FR3016051A1

( en )

2014-01-02

2015-07-03

Essilor Int

METHOD FOR DETERMINING AT LEAST ONE GEOMETRIC PARAMETER OF A PERSONALIZED FRAME OF EYEWEAR AND METHOD OF DETERMINING THE ASSOCIATED CUSTOM FRAME

US20150277155A1

( en )

2014-03-31

2015-10-01

New Eye London Ltd.

Customized eyewear

US20150293382A1

( en )

2014-04-09

2015-10-15

Pro Fit Optix, Inc.

Method and System for Virtual Try-On and Measurement

FR3021205A1

( en )

2014-05-20

2015-11-27

Essilor Int

METHOD FOR DETERMINING AT LEAST ONE BEHAVIORAL PARAMETER

US20160246078A1

( en )

2015-02-23

2016-08-25

Fittingbox

Process and method for real-time physically accurate and realistic-looking glasses try-on

CN105992966A

( en )

2014-01-02

2016-10-05

åè¥¿åå½ééç¨åå¦å¬å¸

Method for fitting an actual predetermined glasses frame for the use thereof by a given wearer

US20160299360A1

( en )

2015-04-10

2016-10-13

Bespoke, Inc.

Systems and methods for creating eyewear with multi-focal lenses

EP3355100A1

( en )

2017-01-27

2018-08-01

Carl Zeiss Vision International GmbH

Device for determining centring parameters for spectacle adaptation

EP3354190A1

( en )

2017-01-27

2018-08-01

Carl Zeiss Vision International GmbH

Computer-implemented method for detecting a cornea vertex

EP3355102A1

( en )

2017-01-27

2018-08-01

Carl Zeiss Vision International GmbH

Computer-implemented method for determining centring parameters

EP3410178A1

( en )

2017-06-01

2018-12-05

Carl Zeiss Vision International GmbH

Method, device and computer program for virtual adapting of a spectacle frame

Family Cites Families (2)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

JPS5275987A

( en )

1975-12-22

1977-06-25

Hitachi Ltd

Gate protecting device

DE10216824B4

( en )

2002-04-16

2006-03-02

Thomas Doro

Method and apparatus for constructing a custom goggle

2017

2017-07-06

EP17179990.1A

patent/EP3425446B1/en

active

Active

2018

2018-07-03

BR112020000106-6A

patent/BR112020000106B1/en

active

IP Right Grant

2018-07-03

CN201880057588.0A

patent/CN111033364A/en

active

Pending

2018-07-03

PCT/EP2018/067914

patent/WO2019007939A1/en

not_active

Ceased

2018-07-03

CA3072117A

patent/CA3072117C/en

active

Active

2018-07-03

JP2020500077A

patent/JP6840889B2/en

active

Active

2018-07-03

CN202111429388.3A

patent/CN113985628A/en

active

Pending

2018-07-03

KR1020207003320A

patent/KR102217887B1/en

active

Active

2018-07-03

ES18737869T

patent/ES2845569T3/en

active

Active

2018-07-03

EP18737869.0A

patent/EP3649505B1/en

active

Active

2019

2019-12-31

US16/731,402

patent/US11915381B2/en

active

Active

2021

2021-02-17

JP2021023465A

patent/JP7369154B2/en

active

Active

Patent Citations (46)

* Cited by examiner, â Cited by third party

Publication number

Priority date

Publication date

Assignee

Title

JPH06118349A

( en )

1992-10-02

1994-04-28

Seiko Epson Corp

Eyewear wearing simulation device

US20030123026A1

( en )

2000-05-18

2003-07-03

Marc Abitbol

Spectacles fitting system and fitting methods useful therein

US20020015530A1

( en )

2000-07-25

2002-02-07

Felix Henry

Method and device for alerting during progressive decoding of a digital image coded with a region of interest

US6792401B1

( en )

2000-10-31

2004-09-14

Diamond Visionics Company

Internet-based modeling kiosk and method for fitting and selling prescription eyeglasses

US20020105530A1

( en )

2001-02-06

2002-08-08

Roman Waupotitsch

Interactive try-on platform for eyeglasses

US20050162419A1

( en )

2002-03-26

2005-07-28

Kim So W.

System and method for 3-dimension simulation of glasses

WO2003081536A1

( en )

2002-03-26

2003-10-02

So-Woon Kim

System and method for 3-dimension simulation of glasses

JP2011060100A

( en )

2009-09-11

2011-03-24

Tokyo Univ Of Agriculture & Technology

Eyeglass fitting simulation system, eyeglass fitting simulation method and program

FR2971873A1

( en )

2011-02-22

2012-08-24

Fittingbox

METHOD FOR DETECTING A PREDEFINED SET OF FACE CHARACTERISTIC POINTS

US9262695B2

( en )

2011-02-22

2016-02-16

Fittingbox

Method for detecting a predefined set of characteristic points of a face

US20140043329A1

( en )

2011-03-21

2014-02-13

Peng Wang

Method of augmented makeover with 3d face modeling and landmark alignment

US20130088490A1

( en )

2011-04-04

2013-04-11

Aaron Rasmussen

Method for eyewear fitting, recommendation, and customization using collision detection

JP2013008137A

( en )

2011-06-23

2013-01-10

Tokyo Univ Of Agriculture & Technology

CN103842894A

( en )

2011-09-28

2014-06-04

åè¥¿åå½ééç¨åå¦å¬å¸

Method for measuring morphogeometric parameters of an individual wearing glasses

US20130188128A1

( en )

2011-09-28

2013-07-25

Fabien Divo

Method of measuring morpho-geometrical parameters of a person wearing eyeglasses

US8733936B1

( en )

2012-01-30

2014-05-27

Ditto Technologies, Inc.

Fitting glasses frames to a user

CN104168817A

( en )

2012-03-08

2014-11-26

åè¥¿åå½ééç¨åå¦å¬å¸

Method for estimating distance separating a pair of glasses and eye of the wearer of the pair of glasses

US20150015848A1

( en )

2012-03-08

2015-01-15

Method for estimating a distance separating a pair of glasses and an eye of the wearer of the pair of glasses

US20130321412A1

( en )

2012-05-23

2013-12-05

1-800 Contacts, Inc.

Systems and methods for adjusting a virtual try-on

WO2013177456A1

( en )

2012-05-23

2013-11-28

1-800 Contacts, Inc.

Systems and methods for adjusting a virtual try-on

US9286715B2

( en )

2012-05-23

2016-03-15

Glasses.Com Inc.

Systems and methods for adjusting a virtual try-on

CA2884576A1

( en )

2012-09-07

2014-03-13

Tipheret

Method and device for preparing a spectacle frame

WO2014037915A1

( en )

2012-09-07

2014-03-13

Tipheret

Method and device for preparing a spectacle frame

US9589340B2

( en )

2012-09-07

2017-03-07

Tipheret

Method and device for preparing a spectacle frame

US20150243015A1

( en )

2012-09-07

2015-08-27

Tipheret

Method and device for preparing a spectacle frame

US20140160123A1

( en )

2012-12-12

2014-06-12

Microsoft Corporation

Generation of a three-dimensional representation of a user

US20150055085A1

( en )

2013-08-22

Method, device and computer program for virtually adjusting a spectacle frame — Carl Zeiss Ag (US11915381B2)

Related documents