Next Article in Journal
Hough Transform and Clustering for a 3-D Building Reconstruction with Tomographic SAR Point Clouds
Previous Article in Journal
Frying Oil Evaluation by a Portable Sensor Based on Dielectric Constant Measurement
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Accurate Calibration Means for the Phase Measuring Deflectometry System

1
School of Machinery and Automation, Wuhan University of Science and Technology, Wuhan 430081, China
2
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
3
School of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China
4
Mechanical and Automation Engineering Department, The Chinese University of Hong Kong, Hong Kong SAR, China
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(24), 5377; https://doi.org/10.3390/s19245377
Submission received: 21 October 2019 / Revised: 27 November 2019 / Accepted: 4 December 2019 / Published: 5 December 2019
(This article belongs to the Section Optical Sensors)

Abstract

:
Calibration is a critical step for the phase measuring deflectometry system. Existing calibration methods are mainly optimizing the calibration parameters with respect to the 2D re-projection error criterion. However, such a procedure cannot reduce metric errors in the practical application. Therefore, an accurate and practical calibration method is proposed. In which, conventional calibration means is first applied for the primary calibration. Then, a precise square planar mirror is used for the optimization of system calibration parameters. All the intrinsic and extrinsic parameters are considered as a global multi-objective optimization problem. Three metric error criteria are introduced to evaluate the 3D reconstruction accuracy of the reference mirror. Compared with classical calibration means, which apply the parameter optimization in 2D image space to minimize the re-projection errors, the proposed optimization approach is executed in 3D space directly. An experiment and comparison are conducted to verify that the proposed optimal calibration approach can effectively reduce the system deviation and to improve the system measurement accuracy.

1. Introduction

3D optical measurement has been widely used in various applications like industrial inspection, inverse engineering, robot navigation, and human–machine interaction, etc. [1,2,3,4,5]. Off-the-shelf commercial 3D scanners like structured light system [6,7,8] and laser 3D scanners [9] can perform well in the 3D measurement of diffuse surface or Lambertian surface. However, these 3D measurement techniques usually fail to deal with mirror-like specular surfaces subject to the strong reflectance. Instead of avoiding the specular reflection by coating the surface with powders, the phase measuring deflectometry (PMD) technique [10,11,12] takes full advantage of the surface reflective property, which captures the virtual image reflected by the target surface. By analyzing the deformed strip patterns captured by the camera, precise discrete slope variations of the test surface can be calculated. By integrating the slope data, 3D topography of the target surface can be reconstructed precisely [13,14,15].
In the PMD-based 3D measurement systems, the calculated surface slope and the integration step are highly sensitive to the system error, which is caused by the calibration accuracy [16,17]. Therefore, the calibration method of the PMD system is very important, which determines the system measurement precision directly. Mostly, the PMD system calibration performs by calibrating the camera and system geometric parameters respectively. The camera calibration is conducted to compute the term camera calibration parameters [18,19,20]. The system geometry calibration refers to determining the relation between the screen, the reference mirror, and the camera. In detail, this step aims to find correspondence between screen pixels, the mirror reflected points, and the camera pixels. Since the screen that used to display the strip patterns does not lie within the field view of the camera in the PMD systems, it is difficult to obtain geometrical relation between the camera and screen without auxiliary setup.
To solve the geometry calibration problem in PMD systems, existing approaches can be generally classified into four categories. (i) Using a laser tracker or a coordinate measuring machine to specify the positions of the camera, the screen, and the mirror [21,22,23]. Although the accuracy can be guaranteed by the usage of additional precise instruments, the operation is laborious and the equipment is very expensive. (ii) Using a reference planar mirror with markers printed on it [10,24,25]. These methods indirectly calibrate the pose between the screen and the camera by the position of the reference mirror. The mirror should be custom-made with precise markers. Besides, markers on the mirror may interrupt the reflected patterns. (iii) Using a marker-less mirror by changing its pose at least three different positions [26,27,28]. The pose of the screen can be estimated by optimizing all the pose parameters simultaneously with the application of bundle adjustment [27] process or orthogonality constraint [28]. (iv) By treating the system geometry calculation as an optimization problem [29]. Given initial values of the system geometry parameters, and the iteration procedure is introduced to reach an optimal value [30,31,32]. Such methods are usually sensitive to the initialization of system parameters and cannot guarantee global optimal results. Moreover, the optimization is based on the criterion of 2D image re-projection error, which cannot reflect final 3D reconstruction errors.
In this paper, a 3D criterion-based calibration method is proposed to improve the global calibration accuracy of the PMD system. The system is initially calibrated by traditional means with a flat mirror. Then, a planar mirror is used for parameter optimization. Based on the reference mirror, 3D metric error criteria are defined as the planarity error, the distance error, and the angular error. A multi-objective optimization problem is established by considering all the system parameters as variables. Using the primary calibration results as initial values, by minimizing the defined 3D measurement errors, the optimal calibration parameters can be computed finally. The results show, with a simple planar mirror and the proposed calibration method, system calibration accuracy can be greatly improved compared with conventional calibration methods.

2. Modeling and Initial Calibration of the PMD System

Figure 1 describes the basic principle of the PMD measurement system. The system is composed of a camera, a display screen, and the specular surface to be tested. Structured light patterns displayed by the screen are reflected by the targeted surface, and captured by the camera. The obtained images are the virtual images of the real screen. Then the surface x-slope and y-slope can be calculated by the system geometrical model and calibration parameters. Finally, the slope is integrated to obtain the 3D shape of the target surface. For simplicity, as shown in Table 1, the coordinate frames of the screen and the camera are defined as {s} and {c}, respectively. {v} refers to the virtual screen, which is the image of the real screen. The definitions of the concerned coordinate systems are listed in Table 1. In this paper, bold capital letters R and T are used to denote the rotation matrix and the translation vector. The subscript refers to coordinate transformation between the source and the target coordinate system, e.g., Rw2c means the rotation matrix from world coordinate system {w} to the camera coordinate system {c}, and so on in a similar fashion.
The fundamental principle of the PMD method is the law of reflection, which means the incident angle and reflected angle for any surface point should be exactly equal. For convenience, as shown in Figure 1, the camera can be assumed as an active observer. A ray that emitted from point P goes through the camera optical center, reflected by the specular surface at point M, and hits the screen at point Q. In the initial calibration procedure, the reference mirror is placed at more than three different positions. For each position, a pattern with asymmetric circular markers is displayed by the screen and captured by the camera to calculate the internal parameters as shown by Figure 2a. Because the virtual screen has further distance to the camera compared with the real target surface, the captured images are usually blurred subject to the defocus of the camera. The blurred calibration images make the localization of dot center inaccurate as well as the calibration results of camera. That’s also one reason to apply a global optimization for all the system parameters.
The virtual fiducials Q is mapped to camera pixel P. Let Q c = [ X c   Y c   Z c ] T denotes the coordinate in the frame {c}, and image pixel P is denoted as p c = [ u c   v c ] T in image plane. According to the pinhole model, the normalized form of pc can be written as:
p ˜ c = [ u ˜ c v ˜ c ] = [ X c / Z c Y c / Z c ] .
Considering the lens distortions D = [ k 1   k 2   k 3   p 1   p 2 ] , where ( k 1 , k 2 , k 3 ) refers to the radial coefficients and ( p 1 , p 2 ) refers to the tangential coefficients, the undistorted expression of p ˜ c can be expressed as:
U ( p ˜ c ) = p ˜ c ( 1 + k 1 r c 2 + k 2 r c 4 + k 3 r c 6 ) + Δ ( p ˜ c ) ,
where r c 2 = u ˜ c 2 + v ˜ c 2 and Δ ( p ˜ c ) refers to the tangential distortion vector that is expressed as:
Δ ( p ˜ c ) = [ 2 p 1 u ˜ c v ˜ c + p 2 ( r c 2 + 2 u ˜ c 2 ) p 1 ( r c 2 + 2 v ˜ c 2 ) + 2 p 2 u ˜ c v ˜ c ] .
The homogeneous coordinate p ¯ c of the undistorted point P can be expressed as:
p ¯ c = [ x c y c 1 ] = A U ( p ˜ c ) ,
where A is the camera intrinsic matrix, which can be expressed as:
A = [ f u α u 0 0 f v v 0 0 0 1 ] .
For a complete model with lens distortions, there are 10 parameters to be estimated, i.e., { f u , f v , α , u 0 , v 0 , k 1 , k 2 , k 3 , p 1 , p 2 } . The parameter of α refers to the skewness of the sensor axes, which can be assumed to be 0 for most modern imaging sensors. Intrinsic parameters of the camera can be estimated by a lot of existing calibration methods.
The extrinsic parameters between frame {v} and {c} are expressed as Rv2c and Tv2c, which can be mathematically represented as:
s [ u c v c 1 ] = A [ R v 2 c | T v 2 c ] [ x v y v z v 1 ] ,
where s is a scale factor. Based on the maximum likelihood estimation algorithm [19], the internal and external parameters can be estimated by assessing the re-projection of the fiducials in frame {v} onto frame {c}, denoting the nonlinear mathematical function as , the minimization of the re-projection errors can be expressed as:
[ A R v 2 c T v 2 c ] = arg min P ( Q ) .
The structured light patterns captured by the camera are from the real screen frame {s}. Therefore, it is the real point Q that transformed into the camera frame {c}. To estimate the position and orientation of the real screen, a transparent Polyethylene Terephthalate (PET) calibration board is attached to the mirror at its last position and imaged by the camera, as shown in Figure 2b. Since the camera has been calibrated, the intrinsic parameters can be used to estimate the extrinsic parameters Rw2c and Tw2c by the following equation:
[ R w 2 c   T w 2 c ] = arg min P ( M ) .
According to the geometrical relation [33] and the Householder transformation [34], the relation between {s} and {c} can be calculated as:
{ ( I 3 2 n c n c T ) R s 2 c = R v 2 c ( I 3 2 e 3 e 3 T ) ( I 3 2 n c n c T ) T s 2 c = T v 2 c + 2 d w 2 c n c ,
where I 3 is a 3 × 3 identity matrix, and e 3 = [ 0   0   1 ] T , n c is the normal vector of mirror respect to the camera frame {c}, d w 2 c refers to the distance between the calibration mirror and the camera optical center. They can be derived via Rw2c and Tw2c as:
{ n c = R w 2 c ( : , 3 ) d w 2 c = | n c T T w 2 c | .
With the above operation and calculation, the initial camera and system geometrical parameters can be obtained. However, subject to the camera defocus, feature detection errors, manufacturing error of the transparent checkboard pattern and operating errors, etc., the initial calibration results of the PMD system are usually inaccurate. The following section will show how it can be optimized with a simple planar mirror.

3. Global Optimization of PMD System Parameters

Optimization of calibration parameters with respect to the 2D re-projection error criterion has been a standard step in existing calibration methods [16,26,29] for 3D optical measurement. However, the re-projection error cannot reflect real metric errors of the vision-based measurement system. More importantly, the 2D re-projection error based optimization procedure is only applied to the camera model parameters. But the factors of camera lens defocusing, structured light decoding error, and slope calculation errors, etc. are not considered. All these factors can make the final PMD calibration results inaccurate. That’s also the major motivation of this research, that a global optimization must be performed after the primary calibration so as to improve the system calibration accuracy. In this section, to improve the PMD system calibration accuracy, a practical 3D-based calibration procedure is introduced as follows. The underlying principle of the proposed method is to regard calibration of the PMD system as a global optimization problem. The primary calibration results are used as the initial values, and some objective functions are constructed to minimize the 3D metric deviation. By solving the nonlinear multi-objective optimization problem, the optimal parameters can be obtained. The workflow of the procedure is shown in Figure 3.
The object used for calibration is rather simple as a square planar mirror, which is aluminum coated with λ/10 flatness to guarantee high planarity and precision. The first image displayed on the screen is a white pattern without any information, which is used to illuminate the mirror and make it visible for the camera. Based on this image, four corners (cc) of the mirror can be detected with subpixel accuracy, and the mask of the mirror area can be located in the image. To improve efficiency, a liner uniform down-sampling is applied and gets a set of image points (cp). Based on the reconstruction method and primary calibration parameters, 3D coordinates of cp and cc can be calculated and denoted as Cp and Cc, as shown in Figure 4.
Based on the reconstructed 3D information of the mirror, three metric errors are defined so as to construct the multi-objective optimization problem for accurate system parameter estimation. The adopted three objective functions are defined as follows.

3.1. Planarity Error

The square mirror used for reconstruction can be treated as a perfect plane. Regardless of the calibration derivations and reconstruction derivations, the planarity error of the Cp should be zero. In general, a least-square fitting approach is applied to minimize the distance between the reconstructed points on the mirror surface. Given a plane, for each surface point, it has the same slope value in a certain direction. So we can use the slope values instead of planar fitting to describe the planarity term, which also makes the calculation more efficient. In details, the slope value can represent the planarity error by the following expression:
E p = i = 1 N | s i x s ¯ x | / N + i = 1 N | s i y s ¯ y | / N ,
where N is the number of sampling points, s i x and s i y are slopes along the x and y-axis of the i-th sampling point, s ¯ x and s ¯ y are the corresponding mean value, respectively.

3.2. Distance Error

For each corner cc, its average distance to clockwise adjacent corners can be calculated and denoted as dj. There are four corners and the distance error is simply defined as:
E d = j = 1 4 | d j L | / 4 ,
where, L is the nominal edge length of the mirror.

3.3. Angular Error

The planarity and distance error terms are still not enough to guarantee the reference plane will be well reconstructed. Considering the distortion caused by the affine transformation, the 3rd error term named angular error is defined. For each corner C j C c , by connecting it with the adjacent corners, all angles θ j can be calculated, and the angular error can be defined as:
E θ = j = 1 4 | θ j θ | / 4 ,
where, the ground-truth value of θ is known to be 90 degree.
For the adopted PMD system, there are 19 parameters to be optimized totally, which can be expressed by a vector K as:
K = [ f u , f v , u 0 , v 0 , D , R s 2 c , T s 2 c , n c , d w 2 c ] T .
Corresponding rotation vector is denoted as R s 2 c by Rodrigues transformation to satisfy the orthogonality constraint, i.e., R s 2 c R s 2 c T = 1 . The primary calibration results are used as the initial values of K and denote it as K0. Therefore, a multi-objective optimization problem can be established as:
{ K ^ = arg min K { E p ( K ) , β E d ( K ) , γ E θ ( K ) } s . t . l b K 0 K u b K 0 ,
where the boundary coefficient lb and ub are empirically set to [0.9, 1.1], the weighting factors β and γ are used to balance the effects from three error criteria, which can be evaluated empirically to satisfy E p β E d γ E a , e.g.,
{ β = 1 L γ = 1 θ .
To solve this multi-objective optimization problem, a lot of mathematical tools can be used. In this work, the “fgoalattain” function provided in the MATLAB optimization toolbox is used, which is based on the goal attainment method as described in [35]. Finally, the solved optimal system calibration parameters K ^ are used for surface reconstruction. Since 3D metrics are used instead of 2D image re-projection errors, accurate measurement results can be promised as the experiments verified.

4. Experimental Results and Discussion

To verify the performance of the proposed calibration method, a PMD system is established as shown in Figure 5a. Dimension and relative positions of the setup is as shown by Figure 5b. The system consists of an LCD screen (HP 24 es 23.8-inch), which has a resolution of 1920 × 1080 and the pixel pitch is 0.2745 mm, an industrial camera (PointGray FL3-U3-32S2C-CS), which has a resolution of 2080 × 1552 pixel and the pixel size is 2.5 μm. The camera lens has a focal length of 12 mm. Distance from the object to the camera is about 360 mm. A sinusoidal phase-shifting pattern is adopted for the surface slope calculation as shown in Figure 5a. Virtual images of the displayed fringe patterns can be reflected by the mirror and then captured by the camera.
In the primary calibration step, the asymmetric dots pattern is displayed by the screen. By changing the posture of the reference flat mirror, 10 different views of patterns are acquired for camera calibration. While the last image was captured, without changing the position of the mirror, a transparent PET calibration board is attached on the mirror surface and captured by the camera. Following the method described in Section 2, the initial calibration parameters can be calculated. In the system parameter optimization step, a square mirror with a size of 60 × 60 mm is used as shown in Figure 6. Four corners of the mirror are detected from the image firstly. Then, with the primary calibration results, the mirror surface can be reconstructed to get its 3D model. Based on the reconstructed dense 3D points, a uniform down-sampling is applied to reduce the point number. Finally, three metric errors can be calculated. By solving Equation (15), the optimized system parameters can be calculated. Table 2 shows the parameters before and after optimization, namely K0 and K ^ respectively. The reference mirror is placed in the system as shown by Figure 6a. Measurement results of the reference mirror plane before and after optimization are shown in Figure 6b and Figure 6c respectively. And the three metric errors computed with two groups of calibration parameters are given by Table 3. We can see that the planarity by the optimized calibration parameters can be improved almost 10 times. The distance and angular errors also can be improved greatly after the optimization of system calibration parameters.
In the first experiment, a stainless gauge block with a polished surface is used for evaluation, which has a size of 26 × 6 × 10 mm as shown in Figure 7a. The block surface is reconstructed twice based on the same structured light images with initial parameters and optimal parameters. So, the difference between the two measurement results can only be caused by the calibration error. 3D reconstruction results by the conventional and proposed method are as shown in Figure 7b and Figure 7c respectively. By fitting the reconstructed 3D points with an ideal plane, the peak and valley (PV) and root mean square (RMS) values are calculated as {5.7, 1.5} μm and {2.6, 0.52} μm respectively. To indicate the change of surface shape more clearly, a section line is selected and plotted as shown in Figure 7d, the blue and red lines are the profile of Figure 7b and Figure 7c, respectively. With the above comparison results, we can see that measurement results by the optimal system calibration parameters can be improved distinctly.
A concave aluminized glass is also used for the experiment as shown in Figure 8a. According to the specification provided by the manufacturer, its nominal aperture is 50 mm, and the radius of curvature of the concave mirror is 200 mm, with a tolerance of ±2%. Using the optimal calibration results, the reconstructed 3D model of the concave surface is as shown in Figure 8b. To visualize the 3D shape of the model, z axis is zoomed in. By fitting the reconstruction results with an ideal sphere as shown in Figure 8c, radius of reconstructed 3D model is about 199.12 mm, which locates within the metric tolerance. The PV and RMS error are calculated as 14.6 μm and 6.9 μm, respectively as shown in Figure 8d. In comparison, with the primary calibration results, the radius is calculated as 197.73 mm, the PV and RMS errors are 19.68 μm and 12.04 μm. Measurement accuracy improvement by the optimized system calibration results can be fully demonstrated.
To compare the 3D quality of the reconstructed shape with another 3D means, a commercial structured light 3D scanner (with nominal precision of 2.0 μ) was used to reconstruct the concave mirror and the result was shown in Figure 9. Subject to the mirror reflective surface, the structured light scanner cannot scan the mirror surface directly. To make the structured light scanner work, a coating operation was applied to the concave mirror surface to make it not reflective as shown in Figure 9a. The coating process is a usual procedure for the 3D scanners in industrial inspections, especially for the reflective or transparent surfaces. The reconstructed 3D model is as shown in Figure 9b. With a similar sphere fitting operation as shown by Figure 9c, the fitted radius is calculated as 206.9697 mm. In comparison, the result by the PMD system with optimized calibration parameters is much more close to the ground-truth data. In addition, compared with the 3D coordinate measuring method, the PMD method has the distinct advantage of non-contact and also much more efficient. Compared with structured light or laser 3D scanning techniques, the PMD method can work with a mirror-like surface directly. It has great potential in the online 3D inspection of mirror-like surfaces.

5. Conclusions

PMD is an important technique for the 3D measurement of mirror-like surfaces. Compared with conventional triangulation-based optical 3D measuring methods, the precision of the surface integration-based PMD methods is more dependent on the system calibration accuracy. In this paper, a simple and practical PMD system calibration approach is investigated to improve the system measurement accuracy. The system is calibrated by conventional means firstly. Then, a precise square planar mirror is used for the optimization of primary calibration parameters. Compared with traditional 2D image re-projection errors, three metric error criteria are introduced as the objective functions, i.e., planarity error, distance error, and the angular error. Using the primary calibration parameters as initial values, a nonlinear multi-objective optimization problem can be established and solved to obtain the optimal calibration parameters. Various mirror reflective surfaces are used for the experiments, and the results show that system measurement accuracy can be improved effectively. The approach is simple and effective, which is applicable not only for mono-PMD but also for stereo-PMD or multi-camera PMD configurations.

Author Contributions

H.H., S.W. and Z.S. have contributed to the scientific part of this work. All the authors have contributed to the writing of this article.

Funding

This work is supported by the National Key R&D Program of China (No. 2017YFB1103602), Shenzhen Science Plan (KQJSCX20170731165108047, JCYJ20170818160448602), and the National Natural Science Foundation of China (Nos. 61775172, U1613213).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pérez, L.; Rodríguez, Í.; Rodríguez, N.; Usamentiaga, R.; García, D.F. Robot Guidance Using Machine Vision Techniques in Industrial Environments: A Comparative Review. Sensors 2016, 16, 335. [Google Scholar] [CrossRef] [PubMed]
  2. Xiao, Y.; Wang, G.; Hu, X.; Shi, C.; Meng, L.; Yang, H. Guided, Fusion-Based, Large Depth-of-field 3D Imaging Using a Focal Stack. Sensors 2019, 19, 4845. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Balntas, V.; Doumanoglou, A.; Sahin, C.; Sock, J.; Kouskouridas, R.; Kim, T.K. Pose Guided 310 RGBD Feature Learning for 3D Object Pose Estimation. Proc. IEEE Int. Conf. Comput. Vis. 2017, 311, 3876–3884. [Google Scholar]
  4. Ravankar, A.; Ravankar, A.A.; Kobayashi, Y.; Hoshino, Y.; Peng, C.-C. Path Smoothing Techniques in Robot Navigation: State-of-the-Art, Current and Future Challenges. Sensors 2018, 18, 3170. [Google Scholar] [CrossRef] [Green Version]
  5. Song, L.; Li, X.; Yang, Y.-G.; Zhu, X.; Guo, Q.; Liu, H. Structured-Light Based 3D Reconstruction System for Cultural Relic Packaging. Sensors 2018, 18, 2981. [Google Scholar] [CrossRef] [Green Version]
  6. Song, Z.; Chung, R.; Zhang, X.T. An accurate and robust strip-edge-based structured light means for shiny surface micromeasurement in 3-D. IEEE Trans. Ind. Electron. 2013, 60, 1023–1032. [Google Scholar] [CrossRef]
  7. Zhang, S. Recent progresses on real-time 3D shape measurement using digital fringe projection techniques. Opt. Lasers Eng. 2010, 48, 149–158. [Google Scholar] [CrossRef]
  8. Salvi, J.; Fernandez, S.; Pribanic, T.; Llado, X. A state of the art in structured light patterns for surface profilometry. Pattern Recognit. 2010, 43, 2666–2680. [Google Scholar] [CrossRef]
  9. Schmitz, B.; Holst, C.; Medic, T.; Lichti, D.D.; Kuhlmann, H. How to Efficiently Determine the Range Precision of 3D Terrestrial Laser Scanners. Sensors 2019, 19, 1466. [Google Scholar] [CrossRef] [Green Version]
  10. Knauer, M.C.; Kaminski, J.; Hausler, G. Phase measuring deflectometry: A new approach to measure specular free-form surfaces. Opt. Metrol. Prod. Eng. 2004, 5457, 366. [Google Scholar]
  11. Huang, L.; Idir, M.; Zuo, C.; Asundi, A. Review of phase measuring deflectometry. Opt. Lasers Eng. 2018, 107, 247–257. [Google Scholar] [CrossRef]
  12. Zhang, Z.; Wang, Y.; Huang, S.; Liu, Y.; Chang, C.; Gao, F.; Jiang, X. Three-dimensional shape measurements of specular objects using phase-measuring deflectometry. Sensors 2017, 17, 2835. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Huang, L.; Idir, M.; Zuo, C.; Kaznatcheev, K.; Zhou, L.; Asundi, A. Comparison of two-dimensional integration methods for shape reconstruction from gradient data. Opt. Lasers Eng. 2015, 64, 1–11. [Google Scholar] [CrossRef]
  14. Li, M.; Li, D.; Jin, C.; Kewei, E.; Yuan, X.; Xiong, Z.; Wang, Q. 2017 Improved zonal integration method for high accurate surface reconstruction in quantitative deflectometry. Appl. Opt. 2017, 56, 144. [Google Scholar] [CrossRef] [PubMed]
  15. Ettl, S.; Kaminski, J.; Knauer, M.C.; Hausler, G. Shape reconstruction from gradient data. Appl. Opt. 2008, 47, 2091–2097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Zhou, T.; Chen, K.; Wei, H.; Li, Y. Improved system calibration for specular surface measurement by using reflections from a plane mirror. Appl. Opt. 2016, 55, 7018. [Google Scholar] [CrossRef] [PubMed]
  17. Ren, H.; Gao, F.; Jiang, X. Iterative optimization calibration method for stereo deflectometry. Opt. Express 2015, 23, 22060. [Google Scholar] [CrossRef]
  18. Tsai, R.Y. A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses. IEEE J. Robot. Autom. 1987, 3, 323–344. [Google Scholar] [CrossRef] [Green Version]
  19. Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334. [Google Scholar] [CrossRef] [Green Version]
  20. Huang, L.; Zhang, Q.; Asundi, A. Flexible camera calibration using not-measured imperfect target. Appl. Opt. 2013, 52, 6278–6286. [Google Scholar] [CrossRef]
  21. Huang, R.; Su, P.; Burge, J.H. Deflectometry measurement of Daniel K. In Inouye Solar Telescope primary mirror. In Proceedings of the Optical Manufacturing and Testing XI, San Diego, CA, USA, 27 August 2015; Volume 9575, p. 957515. [Google Scholar]
  22. Su, P.; Wang, Y.; Burge, J.H.; Kaznatcheev, K.; Idir, M. Non-null full field X-ray mirror metrology using SCOTS: A reflection deflectometry approach. Opt. Express 2012, 20, 12393. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Huang, R.; Su, P.; Burge, J.H.; Huang, L.; Idir, M. High-accuracy aspheric x-ray mirror metrology using Software Configurable Optical Test System/deflectometry. Opt. Eng. 2015, 54, 084103. [Google Scholar] [CrossRef]
  24. Zhang, Z.; Liu, Y.; Huang, S.; Niu, Z.; Guo, J.; Gao, N.; Gao, F.; Jiang, X. Full-field 3D shape measurement of specular surfaces by direct phase to depth relationship. Opt. Metrol. Insp. Ind. Appl. IV 2016, 10023, 100230X. [Google Scholar]
  25. Petz, M.; Tutsch, R. Reflection grating photogrammetry: A technique for absolute shape measurement of specular free-form surfaces. In Proceedings of the Optical Manufacturing and Testing VI, San Diego, CA, USA, 18 August 2005; Volume 5869, p. 58691. [Google Scholar]
  26. Sturm, P.; Bonfort, T. How to compute the pose of an object without a direct view? In Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Oeiras, Portugal, 4–6 September 2006; 3852, pp. 21–31. [Google Scholar]
  27. Xiao, Y.L.; Li, S.; Zhang, Q.; Zhong, J.; Su, X.; You, Z. Optical fringe-reflection deflectometry with bundle adjustment. Opt. Lasers Eng. 2018, 105, 132–140. [Google Scholar] [CrossRef]
  28. Takahashi, K.; Nobuhara, S.; Matsuyama, T. A new mirror-based extrinsic camera calibration using an orthogonality constraint. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012; pp. 1051–1058. [Google Scholar]
  29. Olesch, E.; Faber, C.; Häusler, G. Deflectometric Self-Calibration for arbitrary specular surfaces. DGaO Proc. 2011, 3, 2–3. [Google Scholar]
  30. Xu, X.; Zhang, X.; Niu, Z.; Wang, W.; Zhu, Y.; Xu, M. Self-calibration of in situ monoscopic deflectometric measurement in precision optical manufacturing. Opt. Express 2019, 27, 7523. [Google Scholar] [CrossRef]
  31. Huang, L.; Xue, J.; Gao, B.; McPherson, C.; Beverage, J.; Idir, M. Modal phase measuring deflectometry. Opt. Express 2016, 24, 24649. [Google Scholar] [CrossRef]
  32. Xu, Y.; Gao, F.; Zhang, Z.; Jiang, X. A holistic calibration method with iterative distortion compensation for stereo deflectometry. Opt. Lasers Eng. 2018, 106, 111–118. [Google Scholar] [CrossRef]
  33. Hesch, J.A.; Mourikis, A.I.; Roumeliotis, S.I. Mirror based extrinsic camera calibration. In Algorithmic Foundation of Robotics VIII; Springer: Berlin, Germany, 2010; pp. 285–299. [Google Scholar]
  34. Dubrulle, A.A. Householder transformations revisited. SIAM J. Matrix Anal. Appl. 2000, 22, 33–40. [Google Scholar] [CrossRef]
  35. Gembicki, F.W. Vector Optimization for Control with Performance and Parameter Sensitivity Indices. Ph.D. Thesis, Case Western Reserve University, Cleveland, OH, USA, 1974. [Google Scholar]
Figure 1. Principle of classical (Phase Measuring Deflectometry) PMD method to measure specular surface.
Figure 1. Principle of classical (Phase Measuring Deflectometry) PMD method to measure specular surface.
Sensors 19 05377 g001
Figure 2. (a) Circular markers are displayed by the screen and used for the camera calibration. (b) The (Transparent Polyethylene Terephthalate) PET checkboard pattern used for the calibration of system geometrical parameters.
Figure 2. (a) Circular markers are displayed by the screen and used for the camera calibration. (b) The (Transparent Polyethylene Terephthalate) PET checkboard pattern used for the calibration of system geometrical parameters.
Sensors 19 05377 g002
Figure 3. Workflow of the proposed optimal calibration method for PMD system.
Figure 3. Workflow of the proposed optimal calibration method for PMD system.
Sensors 19 05377 g003
Figure 4. Illustration of the square mirror used for system parameters optimization.
Figure 4. Illustration of the square mirror used for system parameters optimization.
Sensors 19 05377 g004
Figure 5. (a) The experimental setup of the PMD system; (b) Illustration of the PMD system model.
Figure 5. (a) The experimental setup of the PMD system; (b) Illustration of the PMD system model.
Sensors 19 05377 g005
Figure 6. (a) The square mirror used for parameter optimization; (b) 3D reconstruction result with initial calibration parameters; (c) 3D reconstruction result with the optimal calibration parameters.
Figure 6. (a) The square mirror used for parameter optimization; (b) 3D reconstruction result with initial calibration parameters; (c) 3D reconstruction result with the optimal calibration parameters.
Sensors 19 05377 g006
Figure 7. (a) A stainless gauge block; (b) Reconstructed surface by conventional method; (c) Reconstructed surface by proposed approach; (d) Cross section lines of the two 3D models.
Figure 7. (a) A stainless gauge block; (b) Reconstructed surface by conventional method; (c) Reconstructed surface by proposed approach; (d) Cross section lines of the two 3D models.
Sensors 19 05377 g007
Figure 8. (a) A concave aluminized glass; (b) Reconstructed 3D model of the glass; (c) A sphere is fitted to the reconstructed surface points; (d) Distribution of the fitting error.
Figure 8. (a) A concave aluminized glass; (b) Reconstructed 3D model of the glass; (c) A sphere is fitted to the reconstructed surface points; (d) Distribution of the fitting error.
Sensors 19 05377 g008
Figure 9. (a) The concave mirror after coating process; (b) Reconstructed 3D model of the concave surface by a structured light 3D scanner; (c) Sphere fitting of the concave surface.
Figure 9. (a) The concave mirror after coating process; (b) Reconstructed 3D model of the concave surface by a structured light 3D scanner; (c) Sphere fitting of the concave surface.
Sensors 19 05377 g009
Table 1. Notation of four coordinate systems.
Table 1. Notation of four coordinate systems.
Coordinate SystemNotation
Camera coordinate systemc
Screen coordinate systems
Virtual Screen coordinate systemv
World coordinate systemw
Table 2. Calibration parameters before and after optimization.
Table 2. Calibration parameters before and after optimization.
fx/fyu0/v0D R s 2 c T s 2 c ncdw2c
0.0457
4838.15861019.23700.1673−0.0385−398.5548−0.4753
K04837.3356748.2347−0.00230.8012−145.6743−0.0311321.3857
−0.0011−0.0182419.4638−0.8793
5.3042
0.0683
4837.99681017.71580.3972−0.0394−397.5548−0.4817
K ^ 4837.1374748.0554–0.00050.7937−146.7653−0.0350322.0015
0.0014−0.0179418.1663−0.8756
5.5530
Table 3. Three metric errors computed with and without system optimization.
Table 3. Three metric errors computed with and without system optimization.
EpEd (mm)Eθ (°)
Initial parameters0.00260.1250.154
Optimal parameters0.000280.0260.031

Share and Cite

MDPI and ACS Style

Han, H.; Wu, S.; Song, Z. An Accurate Calibration Means for the Phase Measuring Deflectometry System. Sensors 2019, 19, 5377. https://doi.org/10.3390/s19245377

AMA Style

Han H, Wu S, Song Z. An Accurate Calibration Means for the Phase Measuring Deflectometry System. Sensors. 2019; 19(24):5377. https://doi.org/10.3390/s19245377

Chicago/Turabian Style

Han, Hao, Shiqian Wu, and Zhan Song. 2019. "An Accurate Calibration Means for the Phase Measuring Deflectometry System" Sensors 19, no. 24: 5377. https://doi.org/10.3390/s19245377

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop