Shujun Huang

A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system

An important step of phase calculation-based fringe projection systems is 3D calibration, which builds up the relationship between an absolute phase map and 3D shape data. The existing 3D calibration methods are complicated and hard to implement in practical environments due to the requirement of a precise translating stage or gauge block. This paper presents a 3D calibration method which uses a white plate with discrete markers on the surface. Placing the plate at several random positions can determine the relationship of absolute phase and depth, as well as pixel position and X, Y coordinates. Experimental results and performance evaluations show that the proposed calibration method can easily build up the relationship between absolute phase map and 3D shape data in a simple, flexible and automatic way.

Flexible phase error compensation based on Hilbert transform in phase shifting profilometry

This paper makes use of Hilbert transform to analyze and compensate the phase error caused by the nonlinear effect in phase shifting profilometry (PSP). The characteristics of the phase error distribution in Hilbert transform domain was analyzed and compared with spatial domain. A simple and flexible phase error compensation method was proposed to directly process the phase-shifting fringe images without any auxiliary conditions or complicated computation. Experimental results demonstrated that the phase error can be reduced by about 80% in three-step PSP, and more than 95% in four or more step PSP, which verified the effectiveness, flexibility, robustness and automation of the proposed phase error compensation method.

Accurate projector calibration method by using an optical coaxial camera

Digital light processing (DLP) projectors have been widely utilized to project digital structured-light patterns in 3D imaging systems. In order to obtain accurate 3D shape data, it is important to calibrate DLP projectors to obtain the internal parameters. The existing projector calibration methods have complicated procedures or low accuracy of the obtained parameters. This paper presents a novel method to accurately calibrate a DLP projector by using an optical coaxial camera. The optical coaxial geometry is realized by a plate beam splitter, so the DLP projector can be treated as a true inverse camera. A plate having discrete markers on the surface is used to calibrate the projector. The corresponding projector pixel coordinate of each marker on the plate is determined by projecting vertical and horizontal sinusoidal fringe patterns on the plate surface and calculating the absolute phase. The internal parameters of the DLP projector are obtained by the corresponding point pair between the projector pixel coordinate and the world coordinate of discrete markers. Experimental results show that the proposed method can accurately calibrate the internal parameters of a DLP projector.

Three-Dimensional Shape Measurements of Specular Objects Using Phase-Measuring Deflectometry

The fast development in the fields of integrated circuits, photovoltaics, the automobile industry, advanced manufacturing, and astronomy have led to the importance and necessity of quickly and accurately obtaining three-dimensional (3D) shape data of specular surfaces for quality control and function evaluation. Owing to the advantages of a large dynamic range, non-contact operation, full-field and fast acquisition, high accuracy, and automatic data processing, phase-measuring deflectometry (PMD, also called fringe reflection profilometry) has been widely studied and applied in many fields. Phase information coded in the reflected fringe patterns relates to the local slope and height of the measured specular objects. The 3D shape is obtained by integrating the local gradient data or directly calculating the depth data from the phase information. We present a review of the relevant techniques regarding classical PMD. The improved PMD technique is then used to measure specular objects having discontinuous and/or isolated surfaces. Some influential factors on the measured results are presented. The challenges and future research directions are discussed to further advance PMD techniques. Finally, the application fields of PMD are briefly introduced.

Full-field 3D shape measurement of discontinuous specular objects by direct phase measuring deflectometry

AbstarctWith the advent of intelligent manufacturing, phase measuring deflectometry (PMD) has been widely studied for the measurement of the three-dimensional (3D) shape of specular objects. However, existing PMDs cannot measure objects having discontinuous specular surfaces. This paper presents a new direct PMD (DPMD) method that measures the full-field 3D shape of complicated specular objects. A mathematical model is derived to directly relate an absolute phase map to depth data, instead of the gradient. Two relevant parameters are calibrated using a machine vision-based method. On the basis of the derived model, a full-field 3D measuring system was developed. The accuracy of the system was evaluated using a mirror with known positions along an accurate translating stage. The 3D shape of a monolithic multi-mirror array having multiple specular surfaces was measured. Experimental results show that the proposed DPMD method can obtain the full-field 3D shape of specular objects having isolated and/or discontinuous surfaces accurately and effectively.

Phase error compensation methods for high-accuracy profile measurement

In a phase-shifting algorithm-based fringe projection profilometry, the nonlinear intensity response, called the gamma effect, of the projector-camera setup is a major source of error in phase retrieval. This paper proposes two novel, accurate approaches to realize both active and passive phase error compensation based on a universal phase error model which is suitable for a arbitrary phase-shifting step. The experimental results on phase error compensation and profile measurement of standard components verified the validity and accuracy of the two proposed approaches which are robust when faced with changeable measurement conditions.

An accurate projector calibration method based on polynomial distortion representation.

In structure light measurement systems or 3D printing systems, the errors caused by optical distortion of a digital projector always affect the precision performance and cannot be ignored. Existing methods to calibrate the projection distortion rely on calibration plate and photogrammetry, so the calibration performance is largely affected by the quality of the plate and the imaging system. This paper proposes a new projector calibration approach that makes use of photodiodes to directly detect the light emitted from a digital projector. By analyzing the output sequence of the photoelectric module, the pixel coordinates can be accurately obtained by the curve fitting method. A polynomial distortion representation is employed to reduce the residuals of the traditional distortion representation model. Experimental results and performance evaluation show that the proposed calibration method is able to avoid most of the disadvantages in traditional methods and achieves a higher accuracy. This proposed method is also practically applicable to evaluate the geometric optical performance of other optical projection system.

3D palmprint and hand imaging system based on full-field composite color sinusoidal fringe projection technique

Palmprint and hand shape, as two kinds of important biometric characteristics, have been widely studied and applied to human identity recognition. The existing research is based mainly on 2D images, which lose the third-dimensional information. The biological features extracted from 2D images are distorted by pressure and rolling, so the subsequent feature matching and recognition are inaccurate. This paper presents a method to acquire accurate 3D shapes of palmprint and hand by projecting full-field composite color sinusoidal fringe patterns and the corresponding color texture information. A 3D imaging system is designed to capture and process the full-field composite color fringe patterns on hand surface. Composite color fringe patterns having the optimum three fringe numbers are generated by software and projected onto the surface of human hand by a digital light processing projector. From another viewpoint, a color CCD camera captures the deformed fringe patterns and saves them for postprocessing. After compensating for the cross talk and chromatic aberration between color channels, three fringe patterns are extracted from three color channels of a captured composite color image. Wrapped phase information can be calculated from the sinusoidal fringe patterns with high precision. At the same time, the absolute phase of each pixel is determined by the optimum three-fringe selection method. After building up the relationship between absolute phase map and 3D shape data, the 3D palmprint and hand are obtained. Color texture information can be directly captured or demodulated from the captured composite fringe pattern images. Experimental results show that the proposed method and system can yield accurate 3D shape and color texture information of the palmprint and hand shape.

Generic precise augmented reality guiding system and its calibration method based on 3D virtual model

Augmented reality system can be applied to provide precise guidance for various kinds of manual works. The adaptability and guiding accuracy of such systems are decided by the computational model and the corresponding calibration method. In this paper, a novel type of augmented reality guiding system and the corresponding designing scheme are proposed. Guided by external positioning equipment, the proposed system can achieve high relative indication accuracy in a large working space. Meanwhile, the proposed system is realized with a digital projector and the general back projection model is derived with geometry relationship between digitized 3D model and the projector in free space. The corresponding calibration method is also designed for the proposed system to obtain the parameters of projector. To validate the proposed back projection model, the coordinate data collected by a 3D positioning equipment is used to calculate and optimize the extrinsic parameters. The final projecting indication accuracy of the system is verified with subpixel pattern projecting technique.

Full-Field 3D Shape Measurement of Specular Surfaces by Direct Phase to Depth Relationship

This paper presents a new Phase Measuring Deflectometry (PMD) method to measure specular object having discontinuous surfaces. A mathematical model is established to directly relate absolute phase and depth, instead of phase and gradient. Based on the model, a hardware measuring system has been set up, which consists of a beam splitter to change the optical path, and two LCD screens to display the same sinusoidal fringe patterns. By using model-based and machine vision method, system calibration is accomplished to provide the required parameters and conditions. The verification tests are given to evaluate the effectiveness of the developed system. The 3D shape of an artificial step having multiple specular surfaces and a concave mirror has been measured. Initial experimental results show that the proposed measurement method can obtain 3D shape of specular objects with discontinuous surface effectively.