Taeone Kim

360-degree tabletop electronic holographic display

We demonstrate a tabletop holographic display system for simultaneously serving continuous parallax 3.2-inch 360-degree three-dimensional holographic image content to multiple observers at a 45-degree oblique viewing circumference. To achieve this, localized viewing windows are to be seamlessly generated on the 360-degree viewing circumference. In the proposed system, four synchronized high-speed digital micro-mirror displays are optically configured to comprise a single 2 by 2 multi-vision panel that enables size enlargement and time-division-multiplexing of holographic image content. Also, a specially designed optical image delivery sub-system that is composed of parabolic mirrors and an aspheric lens is designed as an essential part for achieving an enlarged 3.2-inch holographic image and a large 45-degree oblique viewing angle without visual distortion.

Estimation of Internal and External Parameters for Camera Calibration Using 1D Pattern

Camera calibration is to estimate the intrinsic and extrinsic parameters of a camera. Most of object-based calibration methods used 3D or 2D pattern. A novel and more flexible 1D object-based calibration was introduced only a couple of years ago, but merely for estimation of intrinsic parameters. The estimation of extrinsic papers is essential when multiple cameras are involved for simultaneously taking images from different view angles and when the knowledge of relative locations between the cameras is required. Though it is relatively simple using 2D or 3D calibration pattern, the estimation of extrinsic parameters is not obvious using 1D pattern. In this paper, we will perform a 1D camera calibration involving both intrinsic and extrinsic parameters.

Multi-view 3D video acquisition using hybrid cameras with beam splitter

We present a multi-view 3D video acquisition and its processing system for multi-view 3D television (3DTV). The proposed hybrid camera system consists of three-color cameras and one time of flight (TOF) camera. Since currently available TOF cameras do not provide color images associated with the depth image, we use a beam splitter between the color camera of the center view and the TOF camera to minimize the FOV difference between two cameras. We capture three-view color and one-view depth videos with hardware trigger synchronization. After capturing videos, we perform camera calibration, color correction, lens distortion correction, rectification, depth calibration, and multiview depth generation for three-view color videos. We showed experimental results using the proposed acquisition system. The proposed system can be used to generate multi-view 3D videos for 3DTV.

Dense Depth Map Acquisition System for 3DTV Applications Based on Active Stereo and Structured Light Integration

In this paper, we present and analyze a depth imaging system based on the integration of active stereo matching and structured light methods. The integration of these methods benefits from the advantages of the two approaches, allowing a shape recovery from a wider view with less occlusion. We build a system composed of two cameras and a projector, and project a single one-shot pattern. We first use the structured light part in order to estimate reliable correspondences between each camera and the projector via an efficient pattern decoding technique. The remaining unresolved regions are explored by a stereo matching technique which is less sensitive to object surface colors and projectors short depth of field to estimate additional correspondences. By switching between the colored pattern and a white light, the texture information of the system is retrieved at the same time and from the same viewpoint. Finally, we present a thoughtful and in-depth analysis of the capabilities and limitations of the presented system in the context of the development and contents creation for depth image-based representation (DIBR) 3DTV. Through carefully designed experiments we quantify the depth range of the camera system, the effects of the projector depth of field on the pattern decoding performance and the robustness to scene surface colors with respect to their hue, saturation, and brightness.

Complete Camera Calibration Using Line-Shape Objects

Most of object-based calibration methods used 3D or 2D pattern. A novel and more flexible 1D object-based calibration was introduced only a couple of years ago, and merely for estimation of intrinsic parameters without consideration camera distortion. Estimation of extrinsic papers is essential when multiple cameras are involved for simultaneously taking images from different view angles and when the knowledge of relative locations between the cameras is required. Estimation of distortion parameters is critical for precise estimation of all calibration parameters. In this paper, we will perform a multi-layer camera calibration involving both intrinsic and extrinsic parameters including distortion parameters based on a line-shape calibration object

Structured light-based high-accuracy depth imaging applied for DIBR in multiview 3DTV

In this paper we address the estimation of scene range for multiview 3DTV applications. Based on their similar setup requirements, we propose a depth camera system combining the strengths of Structured Light and Active Stereo techniques to obtain a fast depth map recovery for a larger variety of scenes and from a wider view with less occlusion. The proposed system is composed by a stereo rig and a projector. A stripe-based one shot pattern is projected into the target scene. Using an efficient decoding technique, reliable correspondences can be found between each camera and the projected pattern. Decoded areas common to both cameras are triangulated and used to calibrate the projector on the fly in order to estimate depth in decoded areas only visible in one camera. Correspondences in undecoded areas are estimated via a stereo matching procedure. The different estimated data is then combined in a single depth map. We introduce a 3 projection method that improves the structured light identification in strong illumination conditions and more robust to color objects surfaces of the scene. We demonstrate the efficacy of the integration method experimental results with special emphasis on its performance in the context of the development and contents creation for depth image-based representation (DIBR) 3DTV.

Depth camera for 3DTV applications

In this paper, we present the depth value accuracy requirements for novel view synthesis in 3DTV and our approach for depth camera based on hybrid method of structured light and active stereo matching. We first review the background on the use of multiview video plus depth(MVD) representation for future 3DTV system, depth acquisition methods and tools for real-time and non-real-time dense depth map acquisition in terms of performance and limitations. Then we use a simple analysis model for novel view synthesis based on DIBR to draw depth value accuracy requirements. Finally we present our approach on depth camera development along with future directions and huddles in developing real-time depth camera usable for 3DTV content production.