Yukinori Matsumoto

Conversion system of monocular image sequence to stereo using motion parallax

A three-dimensional reconstruction system -- the 3DR system -- has been developed. The main feature of the 3DR system is that it converts monocular image sequences to stereoscopic ones. This provides the following advantages: (1) Stereoscopic images can be reproduced even from films taken in the past. (2) A compact 3D-scene capturing system using a monocular camera is realized. The key 3DR technology is depth sensing based on motion parallax. A novel technique for motion analysis is proposed where, according to classification of motion vectors using the stability and colinearity, an iterative operation is performed to obtain an accurate solution. Preliminary evaluations have shown that not only was the motion parallax analyzed very accurately but also stereoscopic images of high quality were generated.

Multicamera 3D modeling system to digitize human head and body

A multi-camera 3D modeling system to digitize a human head and body is presented in this paper. The main features of this system are as follows: 1) Fast capturing: Both of texture images and pattern images can be taken within a few seconds using multiple digital still cameras which are set around the target human. Slide projectors are also set to provide a color line patterned light on the target for pattern image capturing, 2) Realistic Shape and Texture: The whole shape and photo-realistic textures of the human head including hair can be digitized at a time on a personal computer, and 3) Hybrid Algorithm: Our modeling algorithm is based on a hybrid method where the Shape-from-Silhouette technique and the Active-Stereo technique are combined. In the first step, the rough shape of the target is estimated in a voxel space using our Extended Shape-from-Silhouette method. In the next step, the shape is refined based on the depth-map data that is calculated using a multi-camera active stereo method. This combination makes up for the shortcomings of each method. Our system has been applied to the digitizing several Japanese people using sixteen cameras for texture image capturing and twelve cameras and two projectors for pattern image capturing. Its capturing time is approximately three seconds and calculation time is about 15-20 minutes on a personal computer with the Pentium-III processor (600MHz) and 512MB memory to digitize the whole shape as well as the texture of the human head and body.

CyberModeler: a compact 3D scanner based on monoscopic camera

A 3D scanner based on a monoscopic camera is presented in this paper. The scanner, CyberModeler, is capable of reconstructing 3D shapes as well as obtaining texture information of a target object form multiple camera views. The CyberModeler is a compact, easy-to-use, and inexpensive system because it does not require any special ray such as laser. Several new techniques are featured in the CyberModeler: voting-based Shape-from-Silhouette, calibration using the Hough method, and texture acquisition using an energy minimization technique. These lead to robust use in real-world environments as well as wide applicability to viewing applications. Our experiments showed that not only was the quality of the models generated high enough for viewing but also the modeling speed was at an acceptable practical level.