Tomoji Toriyama

3D video system for capturing unexpected moments in daily life

In this paper, we propose a new free-view video system that generates 3D video from arbitrary point of view, using multiple cameras. When target objects are captured by these cameras, the PC allocated to each capturing camera segments the objects and transmits the masks and color textures to a 3D modeling server via the systems network. The modeling server then generates 3D models of each object from the gathered masks. Finally, the server generates a 3D video at the designated point of view with the 3D model and texture information. In 3D modeling, a reliability-based shape-from-silhouette technique reconstructs a visual hull by carving a 3D space based on the intra-/inter-silhouette reliabilities. In final view rendering, we use a cinematographic camera control system and an ARToolkit to control virtual cameras.