Shiro Ozawa

Highly Realistic 3D Display System for Space Composition Telecommunication

In this paper, we describe a highly realistic 3D display system that generates composites of current and remote places for telecommunication purposes. It uses a 3D projector and head tracking to display a person in a remote place as a life-size stereoscopic image against background scenery. Since it generates displayed images that correspond to the observers viewing position, it reproduces well the fidelity of existence and the feel of materials. We also describe a simple, fast, and high quality background scenery generation method, the development of which was inspired by the visual effects of depth-fused 3D (DFD) displays, and applied to a single direction conceptual demonstration system. Our system is a promising means for achieving real-time communication between two different places in cases where a sense of reality is required.

3D building facade model reconstruction using parallel images acquired by line scan cameras

This paper proposes a stereo method robust against occlusions that can reconstruct 3D building facades from images captured from a vehicle. When using ground-based views of facades, the occlusion problem caused by roadside trees and telegraph poles in urban areas is the one of the most difficult barriers. In this study, we show the stereo matching based on parallel images minimize the occlusion effect. To acquire the parallel images, we use two line scan cameras linked a rotary encoder mounted on a vehicle. Experimental results using outdoor scenes confirm the effectiveness of this method.

MoPaCo: pseudo 3D video communication system

We propose a pseudo 3D video communication system that imparts motion parallax which adjusts to the viewpoint position of a user and enables the user to view video pictures in which depth can be perceived with an ordinary equipment setup, namely a monocular camera and a 2D display. We have implemented the system and evaluation experiment results with it showed that its imparting of motion parallax allows it to represent distances that closely reflect actual face-to-face situations better than 2D video can. In addition, subjective evaluations confirmed that motion parallax gives users the feeling that the conversational partner is actually present and makes it easier for them to comprehend the positional relationship of the conversational partner in space.

Large High-Definition Multiview Display System Capable of Controlling Observation Area

We developed a large high-definition multiview projection display configured from newly developed double-sided lenticular lens, a Fresnel lens, and multiple projectors. The system projects magnified images of each projectors iris side by side using a Fresnel lens, which minimizes the crosstalk between the images in adjacent areas and creates a broad observation area with highly uniform in-plane brightness. In addition, by using an inclined screen, we developed a method to evaluate the observation area of the multiview display. The characteristics of the proposed multiview display are the easily adjustable projector arrangement and the broad observation area without crosstalk between images in adjacent areas. The proposed multiview display is expected to be useful in future teleconference and digital signed systems.

MulDiRoH: a human representation system with multi-view display using a QDA screen

In the area of teleconference systems, it is very important to have a function to enable participants to viscerally understand where a remote participant is actually looking at [Jones et al. 2009] [Feldmann et al. 2010]. A multi-view display using a parallax barrier that achieves such a function has been proposed [Takaya2007]. However, three problems have emerged in these previous studies. The first is that the systems are difficult to construct. The second is that the number of observers decreases. The third is that the observation area is very shallow.

MulDiRoH: An Evaluation of Facial Direction Expression in Teleconferencing on a Multi-view Display System

We have developed a teleconference system called MulDiRoH (Multi-Directional Representation of Humans). It features the use of a QDA screen, one of the newest multi-view display techniques. A principal benefit of multi-view displays is they can show views of a remote participant from the direction in which the participant’s face is pointing. This enables other participants to directly see the face of a remote participant who is actually looking away from them. However, all multi-view display systems share a common problem in that users who stand outside of the center area cannot observe geometrically correct images. To addressthis problem, we propose the use of the perspective transform method. We also evaluate the conveying of a person’s facial direction by a communication game for multiple users.

Highly realistic 3D display system for space composition telecommunication

In this paper, we describe a highly realistic 3D display system that generates composites of current and remote places for telecommunication purposes. It uses a 3D projector and head tracking to display a person in a remote place as a life-size stereoscopic image against background scenery. Since it generates displayed images that correspond to the observers viewing position, it reproduces well the fidelity of existence and the feel of materials. We also describe a simple, fast, and high quality background scenery generation method, the development of which was inspired by the visual effects of depth-fused 3D (DFD) displays, and applied to a single direction conceptual demonstration system. Our system is a promising means for achieving real-time communication between two different places in cases where a sense of reality is required.

Design and Evaluation of Mirror Interface MIOSS to Overlay Remote 3D Spaces

The MIOSS mirror interface can overlay two remote spaces, enabling users to feel as if they are in the same room and thereby to share 3D objects in the spaces. MIOSS imparts motion parallax through a mirror that adjusts to the viewpoint of the user, in addition to providing geometrical consistency in the occlusion, size, and positional relationships in the two remote spaces. Experimental evaluations of an implemented MIOSS system show that users can recognize the exact positions of shared objects in the partner’s space via the mirror video.

Expressing Observation Direction through Face and Body Rotation in a Multi-user Conversation Setting

In this paper we clarified the range of observing direction by rotating the 2D human image and it is possible to express the observing direction by face direction. We conducted two subjective experiments about direction expression of the person on an image. In the first experiment, we compared two types of human image expression, rotated 2D human image of rotated 2D and direction correct. In the second experiment, we evaluated the effect of human image rotation and the criterion for judging the direction. We showed that the direction of the user’s face is the main factor in expressing the observation direction. Results clearly showed that it is possible to express the observation direction, which is required for effective communication, by using only the rotation of human facial image.