Naoko Umeki

A kinetic and 3D image input device

Gesture recognition in real time can bridge a gap between humans and computers. Object segmentation from the background is a critical problem in the conventional gesture recognition technology. We have developed a new input device which can detect a kinetic and 3D image of a hand in real time. We call it “Motion Processor”. The Motion Processor with infrared light sources and an area sensor can detect the reflected light image of a hand at 30 frames per second. The image resolution is 64 pixels by 64 pixels. It is easy to recognize gestures and motions in real time based on the detected hand images. This gesture recognition bridges a gap between humans and computers.

A motional interface approach based on user's tempo

People naturally use gesture to aid inter-personal communication. However, during computer interaction, users are obliged to use conventional devices such as keyboards, mice, and game-pads. In this paper a motional interface is described that allows processing of gestural inputs through the medium of a 3D image-input device, or Motion Processor, which provides a more natural framework for human-computer interaction. Several PC applications for this real-time motional interface will be presented in the live demonstration session. These applications are edutainment prototypes that make use of natural hand movement.

Sensation of movement in virtual space

Our objective was to develop a compact system for training watchmen in their rounds, suitable for use on a standard computer. A virtual space was created by means of computer graphics. The most important aspect of learning the watchmans rounds is familiarization with the route, including distances, directions, and visual features. A method in which visual and aural cues were used to give a sense of traversing a distance equal to that in the real space is described. Tests showed that when the visual information included a simulation of the watchman (the “virtual user”) moving just ahead of the trainee and when a slight rolling of the visual field was used to simulate the motion of walking, the trainees had the sense of having covered a distance close to the actual distance represented in the simulation.

Visual engineering system - VIGOR:Virtual environment for visual engineering and operation

We have developed a visual and interactive system bridging among systems developers, human factors engineers, human operators, and clients. The system - VIGOR(Virtual environment for visual engineering and operation) has six components; a virtual space, a virtual user, interactive operation, dynamic simulation, physical simulation, and rendering. The virtual space component has a new LOD (level of detail) method, physical locate constraints, behavioral and structural representations of objects, and adequate fonts in order to offer high quality image, high speed, and natural interaction. The virtual user works in the virtual space instead of a real human operator. We can quantitatively compare layout alternatives, measuring motions, visibility, and reach assessment using the virtual user. We have applied VIGOR to the operation room design, hospital facilities layout, social human interface design, and operation and patrol training.