Masataka Imura

Fragra: a visual-olfactory VR game

Fragra is a new Visual-Olfactory VR Game that enables players to explore the interactive relationship between olfaction and vision. For this purpose, Fragra does not always display fragrances that correspond to images. So observers must distinguish what each visual and olfactory information means and compare them.

Projection-based augmented reality with automated shape scanning

This paper presents a new framework for interactive Augmented Reality(AR) and Mixed Reality(MR) representation using both visible and invisible projection onto physical target objects. Projection-based approach for constructing AR/MR uses physical objects such as walls, books, plaster ornaments and whatever the computer generated contents can be optically projected onto, namely, projection makes it possible to use real objects as displays. What we demonstrate in this study is to employ near-infrared pattern projection for triangulation so that scanning and updating the geometry data of the object is automatically performed in background process, thus parallel processing to provide AR/MR representation can be achieved according to dynamic physical geometry changes.

Real-time generation of CG and sound of liquid with bubble

Recently, we can render real-time CG of liquid which shows various phenomena by global lighting and physical simulation according to the improvement of the computing power. However, the effect sound for real-time CG of liquid should be made corresponding to all the behavior of the liquid beforehand. Therefore, it is difficult for high reproducibility to be made for all sounds by hand. In liquid, the sound is generated according to the change of the radius of the moving bubble. Therefore, making the effect sound of liquid should consider the movement of bubbles.

Whole Shape Measurement System Using a Single Camera and a Cylindrical Mirror

This paper proposes a three-dimensional measurement system with a simple structured system. The proposed system consists of a camera with a fish-eye lens and a cylinder whose inside is coated by a silver reflective layer. A target object is placed inside the cylinder and an image is captured by the camera from right above. The captured image includes sets of points that are observed from multiple viewpoints: one is observed directly, and the other is observed via the mirror. Therefore, the whole shape of the object can be measured using stereo vision in a single shot. An actual experimental situation was simulated and the accuracy is evaluated. In addition, a prototype system was implemented and the shape of the real object was measured

Three-Dimensional measurement system using a cylindrical mirror

We propose a novel method for measuring a whole three-dimensional shape of an object with a simple structured system. The proposed system consists of a single CCD camera and a cylindrical mirror. A target object is placed inside the cylindrical mirror and an image is captured by the camera from above. There are two or more points that have the same origin in the captured image: one is observed directly, and the other is observed via the mirror. This situation means that a point is observed by a real camera and virtual cameras at the same time. Therefore, the three-dimensional shape of the object can be obtained using stereo vision. We simulated an actual experimental situation and measured the three-dimensional shape of the object from the simulated image, and the results have demonstrated that the proposed method is useful for measuring the whole three-dimensional shape.

AirGrabber: virtual keyboard using miniature infrared camera and tilt sensor

This paper presents the AirGrabber, a virtual keyboard suitable for wearable computers, by which a user can enter characters by typing in the air on a virtual keyboard. The AirGrabber detects keystrokes by monitoring the motions of the fingers and hand through a miniature camera and a tilt sensor on the users wrist.

E-cane with situation presumption for the visually impaired

The E-cane is an electronic aid equipment for the visually impaired to widely detect the obstacles that normal white cane cannot reach. We propose a situation presumption algorithm, Wall/Floor-strategy for the E-cane, which is capable of detecting the presuming the condition of spot where the blind user is stepping into. When some obstacles are recognised, E-cane informs the user about the types of the obstacles;the walls, gaps, stairs and so on by vibration and voice. This paper presents our proto-type implementation and some experimental results, that show the effectiveness of the proposed system.

Grasp motion synthesis based on object features

This paper presents a new scheme for synthesizing hand motion to grasp various objects. Hand motion has a variety of expression with its high degrees of freedom and the functional motions are especially complex and difficult to synthesize. This paper focuses on a fact that actual grasp motion varies depending on the features of the object including its size and shape, which give important clues for reproducing a proper hand motion to manipulate them. Based on this idea, we propose a scheme to sample grasp motions and synthesize the whole hand motion including approach to the object, preparation of the hand shape and grab motion. Synthesized animation demonstrated a potential for easily designing functional motions for hand animation

Development of direct manipulation interface for collaborative VR/MR workspace

Our research projects aim to connect various VR/MR platforms and to realize the seamless collaborative works with the intuitive operations whenever and wherever users like. In order to realize an ideal collaborative workspace, an effective handling scheme for both interactive virtual objects and system operation of VR/MR platform is needed. In this paper, we describe the three components, which are the direct manipulation interfaces for potable MR space and for fixed shared VR/MR space, and Interactive 3D Marker for displaying and manipulating virtual objects reflected lighting and geometry conditions of the real world. These components can give users seamless manipulation workspace by the natural operations such as they behave in their daily life. We also introduce Interactive Interior Design System using these components. This system realizes to coordinate the suitable interiors in the real space, by the free manipulation of virtual interior objects reflected the geometry and the lighting condition of the real space.

Three-Dimensional Measurement for Small Moving Object

In this paper, we propose new measurement technique of whole three dimensional shape for small moving objects. The proposed measurement system is very simple structure with the use of a CCD camera that installed a fish-eye lens and a cylinder that coating mirror inside. The CCD camera is set on the top side of the cylinder, and its optical axis is set to the center of cylinder. A captured image includes two types information. One is direct view of the target, the other is reflected view. These two information are used for measuring the shape of target by means of stereo matching. This proposed method can acquire the shape of target using only single image, so we can obtaine the three dimensional shape with the moving with the use of image sequence.