Yasuto Nakanishi

Vision-Based Face Tracking System for Large Displays

In this paper, we present a stereo-based face tracking system which can track the 3D position and orientation of a user in real-time, and the systems application for interaction with a large display. Our tracking system incorporates dynamic update of template images for tracking facial features so that the system can successfully track a users face for a large angle of rotation. Another advantage of our tracking system is that it does not require a user to manually initialize the tracking process, which is critical for natural and intuitive interaction. Based on our face tracking system, we have implemented several prototype applications which change information shown on a large display adaptively according to the location looked at by a user.

iCAMS: A Mobile Communication Tool Using Location and Schedule Information

We have developed a communication support system that estimates the situation of a person usingsc hedule information and location information provided by a PHS (Personal Handy Phone System). From the lessons provided by our prior studies and inventions, we developed a new mobile communication tool for cellular phones that uses location information and schedule information. This is a kind of dynamic telephone book, which we have named iCAMS. We performed user studies for eight weeks in Tokyo with a group of students and with a group of small-office workers. By analyzing the communication logs, questionnaires and interviews we conducted with the users, we evaluated our system.

Virtual prototyping using miniature model and visualization for interactive public displays

In the development of augmented spaces, it is often difficult to perform frequent prototyping and testing. A range of related problems arise, especially when the cost of operation is high or when it is difficult to implement simulation in advance within the installation space. To address these problems, the authors created an integrated environment for iteration-based development of augmented spaces that allows interactive system developers to create systems using iterative virtual simulation and trial-and-error. With this system, hybrid prototyping using both virtual and miniature simulation can be performed. This paper introduces virtual simulation based on visualization. The authors studied four prototyping and deployment processes for two interactive public displays using both methods in order to clarify their characteristics, and the respective merits and demerits were discussed. Based on the results, a prototyping strategy for interactive public displays was proposed. Basic software operations and ideal positioning of input and output devices were investigated within virtual space, problems arising from differences between virtual and real space were clarified within miniature model space, and the addition of features to the code and related adjustment were iterated within both spaces.

Ubiquitous display for dynamically changing environment

This paper proposes a novel method for ubiquitous displays using projectors in indoor environments. In particular, our method consists of two distinct features: automatic scene modeling of a dynamically changing indoor environment, and automatic selection of surfaces onto which various contents are displayed by taking into account both geometric and photometric properties. As a result, our method can be applied to dynamically changing scenes such as a meeting room where furniture and other objects are moved frequently.

Developing a GIS using a mobile phone equipped with a camera and a GPS, and its exhibitions

In this paper, we introduce our geographic information system using a mobile phone that is equipped with a camera and a GPS and its exhibitions. We aim to provide a social information spaces for local communities or towns. Users can annotate not only text notes but also photos to physical spaces by sending emails with photos and location information by GPS attached from mobile phones. Any users using such mobile phones can annotate information to physical spaces when and where they want to do it and act as content provider. We exhibited our system as a photography exhibition in Tokyo and Sendai.

Mobile communications - icams: a mobile communication tool using location and schedule information

iCAMS, a new mobile communication tool for cellular phones, uses location and schedule information. By analyzing communication logs and the results from questionnaires and user interviews, we evaluated our systemand found the following: 1) Location information is good for estimating the callees context, and enables serendipitous meetings. 2) The sorted list of communication channels in the callees priority list helps callers and callees find a nexus between the callers demands and the callees wishes. 3) We should switch location-sensing methods according to distances in both real and mental space.

Estimating communication context through location information and schedule information: a study with home office workers

We have developed a communication support system that estimates the situation of a person by using the location information of a PHS (Personal Handy phone System) and the schedule information. The system supports communication among dispersed and mobile individuals by using the estimated situation. In this paper, we describe it and a study with a small group of home office workers.

EnhancedTable: supporting a small meeting in ubiquitous and augmented environment

This paper describes our design and implementation of an augmented table interface for small group meetings. The system was designed to be used by multiple users in the ubiquitous environment, where people do not need to bring their laptop PCs. With effective use of the advantage of computer vision, we implemented the concept of ubiquitous desktop as personal workspace and virtual Chinese table as shared workspace. User can share/personalize files by drag-and-dropping icons to/from the shared workspace. The system also provides capabilities for interactive image capturing and finger position sharing, both of which would be useful for the group meetings.

iCAMS2: Developing a Mobile Communication Tool Using Location Information and Schedule Information with J2ME

In this paper, we introduce a mobile communication tool which uses location and schedule information. From the lessons learned by conducting user studies on our previous system, we made improvements by implementing the use of mobile phones equipped with a GPS and a J2ME. We conducted user studies for this new system, and the results showed that differences in the size of the area in which users move about as they conduct their daily activities might account for their different preferences.

JIKUKAN-POEMER: Geographic Information System Using Camera Phone Equipped with GPS, and Its Exhibition on a Street

In this paper, we introduce a geographic information system using camera phone equipped with GPS and its exhibitions. We have proposed a new kind of interface to see lost of pictures which have location information, and in the exhibition, we projected our system onto a shopping street in Japan and held it as a photography exhibition. We studied 700 pictures sent for the exhibition and three peculiar motifs were found.