Shuta Nakamae

FistPointer: Target Selection Technique using Mid-air Interaction for Mobile VR Environment

We present a target selection technique using mid-air interaction behind a smartphone for mobile virtual reality (VR) environments. This is realized by using a smartphone as a head-mounted display with a cardboard viewer. Our technique displays a pointer on the screen corresponding to the position of the hand, which is detected by the built-in back camera of the smartphone. The user can move the pointer by moving the hand in a thumbs-up position. The user can also select a target by folding the thumb, similarly to pushing a joystick button. Our technique can be implemented using only a smartphone with a built-in back camera; therefore, it is easy to apply to target selection in mobile VR environments. To test the feasibility of the design, we prototyped a proof-of-concept implementation. Furthermore, we developed a game using our technique and investigated user impressions.

Bubble Cloud: Projection of an Image onto a Bubble Cluster

We introduce Bubble Cloud ---a technology that uses a bubble cluster for displaying images onto a screen. Bubble Cloud projects images onto bubbles without confining a fog and can float in the air by changing an operating condition of the bubble cluster such as altering the size of the bubble. Moreover, the user can modify the display because its shape is composed of clusters. A floating bubble cluster can be controlled and adjusted by hand in arbitrary directions by electrifying the bubble cluster.

RootCap: Touch Detection on Multi-electrodes using Single-line Connected Capacitive Sensing

In designing interactive products, it is important for designers to test the products usability by manufacturing its shape and interface iteratively through rapid prototyping. The goal of our research is to provide the designers with an additional touch sensing method for rapid prototyping interactive products with flat, curved, or flexible surface. In this paper, we present RootCap, a capacitive touch sensing method that can detect a touch on a multi-electrode input surface while maintaining the characteristics of a single-line connection. The key concept behind realizing this goal is the imposition of unique capacitance on each electrode (including the capacitor connected to the touch electrode) branching from the single-line connection. Moreover, we developed a technique for creating a capacitor by printing silver nanoparticle ink on both sides of a sheet of paper, supporting designers in the creation of a multi-electrode input surface, on which each electrode has a unique capacitance.

Children's Social Behavior Analysis System Using BLE and Accelerometer.

We present an IoT-based children’s social behavior analysis system aimed at young children and elementary school students. Our system uses BLE-based ID logs to analyze daily social behaviors, such as how a child spent the day with his/her friends. Furthermore, we also use accelerometer logs to detect the period when the user (i.e., a child) was with friends or not, and what kind of activity (e.g., walking or staying in one place) the user was involved in. We conducted a five-day experiment with four families using our system. We also interviewed the families’ parents and compared their responses with the analyzed results to investigate the accuracy of the above detection and usability of our system. The result shows that our system can detect the period when the child was with other friends or alone, as well as the activity (s)he was involved in.

A Development of Participatory Sensing System for Foreign Visitors in PBL

In this project, we design a system to realize user participatory sensing. This system collects, organizes and visualizes data such as problems of foreign visitors in a city, thereby allowing city officials use that information for making decisions on various city policies. Furthermore, foreigners can be supported by the volunteers from city officials through exchanges of posts and comments in the application. One major problem is that many volunteers are not good at English. To alleviate this language barrier, we adopt a machine translation service and verified whether the service can serve as a communication method between application users.

BLE-Based Children’s Social Behavior Analysis System for Crime Prevention

We propose an IoT-based children’s behavior analysis system for crime prevention, aimed at infants and elementary school students. The system logs children’s behavior with accelerometers and Bluetooth low energy (BLE). We conducted a preliminary experiment with a test application to examine whether BLE-based ID logs can be used to analyze daily social behaviors, such as how a child spent the day with his or her friends. The results suggest that the history of behavior with a child’s friends was acquired accurately. Furthermore, the system could detect the period when the user (that is, a child) was with friends or not, and what kind of activity (for example, walking or staying in one place) the user was involved in.

Bubble Clouds: 3D Display Composed of Soap Bubble Cluster

We examine Bubble Clouds composed of a bubble cluster for a three-dimensional display. A bubble cluster is flexible in that its shape can be modified and it can float in the air with helium gas confinement of the bubbles. By varying the density of the bubble clusters, we project images onto the bubbles without requiring fog confinement or use of special equipment. Moreover, we investigate whether a soap bubble cluster can become interactive by electrifying it.