Jiro Tanaka

AR-Based Point System for Game-like Shopping Experience

Point system is structured marketing strategy offered by merchants to encourage consumers to continue to buy goods or pay for the services. According to the spending, merchants give consumers a certain amount of points as reward. These points can be exchanged into a good or service but not back into cash. However, as a result of the low rate of reduction, the attraction of point system to consumers is not enough, especially in the case of micropayment. This paper calls for the design of innovative technologies to provide consumers with value guidance and improve user intention, e.g., by applying gamification and AR technique. In this paper, we use mission to provide consumers with meaningful task like living a healthy life, protecting environment and promoting local economy. Point will be given if mission is completed. If completed mission reaches a certain number, the level will be upgraded. Consumer can use level information to compete with friends. If a consumer keeps completing a specific mission, he or she can get a badge. Merchant will confirm mission for consumers. In addition, we tried to use point system to solve the inconvenience caused by the small changes during the payment.

Trip Together: A Remote Pair Sightseeing System Supporting Gestural Communication

We present Trip Together, a remote pair sightseeing system supporting gestural communication between a user remaining indoor and a remote partner going outside. With the integration of Head-mounted Display and Depth Camera, we allow the local user to perform a gestural interaction with the remote user on top of the remote scene while each user is provided an independent free viewpoint. Using Trip Together, two side of users could get a feeling that they are truly walking outdoor together side by side for a trip. We have received positive feedback from a preliminary user study.

Using Body Movements for Running in Realistic 3D Map

We developed a running support system using body movements as input in a realistic 3D Map. The users use their body movements to control movements in the 3D map. We used depth-camera sensor to track the user’s body joints movement as the user moves. The location changes are tracked real-time and the system calculates the speed, which will be used as speed control in our system. This means when the users run in the real life, they will also feel like running in the system naturally. The user will feel the realistic aspect of our system because the speed changes with the user’s speed. Realistic 3D map from Zenrin is used in our system. The map consists of several detailed featured such as traffic signs, train station, and another natural feature such as weather, lightning, and shadow. Therefore, we would like to help the users feel more realistic and have some fun experiences.

A Lifelog Viewer System Supporting Multiple Memory Cues

Lifelog means using wearable devices to record human’s life automatically which can help users recall. More and more lifelog cameras with multiple sensors become available to the public. To view the vast amount of lifelog photos captured by the devices, the manufacturers provide supporting viewer systems. However, current systems only enable users to view the photos in time order by installing the specialized software. Previous research stated that memories can be recalled by memory cues, such as where the event happened, who was involved. In this research, we intend to find out the most important memory cues that help people recall and create a new lifelog viewer system to help users recall past more efficiently without increase the burden on users. To find out which cues appear more in events remembered by people, we conducted several experiments. The proposed new lifelog viewer system can recognize object, location, face and time information in lifelog photos automatically and show photos according to these memory cues information instead of in time order. With the system, users can retrieve photos of past events via these multiple memory cues. We also conducted a preliminary user study to evaluate, the results show the validity of the proposed system.

Shopping Together: A Remote Co-shopping System Utilizing Spatial Gesture Interaction

In this paper, we introduce a remote co-shopping system–Shopping Together for two geographically separated people: an in-house user who remains in a house and an in-store user who goes to a shopping place. We support the two of users to achieve a real-time two-way spatial gestural interaction in the physical shopping world where the in-store user stays, with an attention awareness subsystem to enhance a common feeling. The in-house user accesses to the remote shopping venue with an immersive shopping feeling, while the in-store user experiences an augmented reality feeling. Through our system, users could accomplish a shopping task together and share a Shopping together feeling which means a sensation that they are going for purchase together in the same space.

Realizing multi-touch-like gestures in 3D space

In this paper, our purpose is extending 2D multi-touch interaction to 3D space and presenting a universal multi-touch gestures for 3D space. We described a system that allows people to use their familiar multi-touch gestures in 3D space without touching surface. We called these midair gestures in 3D as 3D multi-touch-like gestures. There is no object or surface for user to touch in 3D space, so we use depth camera to detect fingers’ state and estimate whether finger in the “click down” or “click up”, which show user’s intention to interact with system. We use machine learning to recognize hand shapes. While we do not need to precessing the recognition all the time, we only recognize hand shape between “click down” or “click up”.

Gesture-based Mobile Communication System Providing Side-by-side Shopping Feeling

This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.

Interactive Online Shopping with Personalized Robot Agent

Recently, the interaction between human and intelligent agents has become an increasingly hot topic. In this area, entertainment has always played a very important role as an essential element in enriching the user experience. At this research we combined Robohon, a new generation of smart robots, to act as a new type of agent to achieve a better shopping experience through interaction with personal computers and human, which we called as tripartite guiding system. A lot of voice and action is used as the main elements to interact with humans. In the process, the intelligent robot acts as a guide to help people with a better shopping experience step by step.