Ji Hyung Park

Select-and-point: a novel interface for multi-device connection and control based on simple hand gestures

Select-and-Point provides us with a new interface and intuitive interaction style in our daily computer use. With simple selection and pointing hand gestures, users can eliminate cumbersome processes in managing connections and controls between multiple devices as well as in sharing information/data. We implemented a Select-and-Point system in an intelligent meeting room and performed a preliminary user study in this environment. The results show that Select-and-Point is easily accepted by users and it can significantly improve users interaction with various devices in a ubiquitous computing environment.

Gesture-Based Interface for Connection and Control of Multi-device in a Tabletop Display Environment

In this paper, we propose a gesture-based interface for connection and control of multiple devices in a ubiquitous computing environment. With simple selection and pointing gestures, users can easily control connections between multiple devices as well as manage information or data between them. Based on a robust gesture recognition algorithm and a virtual network computing technology, we implemented this concept in an intelligent meeting room consisting of a tabletop, interactive wall displays, and other popular devices such as laptops and mobile devices. We also performed a preliminary user study in this environment, and the results show the usability of the suggested interface.

Wave touch: educational game on interactive tabletop with water simulation

In this paper, we present an underwater exploration game called Wave Touch, designed specifically for a category of devices known as, interactive tabletops. The game provides users with a fun way to learn about important historical artifacts. An emphasis is placed on making Wave Touch entertaining to the user, a goal which is satisfied through the use of interactive tabletops and realistic water simulation. We also present the techniques we used to enable real-time water simulation effects in the game.

AnywhereTouch: Finger Tracking Method on Arbitrary Surface Using Nailed-Mounted IMU for Mobile HMD

Owing to the development of mobile head mounted display (HMD)s, a mobile input device is becoming necessary in order to manipulate virtual objects which are displayed in an HMD anytime and anywhere. There have been many research studies using ray-casting technique for 3D interactions using an HMD. However, traditional ray-casting-based interactions have limitations of usability due to additional cumbersome input devices along with their limited recognition area. In this paper, we propose the AnywhereTouch, a finger tracking method using nailed-mounted inertial measurement unit (IMU) to allow a user to easily manipulate a virtual object on arbitrary surfaces. The AnywhereTouch activates recognizing process for touch input events when a user’s finger touches on an arbitrary surface. It calculates the initial angle of rotation between a finger and the arbitrary surface. Then the AnywhereTouch tracks the position of a fingertip using inverse kinematics models with the angle detected by the IMU. The AnywhereTouch also recognizes tap and release gestures through analyzing changes of acceleration and angular velocity. We expect the AnywhereTouch to provide effective manipulation for the adoption of anywhere touching gesture recognition in the mobile HMD.

Effect of aesthetic design elements on tabletop display interaction

Recent technology developments in the field of tabletop display systems have provided new types of user experiences that were unavailable in traditional vertical displays. While substantial amount of work has been done on new technologies and usability tests for a tabletop display system, not much attention was focused on aesthetic design aspect. In this paper, we studied the effect of aesthetic design elements on tabletop display interactions, especially focusing on users emotional satisfaction and usability. For this purpose, two different tabletop display systems, one aesthetically well designed with 5 selected design elements (color, typography, form, graphic, and sound) and the other not, were tested in an intelligent collaborative environment. The user study showed that an aesthetically well-designed tabletop system not only influenced users emotional satisfaction but also usability by enhancing the abilities in human perception, and eventually affected overall user experience with the system.