Hark-Joon Kim

AR pen and hand gestures: a new tool for pen drawings

This paper explores the interaction possibilities when artists use their non-dominant hand, while drawing with a pen in their dominant hand. We propose a new interactive AR-based pen tool which can overlay virtual images onto a physical drawing in real time. This system allows artists to control the augmented images with gestures of a non-dominant hand while drawing. By interacting with the visually augmented contents using hand gestures and a pen bimanually, artists can draw pictures more creatively. We also made a standalone pen system integrated with a pico-projector and a camera, and suggest a set of useful scenarios for the conventional pen-and-paper drawing.

Modeling the Types of Interaction with Ambient Environment

This paper proposes a new modeling methodology about the interaction with the ambient environment such as tables, windows, physical objects and so on. We analyzed interaction factors in existing scenarios that involve the interaction, and then classified the result of analysis. We made modeling elements though the classification results and designed modeling method combining the elements. The modeling method can reduce the time to understand the existing interactions or the interactions that are designed by co-workers. Moreover, we believe that it can be useful when designers make a new scenario or modify the existing scenarios.

Ambient surface: enhancing interface capabilities of mobile objects aided by ambient environment

We introduce Ambient Surface, an interactive surrounded equipment for enhancing interface capabilities of mobile devices placed on an ordinary surface. Object information and a users interaction are captured by 2D/3D cameras, and appropriate feedback images are projected on the surface. By the help of the ambient system, we may not only provide a wider screen for mobile devices with a limited screen size, but also allow analog objects to dynamically interact with users. We believe that this demo will help interaction designers to draw new inspiration of utilizing mobile objects with ambient environment.

Virtual Bridge: AR-Based Mobile Interaction for Easy Multimedia Control of Remote Home Devices

This paper proposes an interaction for controlling multimedia contents of remote devices using a mobile device based on AR technology. Using a real-time object recognition method, home devices detected by the camera of a mobile device are displayed on the camera preview screen along with the thumbnails of their own multimedia contents around the recognized positions. A user may drag a multimedia content which he or she wants to play, and drop it onto another target home device which he or she wants to play the content through. The user study showed that the proposed interaction expects higher usability since once a home device is registered with its device name when registering its image shown on the mobile camera for the object recognition, this matching process is no longer necessary when a user controls the device through the mobile device.