Jinwook Shim

Interactive features based augmented reality authoring tool

This paper intends to propose an authoring tool system that allows users to easily create augmented reality content with the application of marker based and gesture interactions. It is possible to generate a simplified form of marker based augmented reality content with the user interface by using Kinect that enables gesture interaction. We seek to provide methods for the user to actively interact with augmented reality content. The interaction method we put forth in this study is a gesture interaction approach capable of Transfer, Rotate, Enlarge, and Shrink an object by recognizing and tracking the users bare hand. As for marker based interaction methods, there is one employing two markers and another using marker occlusion. We ascertain the positive results of this study from the user evaluation of an authoring tool system and marker based and gesture interactions.

Fast Contour-Tracing Algorithm Based on a Pixel-Following Method for Image Sensors

Contour pixels distinguish objects from the background. Tracing and extracting contour pixels are widely used for smart/wearable image sensor devices, because these are simple and useful for detecting objects. In this paper, we present a novel contour-tracing algorithm for fast and accurate contour following. The proposed algorithm classifies the type of contour pixel, based on its local pattern. Then, it traces the next contour using the previous pixel’s type. Therefore, it can classify the type of contour pixels as a straight line, inner corner, outer corner and inner-outer corner, and it can extract pixels of a specific contour type. Moreover, it can trace contour pixels rapidly because it can determine the local minimal path using the contour case. In addition, the proposed algorithm is capable of the compressing data of contour pixels using the representative points and inner-outer corner points, and it can accurately restore the contour image from the data. To compare the performance of the proposed algorithm to that of conventional techniques, we measure their processing time and accuracy. In the experimental results, the proposed algorithm shows better performance compared to the others. Furthermore, it can provide the compressed data of contour pixels and restore them accurately, including the inner-outer corner, which cannot be restored using conventional algorithms.

EMG Sensor-based Two-Hand Smart Watch Interaction

These days, smart watches have drawn more attention of users, and many smart watch products have been launched (Samsung Gear series, apple watch and etc.). Since a smart watch is put on the wrist, the device should be small and unobtrusive. Because of these features, display of the smart watch is small and there is a limitation to interaction. To overcome the limitation, many studies are conducted. In this paper, we propose a two-hand interaction technique that obtains posture information of a hand using electromyography (EMG) sensor attached to the arm and to make input interaction to a smart watch different depending on each posture. EMG sensors recognize information about a users hand posture, and the non-dominant hand is used for smart watch inputs. In this way, different function is executed depending on postures. As a result, a smart watch that has limited input methods is given a variety of interaction functions with users.

Prototype of learning tool with augmented reality and natural hand interaction using depth sensing camera

Interests in education are growing all over the world and many methods to raise their learning effects have been suggested in the past few years. Especially, when augmented reality is used in the learning process, a learner can manipulate objects in ones perspective in addition to obtaining knowledge that cannot be experienced in the real world or traditional learning environment. In this case, the learner can directly control objects by using ones creativity or keeping up ones learning pace in accordance with the users abilities, thus aiding ones learning process rather than merely providing fragmentary knowledge. This paper deals with a prototype application of augmented reality which is intended to improve the learning effect by letting users directly interact with augmented content during the learning process.

The development of a detection system for seniors' accidental fall from bed using cameras

For many seniors, patients, and vulnerable people, an accidental fall could bear consequences serious enough to be life-threatening. Accordingly, increasing expenditure on the prevention of accidental fall has been a trend in the developed countries. One of the methods of preventing an accidental fall includes a quick notification to the caregiver. In order to detect and inform an accidental fall speedily, methods using accelerometer, infrared light, ultrasound and camera images have been extensively researched. This paper developed a system of monitoring the patient beds upon receiving the camera images through movement detection using difference image and foreground-background segmentation image which discovered the patients location. It also verified the performance of that system.

Mobile Augmented Reality Authoring Tool

This paper propose a mobile Augmented Reality authoring tool interface that allows users to easily create Augmented Reality (AR) content with marker based and touch based interactions. It is possible to generate a simplified form of marker based AR content with the user interface. As for marker based interaction methods, there is one employing two markers and another using marker occlusion. This suggesting AR authoring tool system is providing another interaction method which is touch based interaction. This mobile AR authoring tool system recognizes user rotate, transfer, zoom-in and zoom-out gestures for virtual object. We seek to provide approaches for the user to actively interact with augmented reality content and ascertain the positive results of this study from the user evaluation of an authoring tool system and interaction.

Gesture-based interactive augmented reality content authoring system using HMD

This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

Enhancing marker-based AR technology

In this paper, we propose a method that solves both jittering and occlusion problems which is the biggest issue in marker based augmented reality technology. Because we adjust the pose estimation by using multiple keypoints that exist in the marker based on cells, we can predict the strong pose on jittering. Additionally, we can solve the occlusion problem by applying tracking technology.

MSL_AR toolkit: AR authoring tool with interactive features

We describe an authoring tool for Augmented Reality (AR) contents. In recent years there have been a number of frameworks proposed for developing Augmented Reality (AR) applications. This paper describes an authoring tool for Augmented Reality (AR) application with interactive features. We developed the AR authoring tool which provides Interactive features that we can perform the education service project and participate it actively for the participating education service. In this paper, we describe MSL_AR Authoring tool process and two kinds of interactive features.

Interactive Augmented Reality Authoring System using mobile device as input method

The proposed system is a user-friendly interactive Augmented Reality Authoring System, which is for users with basic knowledge of augmented reality or without programming skills. The user can wear the head-mounted display and easily create AR content by using sensors on mobile devices. The user can also directly apply a variety of methods to interact with the AR content. Interaction with the AR content is enabled by using the users hand, which is recognized by the camera attached to the HMD, and the mobile devices sensor data. In order to evaluate the effectiveness of the proposed system, a system prototype was presented to users. A usability test was conducted with regard to AR content production and interactive tasks.