Yoonsik Yang

Personal Smart Space: IoT Based User Recognition and Device Control

Recently with the developments of smart devices and IT technologies, studies to construct the smart space are being conducted. The approach these studies took is to support automations in the smart space and to control devices and the space itself. In this study, we focus on reducing simple and repetitive actions of the users by recognizing each user. Saving and applying configurations of the space and device via sensors and vision technologies. Furthermore, we propose concept ideas of various applications for devices with displays such as Smart TV and Smart Window.

Interactive features based augmented reality authoring tool

This paper intends to propose an authoring tool system that allows users to easily create augmented reality content with the application of marker based and gesture interactions. It is possible to generate a simplified form of marker based augmented reality content with the user interface by using Kinect that enables gesture interaction. We seek to provide methods for the user to actively interact with augmented reality content. The interaction method we put forth in this study is a gesture interaction approach capable of Transfer, Rotate, Enlarge, and Shrink an object by recognizing and tracking the users bare hand. As for marker based interaction methods, there is one employing two markers and another using marker occlusion. We ascertain the positive results of this study from the user evaluation of an authoring tool system and marker based and gesture interactions.

EMG Sensor-based Two-Hand Smart Watch Interaction

These days, smart watches have drawn more attention of users, and many smart watch products have been launched (Samsung Gear series, apple watch and etc.). Since a smart watch is put on the wrist, the device should be small and unobtrusive. Because of these features, display of the smart watch is small and there is a limitation to interaction. To overcome the limitation, many studies are conducted. In this paper, we propose a two-hand interaction technique that obtains posture information of a hand using electromyography (EMG) sensor attached to the arm and to make input interaction to a smart watch different depending on each posture. EMG sensors recognize information about a users hand posture, and the non-dominant hand is used for smart watch inputs. In this way, different function is executed depending on postures. As a result, a smart watch that has limited input methods is given a variety of interaction functions with users.

Mobile Augmented Reality Authoring Tool

This paper propose a mobile Augmented Reality authoring tool interface that allows users to easily create Augmented Reality (AR) content with marker based and touch based interactions. It is possible to generate a simplified form of marker based AR content with the user interface. As for marker based interaction methods, there is one employing two markers and another using marker occlusion. This suggesting AR authoring tool system is providing another interaction method which is touch based interaction. This mobile AR authoring tool system recognizes user rotate, transfer, zoom-in and zoom-out gestures for virtual object. We seek to provide approaches for the user to actively interact with augmented reality content and ascertain the positive results of this study from the user evaluation of an authoring tool system and interaction.

Gesture-based interactive augmented reality content authoring system using HMD

This paper proposes an augmented reality content authoring system that enables ordinary users who do not have programming capabilities to easily apply interactive features to virtual objects on a marker via gestures. The purpose of this system is to simplify augmented reality (AR) technology usage for ordinary users, especially parents and preschool children who are unfamiliar with AR technology. The system provides an immersive AR environment with a head-mounted display and recognizes users’ gestures via an RGB-D camera. Users can freely create the AR content that they will be using without any special programming ability simply by connecting virtual objects stored in a database to the system. Following recognition of the marker via the system’s RGB-D camera worn by the user, he/she can apply various interactive features to the marker-based AR content using simple gestures. Interactive features applied to AR content can enlarge, shrink, rotate, and transfer virtual objects with hand gestures. In addition to this gesture-interactive feature, the proposed system also allows for tangible interaction using markers. The AR content that the user edits is stored in a database, and is retrieved whenever the markers are recognized. The results of comparative experiments conducted indicate that the proposed system is easier to use and has a higher interaction satisfaction level than AR environments such as fixed-monitor and touch-based interaction on mobile screens.

DesignAR: Portable projection-based AR system specialized in interior design

This research paper proposes a system for interior design prototyping based on portable-type projection-based AR (Augmented Reality). The DIY (do it yourself) interior designing process takes much time, monetary resources and labor. To overcome such difficulties, many research studies in the have been undertaken in the field of AR. Among those studies, projection-based AR technology provides users virtual information that is very real by projecting new digital information onto things and spaces. Most of those studies employing projection-based AR technology have been carried out in predefined spaces. In this paper, a projection-based AR system that can be used to design interiors of non-predefined spaces was proposed. This DesignAR system can effectively design interiors, even in the spaces not predefined by a 3D map of the space. Also, by connecting with mobile devices, the system raises the users degree of freedom due to the interface usability, mobility and overall convenience. In order to evaluate the effectiveness of the proposed system, we set up a scenario for interior design prototyping. A usability evaluation was conducted by questionnaire after users performed tasks based on a preset scenario.

Realtime plane detection for projection Augmented Reality in an unknown environment

We propose a realtime plane detection method for projection-based Augmented Reality (AR) system in an unknown environment. While previous works usually designate space, the plane detection method automatically detects multiple planes based on the proposed constrained sampling strategy in RAndom SAmpleing Concensus (RANSAC). For each plane, an area for projection is selected for contents while considering occlusions by other objects. In addition, when the multiple planes are detected, the importance for contents is measured by the score functions based on the properties of planes such as size, color, and position. The proposed method can guide users to select plane for projection by visualizing the importances, or can automatically select a plane according to the users. We achieves a significant improvement in speed (about 260 times faster than the RANSAC) and high precision. These technique has become widely utilized in various AR applications such as AR game, and etc.

A Pervasive Assistive Robot System Including Projection-Camera Technology for Older Adults

Here we present a projection augmented reality (AR) based assistive robot, which we call the Pervasive Assistive Robot System (PARS). The PARS aims to improve the quality of life by of the elderly and less able-bodied. In particular, the proposed system will support dynamic display and monitoring systems, which will be helpful for older adults who have difficulty moving their limbs and who have a weak memory.We attempted to verify the usefulness of the PARS using various scenarios. We expected that PARSs will be used as assistive robots for people who experience physical discomfort in their daily lives.

cARe-bot: Portable Projection-based AR Robot for Elderly

An estimated 20 percent of the world»s population experience difficulties with physical, cognitive and mental health. Senior citizens experience many inconveniences due to less memory and mobility as a function of the aging process. To solve this, the cARe-bot system was designed to dynamically provide optimal information in the actual environment at any time or place. It is also designed to increase an elder person»s ability to live in a house or in senior homes with daily support, thus establishing the convenience and comfort they knew throughout their lives. The hardware of this system is a 360-degree controllable projection system. It is made with a pan-tilt system, projector, and a depth-recognition camera. Arduino is attached in order to control two sets of servo-motors, and is connected to a PC, which controls the entire process.

PAMI: Projection Augmented Meeting Interface for Video Conferencing

Video conferencing, which helps gather opinions and make decisions quickly among employees who are not in the same location, is now a very important communication tool in the workplace. Our research is one of these video conferencing solutions, specifically proposed to address the difficulties of analog materials sharing and feedback, and has added some useful features for the smooth use of conference participants. We conducted a comparative experiment on our proposed method of file sharing and the method that we had previously used in video conferencing. As a result, the proposed system yielded better results in terms of time and usability during a full-scale collaborative situation in which feedback was provided.