Jae-Kwan Yun

User-friendly home automation based on 3D virtual world

Home automation refers to a system that is used to control devices around the home. These devices can include doors, lights, surveillance systems, and consumer electronics. A user can control a variety of home devices with the help of a home automation system. To provide mobility, a mobile phone-based home automation has been developed. As another approach toward home automation, an Internet-based home automation system has been proposed, providing a graphic user interface. However, these systems lack userfriendliness and are neither intuitive nor realistic. To improve the user-friendliness of the interface, a 3D view interface was designed. However, its level of realism was low. In this study, to provide a more realistic interface, a 3D virtual world is adopted as the user interface for a home automation system. Additionally, a home server is used as a controller for home devices. As an information exchange format between the virtual and the real world, a control protocol that works under a standardization process is introduced. With the help of a 3D virtual world, a user can control and monitor home devices via a user-friendly interface that works both intuitively and realistically anywhere and anytime through the Internet.

Development of the real-sense media broadcasting service system based on the SMMD

Recently, as the development of the 3D contents service, production of the real-sense media (ne-media) that user can feel physical effects by the scene of the movie has been increased. This kind of the ne-media uses the SMMD (Single Media Multiple Devices) method to give users enhanced effects with playing multiple devices rather than the SMSD (Single Media Single Device) method. To give this effect to users, from the beginning of making one media, we produced ne-media that consists of multiple subject related audio/videos and the SEM (Sensory Effect Metadata) to evaluate physical device controls. The ne-media is transmitted to the HS (home server) to represent multiple audio/videos in multiple A/V players and multiple devices with synchronized way. In this paper, we explained about basic system concepts, sensory effect metadata, system architecture, and how to represent ne-media in multiple devices.

Orchestral Media: The Method for Synchronizing Single Media with Multiple Devices for Ubiquitous Home Media Services

Future digital home is changing into actual feeling/intelligence ubiquitous home, and the future media will include not only audio, video, text but also synchronizing information, control information to be interlocked media with user peripheral devises. To play these new-type of media, there needs efficient media/device synchronization method and multiple devices control technology. Therefore, we will explain active device and passive device synchronization, media/device synchronization, and multiple devices control methods for the SMMD media service system.

Real-sense media synchronization technology based on the SMMD

Recently, the requirements for the real-sense media representation are arising rapidly. Until now, most people mainly used the method SMSD on one device, but we need more than one device to play multiple A/V and multiple sensory effects for effective real-sense media representation. Therefore, multiple A/V device synchronization and multiple sensory effect device synchronization are very important part of real-sense media representation. In this paper, we suggest concept of the real-sense media playback, real-sense media playback system architecture, and synchronization algorithm between multiple A/V devices and multiple sensory effect devices.

Media/playback device synchronization for the 4D broadcasting service system

In these days, various 4D media service system which can give users a lot of special effects (eg., wind, heat, light, vibration, scent effect, ect.) according to the contents has been developed with the increment of 3D media consumptions. Also, standardizations for presenting events in the virtual world to the real world are continuously progressed in the MPEG forum, and companies have developed systems to play media efficiently in the field of game, entertainment, education. These 4D systems are also adapted to the 4D broadcasting services. The 4D broadcasting service systems can transfer captured image from camera with SI(Sensory Information) on the spot to the home server of users. Therefore, there needs researches of the method for acquiring, inserting, time synchronizing, and transferring SI with captured 3D contents. To do this, in this paper, we explained the system architecture of the 4D broadcasting service system, acquiring time methods from an aggregator, time synchronization method between 3D contents and SI.

Multiple devices synchronization and control architecture for orchestral media service system

Future digital home is changing into actual feeling/intelligence ubiquitous home, and the future media will include not only audio, video, text but also synchronizing information, control information to be orchestral media with user peripheral devices. To play this orchestral media, there needs efficient media/device synchronization method and multiple devices control technology. Therefore, we will explain active device and passive device synchronization, media/device synchronization, and multiple devices control methods for orchestral media.

Annotation creation and representation system of sensory effects based on MPEG-V

In a case of adding sensory effect metadata to media and generating sensory experience based media to provide a sensory experience media service, this paper provides a method of generating an annotation of to a sensory effect to enable a user to add the sensory experience metadata faster and more easily and conveniently, and a method of generating the sensory effect metadata based on the generated annotation.

Implementation of CoM footboard sensor for lower limb rehabilitation

Usually people are getting poor sense of balance by getting older or sometimes they lose it by accident. The poor sense of balance causes dizziness, which makes people unable to enjoy normal activities due to dizziness-related problems. In this paper, we propose a CoM (Center of Mass) footboard sensor for lower limb rehabilitation. It measures not only the position of feet, but also the weight degree of feet. Also, it senses the pressure degree of elbow and heel. So, it is possible to analyze straight standing or sense of balance that straight walk of the user.

A vestibular rehabilitation system with real-sense experiences based on multiple sensory media

In this paper, a vestibular rehabilitation system is proposed, which provides for realistic experiences based on multiple sensory media. Postures of vestibular rehabilitation exercises are taken by multiple cameras for multiple A/V media and their reference motion data are generated for similarity analysis. Watching the multiple media contents on multiple display devices and taking postures according to the exercise program, patients take advantages of sensory effect and the vestibular rehabilitation. The effectiveness of the proposed system is enhanced by accuracy analysis of exercise and realization sensory effects.

Development of sensory effect representing system adapting user preferences and device capability

Making films in 3D has become popular and successful by providing 3D effects. Even by providing more effects on top of the 3D effects, it is possible to provide more immersion in terms of user experience by adding sensory effects other than the traditional video and audio. Especially, 4D movies which includes sensory effects, such as wind, vibration, lighting, scent and so on, can stimulate human sensory system by deployed sensory effect devices such as fans, motion chairs, lighting devices and scent generators. As for sensory effects, sensory effect devices have different capacities and performances. Moreover, users also have their own preferences on sensory effects in consuming multimedia. The system proposed in this paper can adapt the capacity of the sensory effect devices and the preference of the consumers. By using this system, users can have different effects even though the 4D media has single descriptive sensory effect metadata.