Je-Ha Ryu

Haptic interaction in realistic multimedia broadcasting

In this paper, we discuss a haptically enhanced multimedia broadcasting system. Four stages of a proposed system are briefly analyzed: scene capture, haptic editing, data transmission, and display with haptic interaction. In order to show usefulness of the proposed system, some potential scenarios with haptic interaction are listed. These scenarios are classified into passive and active haptic interaction scenarios, which can be fully authored by scenario writers or producers. Finally, in order to show how the haptically enhanced scenario works, a typical example is demonstrated to explain specifically for a home shopping setting.

Haptic interaction with depth video media

In this paper we propose a touch enabled video player system. A conventional video player only allows viewers to passively experience visual and audio media. In virtual environment, touch or haptic interaction has been shown to convey a powerful illusion of the tangible nature – the reality – of the displayed environments and we feel the same benefits may be conferred to a broadcast, viewing domain. To this end, this paper describes a system that uses a video representation based on depth images to add a haptic component to an audio-visual stream. We generate this stream through the combination of a regular RGB image and a synchronized depth image composed of per-pixel depth-from-camera information. The depth video, a unified stream of the color and depth images, can be synthesized from a computer graphics animation by rendering with commercial packages or captured from a real environment by using a active depth camera such as the ZcamTM. In order to provide a haptic representation of this data, we propose a modified proxy graph algorithm for depth video streams. The modified proxy graph algorithm can (i) detect collisions between a moving virtual proxy and time-varying video scenes, (ii) generates smooth touch sensation by handling the implications of the radically different display update rates required by visual (30Hz) and haptic systems (in the order of 1000Hz), (iii) avoid sudden change of contact forces. A sample experiment shows the effectiveness of the proposed system.

Client system for realistic broadcasting: a first prototype

This paper presents a prototype of a client system for Realistic Broadcasting that can receive and process immersive media. It provides a viewer which supports stereoscopic video display and haptic interaction with the displayed media. The structure of the system is introduced and each component is described. In order to show the feasibility of Realistic Broadcasting, a home shopping channel scenario is applied to the system and its demonstration is performed in an exhibition. We also discuss users comments and directions for improving of Realistic Broadcasting.

A haptically enhanced broadcasting system

In this paper, we discuss a haptically enhanced broadcasting system. Four stages of a proposed system are briefly analyzed: scene capture, edit, transmission, and display with haptic interaction. In order to show usefulness of the proposed system, a potential home shopping scenario is implemented.