Junghak Kim

Design and Implementation for Interactive Augmented Broadcasting System

In a typical augmented reality (AR), users can rotate, resize, or move AR objects, usually in application programs on handheld devices. In addition, users can instruct them to do an animation. Moreover, various types of application programs are provided and various ways of interactions are tried out for more natural user experience. On the other hand, in regular TV, an AR-applied TV program may be a composite video of original video and AR objects, which was already processed by the transmit side of broadcasting system and thus the TV viewer cannot influence the representation of TV program. Thus, until now, it can be said that an authentic AR service on TV broadcasting is not practically provided. In this paper, a new alternative paradigm of AR service in TV broadcasting is introduced. To provide an interactive AR experience to the viewer, first of all, we propose that the place where the original video and the augmented objects are composited needs to be moved from the transmit side to the TV terminal. Therefore, all augmented objects should be graphically rendered on the TV terminal. Considering the prerequisite, we propose an augmented broadcasting service system based on a hybrid framework that combines the conventional TV broadcasting and the broadband Internet. In the proposed system, the augmented objects are downloaded and rendered in compliance with instructions described in a metadata. The metadata includes the time information to synchronize the representation of the original video images and the rendered augmented-object images. And the metadata is delivered in compliance with MPEG-2 system. Inevitably, the architecture of the MPEG-2 transmission stream multiplexer should be slightly modified to insert the time information for the synchronously compositing. The metadata should be packetized in compliance with the MPEG-2 system. So, we propose a packetized elementary stream format for the metadata. Additionally, we propose an interaction mechanism using a second-screen device that supports touch-screen capability. With second-screen devices, TV viewers can manipulate the augmented objects displayed on TV screen. Moreover, a lot of additive contents synchronized or correlated to TV programs can be automatically popped up on the screen of second-screen device.

Home appliances controlling through Smart TV set-top box with screen-mirroring remote controller

The legacy TV is now being replaced by IP-connected Smart TV which offers more advanced computing ability and connectivity. Smart TV also allows the user to install and run more advanced applications based on a specific platform. Smart TV is expected to play the role of a hub which combines wide variety of solutions for digital living services in home in the near future. In this paper, we present a home appliance control framework based on Smart TV set-top box. The purpose of this framework is to keep users leaning back and watching TV screen and then to provide them with an intuitive and convenient way to monitor and control home appliances. The proposed framework supports not only IP-based but also conventional RS-485-based home appliances.

High speed pattern matching for deep packet inspection

In communication equipments, pattern matching techniques are used to handle various requirements, such as network security, QoS and so on. This paper presents a pattern matching technique to process multiple characters at a single clock cycle. And this paper presents the way to find a particular pattern from communication packets using TCAMs.

An implementation of energy-saving set-top box

This paper introduces an implementation example of a digital TV set-top box which has energy-saving capability. This energy-saving set-top box supports four types of power states: active on, active standby, deep-sleep passive standby, and off. Particularly, in the deep-sleep passive standby state, the level of power consumption of the set-top box goes down to less than 1 watt. And the set-top box can wake up from the deep-sleep passive standby state to go back to the active on state in less than 10 seconds.

Activation pattern based standby mode scheduling for power-efficient set-top box

In this paper, activation pattern based standby mode scheduling is proposed for reducing power consumption of a set-top box during standby state where a set-top box does not receive broadcast services. The set-top box with the standby mode scheduling finds mainly used time (i.e., when users mainly uses the set-top box) and seldom used time by analyzing record of its activation pattern. The set-top box saves power consumption by scheduling passive standby mode (i.e., the lowest power mode) during seldom used time, and reduces time for activating by scheduling active standby mode during mainly used time.

Programmable architecture for NFA-based string matching

In this paper, we propose a programmable string matching architecture to process multiple characters at a single cycle. To simplify the architecture of the previous works, we employ a method of realigning the input data stream by offsets. We show that some registers can be eliminated by using the method. Additionally, we present two different approaches to implement a programmable hardware for string matching on FPGA. We show the synthesis results for these two approaches.

Disaster training and response based on digital signage and augmented reality technologies

This paper introduces a system for disaster training and response based on digital signage and augmented reality technologies. The system provides images and sounds for disaster training and response and evaluates whether the systems user of the system follows the display or not. The evaluation works by using image analysis and IoT communications. If the user does not follow the display, the system can provide additional images and sounds that can improve degree of the users understanding. The system is expected for the user to improve their ability for disaster training and response.

Home appliance control framework based on smart TV set-top box

Most modern smart TV set-top boxes support internet connection and allow the user to install and run more advanced application programs or plugins/add-ons based on a specific platform. It means that a smart TV set-top box can be a good candidate to act as a hub that combines a wide variety of solutions for smart home services. This paper proposes a home appliance control framework based on a smart TV set-top box. As a core component, a home gateway software module is installed on the smart TV set-top box. And the architecture of the home gateway module is designed so that a home appliance control driver is installed only when necessary. To enable the user to control their home appliances in any place using a Web-based application or a Web browser, the proposed framework supports a WebSocket protocol-based data communication and comprises a Web server where each set-top boxs network location is registered. The proposed framework is verified with a demonstration on a small-scale home model. Both IP-based and serial communication-based home appliances are included in the demonstration system. The demonstration examples show that consumers can control various types of home appliances in any place through a smart TV set-top box solution.

A framework for energy-efficient operation of set-top boxes

This paper introduces a framework for the efficient operation of energy-saving set-top boxes, with consideration for updates of applications and EPG information. The energy-saving set-top box supports a deep-sleep passive standby state in which almost all functional modules are stopped and turned off except those required for a fast wake-up, so that the power consumption level goes down to less than 1 watt. However, if the set-top box stays in the deep-sleep passive standby state, applications or EPG cannot be updated. To overcome the shortcomings, this paper proposes a mechanism that remotely wakes up the set-top box using wake-on-LAN capabilities and makes it go into an active standby state for a moment so that applications or EPG can be updated.

An implementation of adaptively power-managed set-top box

This paper introduces an implementation example of an adaptive power management framework applicable to a digital TV set-top box which has energy-saving capability. The energy-saving set-top box supports a deep-sleep passive standby state in which almost all hardware functional modules are turned off except those required for a fast wake-up. Eventually, in the deep-sleep passive standby state, the power consumption level of the set-top box goes down to less than 1 watt. However, if the set-top box stays in the deep-sleep passive standby state, it can miss out the updated version of applications and EPG information. But, such shortcomings can be overcome using a mechanism for controlling power-management state transition based on set-top box usage patterns, which was proposed in the preliminary work related to this paper. This paper proposes two different methods of implementing the adaptive power management framework for the energy-saving set-top box. And this paper also shows some demonstration results.