Kyu-Heon Kim

Verification of Technical Specification of Stereoscopic Video over MPEG-2 TS for 3DTV Service

Stereoscopic video for 3DTV service is emerging as a main content of the Post-HD age in the multimedia industry, and also it starts a ripple effect to build infrastructure for 3DTV service throughout the related industries such as creating contents, consumer electronics and the broadcasting. Thus, Technical Specification of Stereoscopic Video over MPEG-2 TS for 3DTV Service for providing a standard for 3DTV broadcasting transmitter and receiver interface is under development by the 3DTV WG8061 in ITA, Korea. This paper provides verification of the functionalities, problems and future work of the above specification with designed test-bed. Through making a test bed, this paper try to verify not only the functionality of standard but also backward compatible for the present technology and abstract problems to would be reviewed and supplemented.

Signaling and Multiplexing for Service-compatible 3DTV Broadcasting

This paper proposes a signaling and multiplexing mechanism in service-compatible 3DTV broadcasting for guaranteeing backward-compatibility with legacy DTV. Recently, 3DTV experimental broadcasting services are being developed around advanced countries and the standardization of service-compatible 3DTV broadcasting which is able to provide high-quality stereoscopic videos in progress. Based on experimental results, we confirm that proposed method can be used as a common technology and a reference model for stereoscopic video transmission over terrestial, satellite and cable DTV platforms in 3DTV broadcasting service and system development.

Design and implementation of XMT-A to/from MP4 converter for authoring and retrieving MPEG-4/7 based interactive contents

In MPEG-4, two types of file format such as MPEG-4 file format (MP4) and eXtensible MPEG-4 textual format WMT) are defined for the composition of objects. Since, MP4 and XMT are describing the MPEG-4 based interactive multimedia contents in different ways, such as binary and text, each format have their advantages and disadvantages. Therefore, the converting from one to the other format is one of the essential functionality for efficient authoring, streaming and management of multimedia contents based on MPEG-4. And as the development of the digital broadcasting, we have seen a vast increase in digital contents. Therefore it .needs retrieve the interactive MPEG-4 contents easily. In this paper, design and implementation of XMT-A to/from MP4 converter for authoring and retrieving the MPEG-4/7 based interactive multimedia contents is presented.

Design of 3D Video Delivery Format for HTTP Adaptive Streaming Service

Recently, 3D stereoscopic video and HTTP adaptive streaming technologies have received a lot of attention from relevant industrial fields and markets in terms of multimedia contents and delivery services, respectively. It is expected that promising and marketable service models can be created by means of these noticeable two technologies. However, current standard specifications do not provide a method for organized connection between those two technologies. 3D stereoscopic video services are weighted in broadcasting and storage services that are only available under environments in which the network bandwidth is guaranteed or free. Also, HTTP adaptive streaming technologies only provide plain 3D service methods that are dependent on particular Codec. Therefore, this paper proposes 3D video delivery format for HTTP adaptive streaming service which enables stable and seamless display for various stereoscopic video sequences over internet networks. The proposed technology is designed on the basis of Stereoscopic Video Application Format which is a service-oriented standard specification for storing stereoscopic video sequences. Also, this delivery format is directly applicable over DASH that is the representative standard technology for HTTP adaptive streaming services. The delivery format proposed in this paper has been submitted to MPEG and it has been accepted as a working draft, thus it expected to pave the way for practical industrialization in relevant fields from now on.

User Profile Based Seamless Framework under HTTP Adaptive Streaming Environment

Recently, with the digitalization of a broadcasting system and the development of a communication technology, the existing trend of consuming media contents throughout the fixed-displayer and the dedicated channel is being changed. The existing user only could consume media contents under limited time and places because of the fixed-displayer and the dedicated channel. However, with advent of the IP-based terminals and HTTP adaptive streaming which transfer the media sequence according to the user`s transmission condition, users become possible to enjoy the media content anytime anywhere. As the result of the alteration of the broadcasting surrounding, users can enjoy the media content while changing his terminals according to their preferences and circumstances. However, in case that users try to consume consecutively the content from last view-point ended in the previous terminal under current HTTP adaptive streaming environment, a user has to remember the last view-point, and then has to apply the view-point to the changed terminal. Thus, for solving this problem, this paper defines User Profile for describing the metadata for the chained content consume environment between the terminals. Also, for proving the proposed method, this paper try to demonstrate the proposed method throughout the realization of the system based on Smooth Streaming from Microsoft.

Design of MPEG-2 Transport Stream specification for stereoscopic video broadcasting service

Stereoscopic video service is one of the most widely adopted technologies for 3-Dimensional technology. However, the stereoscopic video service has not been penetrated into the market since there does not exist a proper transmission method even though the conventional MPEG-2 Transport Stream (TS) has support for broadcast service of mono-scopic video contents. This is partly because the MPEG-2 TS does not support displaying a stereoscopic video content which consists of several composition types widely used in the market. This paper proposes the new MPEG-2 TS specification suitable for transmitting and displaying stereoscopic video contents. In order to show feasibility of the proposal, this paper describes an end-to-end system which is implemented with consideration of the method how to multiplex and de-multiplex stereoscopic video contents as well as keeping backward compatibility with the traditional MPEG-2 TS.

A study on performance evaluation of DVCs with different coding method and feasibility of spatial scalable DVC

Distributed video coding is a new video coding paradigm based on Slepian-Wolf and Wyner-Ziv`s information theory Distributed video coding whose decoder exploits side information transfers its computational burden from encoder to decoder, so that encoding with light computational power can be realized. RD performance is superior than that of standard video coding without motion compensation process but still has a gap with that of coding with motion compensation process. This parer introduces basic theory of distributed video coding and its structure and then shows RD performances of DVCs whose coding style is different from each other and of a DVC as a spatial scalable video coder.

Design and Implementation of Hybrid Network Associated 3D Video Broadcasting System

ATSC is currently working on standardization of hybrid 3DTV broadcasting service in heterogenous network environment after completion of service-compatible 3DTV broadcasting service standard based on broadcasting channel. This paper proposes a convergence 3D video broadcasting method on broadcasting and IP network while guaranteeing a Full-HD 3D quality without degrading the image quality of legacy DTV. Specifically, this paper describes transmission of the 3D additional video using the ISO/IEC 23009-1 DASH, robust synchronization method under heterogenous network environments and system target decoder model for hybrid 3DTV receiver. Based on experimental results, we confirm that proposed technologies can be used as a core technology in the hybrid 3DTV standardization and a reference model for a development of hybrid 3DTV encoder and receiver. Keyword : 3DTV, ATSC, Hybrid, Stereoscopic, DTV, STD 정규논문 (Regular Paper) 방송공학회논문지 제19권 제5호, 2014년 9월 (JBE Vol. 19, No. 5, September 2014) http://dx.doi.org/10.5909/JBE.2014.19.5.687 ISSN 2287-9137 (Online) ISSN 1226-7953 (Print) 688 방송공학회논문지 제19권 제5호, 2014년 9월 (JBE Vol. 19, No. 5, September 2014) 그림 1. 이종망 연동형 3D 비디오 방송서비스 개념도 Fig.1. Conceptual diagram of hybrid network associated 3D video broadcasting service I. 서 론 사용자의 몰입감과 현장감을 극대화할 수 있는 실감 미 디어는 “스마트”로 대표되는 정보통신 분야의 개발 방향과 함께 사회의 키워드로 점차 자리 매김하고 있다. 실감 미디 어는 공간과 시간의 제약을 극복하고 인간에게 자연감과 사실감을 극대화 할 수 있는 미디어로서 현장감/입체감을 제공하는 3D 분야 및 초고화질을 제공하는 UHD 분야를 중심으로 핵심기술을 선점하기 위한 노력이 전 세계적으로 진행되고 있다 . 특히 3D 영화의 성공은 3D 미디어를 극 장과 같은 특화된 환경이 아닌 댁내와 같은 일반 시청환경 하에서도 현장감과 입체감을 제공하기 위한 노력이 지속적 으로 이어지고 있으며, 이와 같이 시청자에게 대용량의 고 화질 3D 콘텐츠를 제공하는 하나의 방법으로 다양한 네트 워크의 융합을 통한 서비스로 발전되고 있다 . ATSC(Advanced Television System Committee), DVB (Digital Video Broadcasting) 및 TTA(Telecommunications Technology Association) 등 전 세계 표준단체를 중심으로 제정된 서비스호환 3DTV 방송방식은 기존 DTV와 호 환성을 유지하면서 3D 비디오를 한 프레임 내 다중화한 단 일 영상을 서비스하는 프레임호환 3DTV 방송서비스에 비하여 고화질의 3DTV 방송서비스가 가능하나 기존 방송 망 대역폭을 통하여 좌우영상을 제공함으로써 Full HD 화 질을 제공하지 못하는 단점이 있다 . 이를 반영하듯 ATSC 는 2012년 12월 방송망기반 서비스호환 지상파 3DTV 방 송서비스 표준 완료 이후 현재 방송망 및 IP망을 결합한 하 이브리드 3DTV 방송서비스에 초점을 맞추어 표준화를 추 진 중에 있다. 하이브리드 3DTV 방송서비스는 스마트TV 환경 하에서 기존 DTV 화질 열화 없이 시청자에게 FULL HD 3D 비디오 제공이라는 핵심 요구사항을 토대로 이종망 연동 3D 비디오 전송에 따른 시그널링, 좌우영상 동기화 및 수신기 내에서 안정적인 3D 비디오 재생을 위한 시스템 타겟 디코더 모델이 핵심기술로 요구되고 있다 . 이에 본 논문에서는 이종망기반의 하이브리드 3DTV 방 송서비스를 위하여 필수적으로 요구되는 시그널링, 동기 화 및 시스템 타겟 디코더 모델을 제시하고 이를 기반으로 한 하이브리드 3D비디오 방송시스템을 제안한다. 이를 위 해 본 논문의 II장에서는 제안한 이종망 융합형 3D 비디오 방송서비스 개요, 서비스 시그널링 구조, 이종망기반 3D 비디오 동기화 및 시스템 타겟 디코더 모델 등 핵심기술을 설명하고, III장에서는 제안한 기술을 토대로 3D 비디오를 송수신하기 위한 방송시스템 개발 및 실험결과를, 마지막 으로 IV장에서 결론 및 향후 연구에 대하여 기술한다. II. 이종망 연동형 3D 비디오 방송서비스

HTTP Adaptive Streaming Method for Service-compatible 3D Contents Based on MPEG DASH

Recently, many consumer electronics manufacturers have produced 3D devices such as 3DTVs and 3D monitors as interests in a stereoscopic video service are getting increased. However, most of 3D services are focused on local storage or bandwidth guaranteed service since 3D stereoscopic video service require bandwidth more stable and larger. This property causes difficulties in seamless stereoscopic video streaming services under IP based open network environment that cannot guarantee quality of services. In order to achieve a seamless video streaming service the international standard organization MPEG (Moving Pictures Experts Group) has developed the adaptive HTTP streaming technology called as DASH (Dynamic Adaptive Streaming over HTTP). However, the DASH doesn`t have obvious scheme which can express the two elementary video streams based service-compatible stereoscopic contents in one segment. Therefore, this paper proposes a scheme of efficient 3D adaptive streaming service based on the DASH, which covers not only frame-packing stereoscopic contents but also service-compatible ones. The 3D adaptive HTTP streaming scheme introduced in this paper is able to provide 3D contents with various qualities to user and also has benefit that single 3D content can be applied to a variety of devices.

T-DMB Hybrid Data Service Part 1: Hybrid BIFS Technology

Fast developments of broadcasting technologies since 1990s enabled not only High Definition Television service providing high quality audiovisual contents at home but also mobile broadcasting service providing audiovisual contents to high speed moving vehicle. Terrestrial Digital Multimedia Broadcasting (T-DMB) is one of the technologies developed for mobile broadcasting service, which has been successfully commercialized. One of the major technical breakthroughs achieved by T-DMB in addition to robust vehicular reception is an adoption of framework based on MPEG-4 System. It naturally enables integrated interactive data services by using Binary Format for Scene (BIFS) technology for scene description and representation of graphics object and Object Descriptor Framework representing multimedia service components as objects. T-DMB interactive data service has two fundamental limitations. Firstly, graphic data for interactive service should be always overlaid on top of a video not to be rendered out of it. Secondly, data for interactive service is only received by broadcasting channel. These limitations were considered as general in broadcasting systems. However, they are being considered as hard limitations for personalized data services using location information and user characteristics which are becoming widely used for data services of smart devices in these days. In this paper, the architecture of T-DMB hybrid data service is proposed which is utilizing broadcasting network, wireless internet and local storage for delivering BIFS data to overcome these limitations. This paper also presents hybrid BIFS technology to implement T-DMB hybrid data service while maintaining backward compatibility with legacy T-DMB players.