Namho Hur

Development of High-definition 3DTV Experimental System based on Dual Stream Method

This paper introduces an development of high-definition(HD) 3DTV experimental broadcasting system and its experimental service that has been launched via three broadcasting network including terrestrial, cable and satellite in the late of 2010. This 3DTV experimental broadcasting service employs an innovative 3DTV broadcasting mechanism, called as dual stream method in which left and right images are encoded by using each video encoder and multiplexed using MPEG-2 system technology for guaranteeing backward-compatibility with legacy DTV. This paper specifically describes the developed experimental broadcasting system, concentrating on 3DTV re-multiplexer and 3DTV receiver. Finally, implementation and terrestrial 3DTV experimental broadcasting service results will be introduced from the point of objective and subjective evaluation.

Signaling and Multiplexing for Service-compatible 3DTV Broadcasting

This paper proposes a signaling and multiplexing mechanism in service-compatible 3DTV broadcasting for guaranteeing backward-compatibility with legacy DTV. Recently, 3DTV experimental broadcasting services are being developed around advanced countries and the standardization of service-compatible 3DTV broadcasting which is able to provide high-quality stereoscopic videos in progress. Based on experimental results, we confirm that proposed method can be used as a common technology and a reference model for stereoscopic video transmission over terrestial, satellite and cable DTV platforms in 3DTV broadcasting service and system development.

Multi-view Image Generation using Grid-mesh based Image Domain Warping and Occlusion Region Information

In this paper, we propose an algorithm that generates multi-view images by grid-mesh based image domain warping using occlusion mask and various image features obtained from the stereoscopic images. In the proposed algorithm, we first extract image saliency map, line segments and disparity saliency map from stereo images and then get them through a process that improves the quality of extracted features. This process is accomplished in two steps. In the first step, reliability of disparity saliency map on object boundary regions is enhanced by using occlusion information. And in the second step, we enhance the quality of image features in terms of temporal consistency by using temporal consistency information for stereo images. With these enhanced features, multi-view images are generated by grid-mesh based image domain warping technique. Experimental results show that the proposed algorithm performs better than existing algorithms in terms of visual quality.

Multi-view Image Generation from Stereoscopic Image Features and the Occlusion Region Extraction

In this paper, we propose a novel algorithm that generates multi-view images by using various image features obtained from the given stereoscopic images. In the proposed algorithm, we first create an intensity gradient saliency map from the given stereo images. And then we calculate a block-based optical flow that represents the relative movement(disparity) of each block with certain size between left and right images. And we also obtain the disparities of feature points that are extracted by SIFT(scale-invariant We then create a disparity saliency map by combining these extracted disparity features. Disparity saliency map is refined through the occlusion detection and removal of false disparities. Thirdly, we extract straight line segments in order to minimize the distortion of straight lines during the image warping. Finally, we generate multi-view images by grid mesh-based image warping algorithm. Extracted image features are used as constraints during grid mesh-based image warping. The experimental results show that the proposed algorithm performs better than the conventional DIBR algorithm in terms of visual quality.

Rich Media Services for T-DMB: 3-D Video and 3-D Data Applications

Mobile TV applications have gained a lot of interest in recent years. The ability to provide the user with a personal viewing experience as well as the flexibility to add new services have made this technology attractive for media companies and broadcasters around the world. In this chapter, we present a novel approach for mobile 3-D video and data services that extend the regular 2-D video service of the Terrestrial Digital Multimedia Broadcasting (T-DMB) system. We demonstrate the main concepts and features of our 3-D DMB approach and discuss our latest research on the efficient compression of stereoscopic 3-D imagery.

Fast Mode Decision using Global Disparity Vector for Multi-view Video Coding

Multi-view video coding (MVC) based on H.264/AVC encodes multiple views efficiently by using a prediction scheme that exploits inter-view correlation among multiple views. However, with the increase of the number of views and use of inter-view prediction among views, total encoding time will be increased in multiview video coding. In this paper, we propose a fast mode decision using both MB(Macroblock)-based region segmentation information corresponding to each view in multiple views and global disparity vector among views in order to reduce encoding time. The proposed method achieves on average 40% reduction of total encoding time with the objective video quality degradation of about 0.04 dB peak signal-to-noise ratio (PSNR) by using joint multi-view video model (JMVM) 4.0 that is the reference software of the multiview video coding standard.

Disparity-based Depth Scaling of Multiview Images

In this paper, we present a depth scaling method for multiview images that could provide an 3D depth that a user prefers. Unlike previous works that change a camera configuration, the proposed method utilizes depth data in order to carry out the scaling of a depth range requested by users. From multivew images and their corresponding depth data, depth data is transformed into a disparity and the disparity is adjusted in order to control the perceived depth. In particular, our method can deal with multiview images captured by multiple cameras, and can be expanded from stereoscopic to multiview images. Based upon a DSCQS subjective evaluation test, our experimental results tested on an automultiscopic 3D display show that the perceived depth is appropriately scaled according to user’s preferred depth.

A Method of Frame Synchronization for Stereoscopic 3D Video

In this paper, we propose a method of frame synchronization for stereoscopic 3D video to solve the viewing problem caused by synchronization errors between a left video and a right video using the temporal frame difference image depending on the movement of objects. Firstly, we compute two temporal frame difference images from the left video and the right video which are corrected the vertical parallax between two videos using rectification, and calculate two horizontal projection profiles of two temporal frame difference images. Then, we find a pair of synchronized frames of the two videos by measuring the mean of absolute difference (MAD) of two horizontal projection profiles. Experimental results show that the proposed method can be used for stereoscopic 3D video, and is robust against Gaussian noise and video compression by H.264/AVC.

Synchronization Method of Stereoscopic Video in 3D Mobile Broadcasting through Heterogeneous Network

This paper proposes a method to provide the high quality 3D broadcasting service in a mobile broadcasting system. In this method, audio and video data are delivered through a heterogeneous network, consisting of a mobile network as well as a broadcasting network, due to the limited bandwidth of the broadcasting system. However, it is more difficult to synchronize the left and right video frames of a 3D stereoscopic service, which come through different types of networks. The proposed method suggests the use of the offset from the initial timestamp of RTP (Real Time Protocol) to determine the order of frames and to find the pair of a left and a right frame that must be played at the same time. Additionally, a new signaling method is introduced for a mobile device to request a 3D service and to get the initial RTP timestamp.

Standard Technology for Digital Cable Stereoscopic 3DTV Broadcasting

This paper addresses the stereoscopic 3D broadcasting technology that delivers the 3DTV contents through the digital cable networks. In order to convey the 3D contents via DCA TV network, specifications of 3D video format, compression, multiplexing, signalling and transport are to be developed. Since 3D has some constraints unlike 2D, it is required to be well designed by considering the capacity of the additional view and the backward/forward compatibility. This paper goes with the latest trends of 3D standard, requirements and service scenarios and then covers the 3D format, compression, multiplexing and signaling, service information and transport/reception technologies.