Yun-Gu Lee

Video Deblurring Algorithm Using Accurate Blur Kernel Estimation and Residual Deconvolution Based on a Blurred-Unblurred Frame Pair

Blurred frames may happen sparsely in a video sequence acquired by consumer devices such as digital camcorders and digital cameras. In order to avoid visually annoying artifacts due to those blurred frames, this paper presents a novel motion deblurring algorithm in which a blurred frame can be reconstructed utilizing the high-resolution information of adjacent unblurred frames. First, a motion-compensated predictor for the blurred frame is derived from its neighboring unblurred frame via specific motion estimation. Then, an accurate blur kernel, which is difficult to directly obtain from the blurred frame itself, is computed using both the predictor and the blurred frame. Next, a residual deconvolution is applied to both of those frames in order to reduce the ringing artifacts inherently caused by conventional deconvolution. The blur kernel estimation and deconvolution processes are iteratively performed for the deblurred frame. Simulation results show that the proposed algorithm provides superior deblurring results over conventional deblurring algorithms while preserving details and reducing ringing artifacts.

Video deblurring algorithm using an adjacent unblurred frame

Blurred frames may sparsely exist in a video sequence acquired by digital camcorder or digital camera. In order to remove the visually annoying artifact due to those blurred frames, this paper presents a novel motion deblurring algorithm where a blurred frame can be reconstructed utilizing adjacent unblurred frames. Firstly, a motion-compensated predictor of the blurred frame is derived from its neighboring unblurred frame using motion estimation. Then, an accurate blur kernel, which is difficult to obtain from a single blurred frame, is computed using both the predictor and the blurred frame. Next, again using those both frames, a residual deconvolution is proposed to reduce ringing artifacts inherent to conventional deconvolution. Simulation results show that the proposed algorithm provides superior deblurring results over conventional deblurring algorithms while preserving details with reduced ringing artifacts.

A Simultaneous View Interpolation and Multiplexing Method using Stereo Image Pairs for Lenticular Display

Nowadays, the slanted lenticular display becomes a representative one among the commercially introduced autostereoscopic displays. The paper presents a simple method to correct the lenticular alignment error by compensating the correction coefficients to the view number determination formula. Then, based on the corrected view numbers, the proposed algorithm simultaneously performs floating-point viewpoint generation and multiplexing on the scanline using the stereo image pairs and its depth information. Experimental results show that lenticular images, in which distortion and artifact due to lenticular alignment error are considerably reduced, are generated rapidly by using the proposed algorithm.

1080p 60 Hz Intra-Frame Video CODEC Chip Design and Its Implementation

This paper presents a 1080p 60 Hz intra-frame CODEC system for zero delay AV streaming. For high quality streaming, the proposed CODEC employs an RGB-domain inter-color compensation algorithm using strong correlation between RGB color components which was previously presented by the authors of this paper. The proposed CODEC architecture is based on macroblock-level pipelining and parallel processing to handle a significant pixel rate of 1080p 60 Hz videos with RGB 4:4:4 format, i.e., 3 Gbps. Since syntax processing is a bottleneck to supporting speeds of up to 100 Mbps in real-time, a high performance context-adaptive variable length coding architecture exploiting the look-ahead technique is included in the proposed design. Also, the number of syntax symbols is adaptively restricted to accomplish zero end-to-end delay. Finally, by using MPEG-2 TS as the AV stream format, compatibility with general channel chips is guaranteed. Using TSMC 90 nm CMOS technology, the prototype chip is implemented with 1,208 K logic gates and 359 Kb internal SRAM. The chip can achieve real-time encoding and decoding of 1080p 60 Hz videos at 200 MHz execution speed in typical work conditions.

An 18ms-latency wireless high quality codec SoC for full HD streaming

An SoC integrating both an IEEE 802.11n Wireless LAN (WLAN) and a high quality codec is implemented using 90nm CMOS technology for wireless connectivity between full HD video-supporting devices. The WLAN operates with up to 270-Mbps data rates using 2×3 MIMO technologies and the codec supports up to 1080P 60Hz resolution with 30-bit RGB color format. The system achieves total 18ms latency, which enables this SoC to be used in gaming consoles and PCs as well as full-HD digital TVs with 1.5W power consumption.

1080P 60HZ intra-frame CODEC based on RGB color space for wireless AV streaming

To achieve high visual quality of intra-frame coding in order to minimize the visual quality degradation caused by color loss, the authors previously presented an RGB-domain inter-color compensation algorithm using strong correlation between RGB color components. Based on that inter-color compensation algorithm, this paper presents a 1080p 60Hz CODEC system architecture designed to process a bit-rate of up to approximately 100Mbps in real time. Both the encoding and decoding processes are pipelined on a macroblock level. Since syntax processing is a bottleneck to supporting speeds of up to 100Mbps, a high performance context-adaptive variable length coding architecture exploiting the look-ahead technique is included in the proposed design. The final chip implementation can achieve real-time encoding and decoding of 1080p 60Hz videos with reasonable hardware cost and operating clock frequency.