Gopi Lakshminarayanan

Orthogonal Muxing Frame Compatible Full Resolution technology for multi-resolution frame-compatible stereo coding

This paper describes the Orthogonal Muxing Frame Compatible Full Resolution (OM-FCFR) technology that provides efficient compression and reconstruction of full resolution stereoscopic video while maintaining compatibility with stereoscopic AVC Frame Compatible (FC) bitstreams. The OM-FCFR is a dual-layer coding system and is built upon the MVC Stereo High Profile of the AVC. Orthogonal muxing is used to design the enhancement layer video signal. A “Reference Process Unit (RPU)” is employed for creating the inter-layer reference picture that can serve as a good prediction for an enhancement layer picture. Simulation results show that significant improvement over the frame compatible solution is achieved in both subjective and objective evaluations. This technology was submitted as a proposal in response to the call for proposals (CfP) on MPEG Frame- Compatible (MFC) enhancement technology issued by ISO/IEC JTC1/SC29/WG11 (MPEG) and the specification was adopted as the working draft for the MFC standard and AVC Amendment 5.

Practical operating points of multi-resolution frame compatible (MFC) stereo coding

3D content is gaining popularity and the production and delivery of 3D video is now an active working item among video compression experts, content providers and the CE industry. Frame compatible stereo coding was initially adopted for the first generation of 3DTV broadcasting services for its compatibility with existing 2D decoders. However, the frame compatible solution sacrifices half of the original video resolution. In 2012, the Moving Picture Experts Group (MPEG) issued the call for proposal (CfP) for solutions that improve the resolution of frame compatible stereo 3D video signal while maintaining the backward compatibility to legacy decoders. The standardization process of the multiresolution frame compatible (MFC) stereo coding was then started. In this paper, the solution – Orthogonal Muxing Frame Compatible Full Resolution (OM-FCFR) – as a response to the CfP is introduced. In addition, this paper provides some experimental results for broadcasters to guide them in selecting operating points for MFC. It is observed that for typical broadcast bitrates, more than 0.5dB PSNR improvement can be achieved by MFC over the frame compatible solution with only 15%~20% overhead.