Glenn Van Wallendael

Encryption for High Efficiency Video Coding with video adaptation capabilities

In this paper, we describe encryption possibilities for the High Efficiency Video Coding (HEVC) standard under development. Bitstream elements which maintain HEVC compatibility after encryption are listed and their impact on video adaptation is described. From this list, three bitstream elements are selected, namely intra prediction mode difference, motion vector difference sign, and residual sign. These elements provide good protection of the video information and result in 0.0% Bjontegaard delta bitrate increase because of their equal probability entropy encoding property.

Improved intra mode signaling for HEVC

In the current development of HEVC, compression performance improved significantly compared to H.264/AVC for both inter pictures and intra pictures. With intra compression, the main reason for this improvement is the large increase in intra prediction directions (up to 34). The downside of having a larger number of modes is that they increase the signaling overhead in the bitstream. In this paper, a low complexity intra mode prediction algorithm is proposed which improves the mode prediction accuracy. This is achieved by exploiting the correlation between the prediction directions of the neighboring prediction units and that of the encoded prediction unit. As a result, more efficient intra mode signaling can be achieved with minimal impact on encoder and decoder complexity. On average, 0.33% bitrate improvement is obtained by employing the proposed algorithm. For sequences that are encoded with a high number of directional intra modes, around 1% bitrate improvement is measured.

Fast transrating for high efficiency video coding based on machine learning

To incorporate the newly developed High Efficiency Video Coding (HEVC) standard in real-life network applications, efficient transrating algorithms are required. We propose a fast transrating scheme, based on the early prediction of the partition split-flags in P pictures. Using machine learning techniques, the correlation between co-located partitions at different quantizations is investigated. This results in a model which predicts the split-flag and gives the associated prediction accuracy so that the splitting process in the transcoder is optimized. At each partition depth, the model indicates whether the full rate-distortion cost evaluations should be performed at the current depth, or if the partition can be split immediately. Experimental results show that the proposed transcoder reduces the complexity of the transrating process by 76.04%, while maintaining the coding efficiency of a cascaded decoder-encoder.

No-reference bitstream-based impairment detection for high efficiency video coding

Video distribution over error-prone Internet Protocol (IP) networks results in visual impairments on the received video streams. Objective impairment detection algorithms are crucial for maintaining a high Quality of Experience (QoE) as provided with IPTV distribution. There is a lot of research invested in H.264/AVC impairment detection models and questions rise if these turn obsolete with a transition to the successor of H.264/AVC, called High Efficiency Video Coding (HEVC). In this paper, first we show that impairments on HEVC compressed sequences are more visible compaired to H.264/AVC encoded sequences. We also show that an impairment detection model designed for H.264/AVC could be reused on HEVC, but that caution is advised. A more accurate model taking into account content classification needed slight modification to remain applicable for HEVC compression video content.

Fast H.264/AVC-to-SVC Transcoding in a Mobile Television Environment

Mobile TV environments demand flexible video compression like Scalable Video Coding (SVC) because of varying bandwidths and devices. Since existing infrastructures highly rely on H.264/AVC video compression, network providers could adapt the current H.264/AVC encoded video to SVC. This adaptation needs to be done efficiently to reduce processing power and operational cost. Since a cascaded decoder-encoder solution is too complex to be practical, we developed a mechanism to encode scalable video streams from existing H.264/AVC encoded video streams. This paper proposes a novel technique to accelerate the encoding of SVC streams by reusing information from the H.264/AVC stream and the base layer. We achieved a complexity reduction of 52%, while only an insignificant bit rate increase is reported (0.2%). According to these results, an H.264/AVC-to-SVC transcoder is usable with a low operational cost without compromising the coding efficiency.

Efficient Bit Rate Transcoding for High Efficiency Video Coding

High efficiency video coding (HEVC) shows a significant advance in compression efficiency and is considered to be the successor of H.264/AVC. To incorporate the HEVC standard into real-life network applications and a diversity of other applications, efficient bit rate adaptation (transrating) algorithms are required. A current problem of transrating for HEVC is the high computational complexity associated with the encoder part of such a cascaded pixel domain transcoder. This paper focuses on deriving an optimal strategy for reducing the transcoding complexity with a complexity-scalable scheme. We propose different transcoding techniques which are able to reduce the transcoding complexity in both CU and PU optimization levels. At the CU level, CUs can be evaluated in top-to-bottom or bottom-to-top flows, in which the coding information of the input video stream is utilized to reduce the number of evaluations or to early terminate certain evaluations. At the PU level, the PU candidates are adaptively selected based on the probability of PU sizes and the co-located input PU partitioning. Moreover, with the use of different proposed methods, a complexity-scalable transrating scheme can be achieved. Furthermore, the transcoding complexity can be effectively controlled by the machine learning based approach. Simulations show that the proposed techniques provide a superior transcoding performance compared to the state-of-the-art related works. Additionally, the proposed methods can achieve a range of trade-offs between transrating complexity and coding performance. From the proposed schemes, the fastest approach is able to reduce the complexity by 82% while keeping the bitrate loss below 3%.

Predicting full-reference video quality measures using HEVC bitstream-based no-reference features

This paper presents bitstream-based features for perceptual quality estimation of HEVC coded videos. Various factors including the impact of different sizes of block-partitions, use of reference-frames, the relative amount of various prediction modes, statistics of motion vectors and quantization parameters are taken into consideration for producing 52 features relevant for perceptual quality prediction. The used test stimuli constitutes 560 bitstreams that have been carefully extracted for this analysis from the 59, 520 bistreams of the large-scale database generated by the Joint Effort Group (JEG) of the Video Quality Experts Group (VQEG). The obtained results show the significance of the considered features through reasonably accurate and monotonic prediction of a number of objective quality metrics.

Fast motion estimation for closed-loop HEVC transrating

Transrating is a useful tool for adapting the bitrate of a video stream. Reducing the complexity of transrating is extremely important, especially for high efficiency video coding (HEVC) based transrating where the encoder is very time consuming. TZSearch is currently the default integer motion estimation (ME) algorithm in the HEVC reference encoder thanks to its excellent performance in reducing the complexity of ME. However, this algorithm is characterized by a fixed search area and search pattern, which can be considered sub optimal for transrating. In this paper, we improve the performance of HEVC transrating by optimizing this TZSearch algorithm. Utilizing the correlation between input and output motion vectors, we propose a fast search scheme including three steps. First, the initial search point is selected. Then, using the rate-distortion cost of this starting point, the search size is determined according to an online-trained Bayes decision rule. Finally, two proposed search algorithms are described for refining the starting point. Experimental results show that our proposed TZSearch scheme can reduce the complexity of transrating while improving the coding performance in terms of bit rate saving.

Format-compliant encryption techniques for high efficiency video coding

When middlebox devices should be able to adapt an encrypted video stream in the network without having the decryption key, format-compliant partial encryption schemes should be applied. In this paper, we propose such encryption schemes for the recently standardized High Efficiency Video Coding (HEVC) standard. By encrypting specific syntax elements like the sign of the residual information, the sign of the motion vector (MV) difference, the MV prediction index, and the MV reference index, format compliance and the possibility for adaptation are offered. Scrambling performance gradually increases when shifting from encrypting the motion information to encrypting the residual sign and finally to the combination thereof. Applying all these techniques has a negligible impact on the compression efficiency.

Multi-loop quality scalability based on high efficiency video coding

Scalable video coding performance largely depends on the underlying single layer coding efficiency. In this paper, the quality scalability capabilities are evaluated on a base of the new High Efficiency Video Coding (HEVC) standard under development. To enable the evaluation, a multi-loop codec has been designed using HEVC. Adaptive inter-layer prediction is realized by including the lower layer in the reference list of the enhancement layer. As a result, adaptive scalability on frame level and on prediction unit level is accomplished. Compared to single layer coding, 19.4% Bjontegaard Delta bitrate increase is measured over approximately a 30dB to 40dB PSNR range. When compared to simulcast, 20.6% bitrate reduction can be achieved. Under equivalent conditions, the presented technique achieves 43.8% bitrate reduction over Coarse Grain Scalability of the SVC - H.264/AVC-based standard.