IEEE Transactions on Image Processing (TIP)
Sung-Ho Bae, Jaeil Kim and Munchurl Kim
HEVC-based Perceptually Adaptive Video Coding using a DCT-based Local Distortion Detection Probability Model
DCT-based just noticeable difference (JND) profiles have widely been applied into human perception based video coding to reduce perceptual redundancy, which is one of the main goals of perceptual video coding (PVC). However, there are two problems for this approach: (i) the JND value of each transform coefficient is estimated for a fixed sized DCT kernel (e.g., 8x8), but flexible coding structures with variable sized transform units have been utilized in standard video coding frameworks such High Efficiency Video Coding (HEVC); and (ii) the DCT transform coefficients are suppressed by the amounts of JND values for the removal of perceptual redundancy, but the DCT transform coefficients of residues are not sufficiently suppressed due to many small transform coefficient values in mid- and high frequency regions below the JND values. In order to solve these problems, we propose a more generalized visibility model in DCT domain, called the DCT-based Local Distortion Detection Probability (LDDP) model that can estimate a degree of distortion visibility for any distribution of the transform coefficients of any sized DCT kernel for residues. Furthermore, we propose an HEVC-compliant LDDP-based PVC scheme where transform coefficients are sufficiently suppressed based on the LDDP model. The proposed PVC scheme is implemented in HEVC Test Model (HM 11.0) reference software to show the effectiveness of our LDDP-based PVC scheme. Objective and subjective tests for encoded test sequences are performed. The experimental results show that the proposed LDDP-based PVC scheme achieves a significant performance improvement of bitrate reduction at the similar visual quality levels compared to the original HM 11.0.