Proposed Extensions to the Third Edition of JPEG XS (ISO/IEC 21122) Standard

Bibliographic Reference(s)

• D. LeGall and A. Tabatabai, “Subband Coding of Digital Images Using Symmetric Short Kernel Filters and Arithmetic Coding Techniques,” Int. Conf. on Acoustic, Speech, and Signal Process., New York, NY, pp. 761–765, 1988. EXTERNAL
• A. T. Naman and D. Taubman, “JPEG2000-Based Scalable Interactive Video (JSIV),” IEEE Trans. Image Process., 20(5):1435– 1449, May 2011. EXTERNAL
• G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Trans. Circuits Syst. Video Technol., 22(12):1649– 1668, Dec. 2012. EXTERNAL
• T. Richter and T. Bruylands, “Information Technology— JPEG XS Low-Latency Lightweight Image Coding System, Part 1: Core Coding System,” published as International Organization for Standardization/International Electrotechnical Commission EXTERNAL
• A. Descampe et al., “JPEG XS—A New Standard for Visually Lossless Low-Latency Lightweight Image Coding,” Proc. of the IEEE, vol. 109, no. 9, pp. 1559–1577, Sep. 2021. EXTERNAL
• B. Bross et al., “Overview of the Versatile Video Coding (VVC) Standard and Its Applications,” IEEE Trans. Circuits Syst. Video Technol., 31(10):3736–3764, Oct. 2021. EXTERNAL
• T. Bruylants and T. Richter, “Information Technology— JPEG XS Low-Latency Lightweight Image Coding System, Part 2: Profiles and Buffer Models,” published as International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 21122-2, 2019. optimal as intracoefficients require more rate than intercoefficients, yet form the basis of future interprediction and should thus be quantized to a finer level than smaller intercoefficients. In Fig. 5, the quantization level of intracoded coefficients is shifted by multiple bitplanes compared to that of intercoefficients. Otherwise, inter/intraband switch is selected, and unlike in Fig. 1, a per-band refresh mechanism is enabled that is rotated through all bands over the image, that is, the “band-switch bandrefresh” mechanism is here deployed. The “default” graph shows again the performance of an “all-intra” configuration. In the “inter=intra” configuration, the quantizer configuration for inter- and intracoded coefficients is identical. In all remaining configurations, it is offset in the positive or negative direction by one or multiple bitplanes. The “intra Q reduced by 1” indicates a configuration where intracoded coefficients are quantized by one additional bitplane relative to intercoded coefficients, that is, intra is quantized coarser. As seen in the plots, this leads to consistently worse performance regardless of the nature of the image, though it impacts mostly the low-PSNR end for natural images and the high-PSNR end for screen content. Small PSNR gains can be reached if the quantization of intra-coefficients is finer than that of interpredicted coefficients, with the peak performance at a relative quantization shift of 2 bitplanes. The overall PSNR gains remain, however, relatively moderate, approximately 0.2 dB for the above test images. Conclusion According to the experiments, including a frame buffer can result in performance improvements of more than 10 dB relative to the first edition of JPEG XS on-screen content; the gains are lower on natural images, but can reach 5 dB if only moderate motion is present. Various signaling mechanisms for inter/intracoding are currently under discussion in WG1. In our experiments, switching only per band performs better on natural content as the coding overhead for signaling the decision EXTERNAL
• T-REC-T.800.2000 — M. Boliek, Ed. Information Technology—JPEG 2000 Image Coding System: Part 1: Core Coding System, published as International Telecommunication Union-Telecommunications (ITU-T) Recommendation T.800 | International Organization for Standardization/International Electrotechnical Commission EXTERNAL
• T-REC-T.808.2000 — R. Prandolini et al., Eds. Information Technology—JPEG 2000 Image Coding System: Interactivity Tools, APIs and Protocols, published as International Telecommunication Union-Telecommunications (ITU-T) Recommendation T.808 | International Organization for Standardization/International Electrotechnical Commission EXTERNAL