Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 133, No. 1, pp. 40–50
Abstract: Film grain is spatially random in nature, while its physical size can also vary. In addition, film grain is independent in a temporal domain, thereby making it inherently difficult to compress. Therefore, to improve a video coding gain, the film grain is removed prior to encoding, and then added back after decoding at the post-processing stage, as is currently implemented in the Alliance for Open Media (AOM) AV1 coding scheme. In this work, the AV1-compatible film grain modeling for the High-Efficiency Video Coding (HEVC)-based video codecs has been carried out to utilize the existing AV1 film grain post-processing support efficiently. This is done by providing estimated film grain parameters within the International Telecommunication Union-Telecommunication (ITU-T) Recommendation T.35 (ITU-T T.35) Supplemental Enhancement Information (SEI) message. According to extensive experimental results conducted on popular cinematic content, significant bitrate savings are achieved.
Publication Date: 2024-01-01
DOI: 10.5594/JMI.2024/JUNZ2729
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2024/JUNZ2729
Author(s): Dan Grois
Alex Giladi
Thomas Guionnet
Thomas Burnichon
Nikolay Tverdokhleb
Mickael Raulet
Keyword(s): Film Grain, Video Compression, Coding Efficiency, HEVC, AOM, AV1, H.265
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

Performance Comparison of Emerging EVC and VVC Video Coding Standards with HEVC and AV1 [Active]
D. Grois, and A. Giladi, “Perceptual quantization matrices for high dynamic range H.265/MPEG-HEVC video coding”, Proc. SPIE 11137. Applications of Digital Image Processing XLII, 1113700, 2020. EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, “Coding Efficiency Comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC Encoders,” Picture Coding Symposium (PCS), Nuremberg, Germany, Dec. 2016. EXTERNAL
D. Grois, B. Bross, D. Marpe, and K. Sührinq, “HEVC/H.265 Video Cding Standard: Part 1.” [Online]. Available: https://www.youtube.com/watch?v=TLNkK-5C1KN8&t=764s. EXTERNAL
D. Grois, B. Bross, D. Marpe, and K. Sühring, “HEVC/H.265 Video Coding Standard: Part 2.” [Online]. Available: https://www.youtube.com/watch?v=V6a1AW5xyAw&t=5s. EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, “Performance comparison of AV1, JEM, VP9, and HEVC encoders,” Proc. SPIE 10396, Applications of Digital Image Processing XL, 103960L, 2018. EXTERNAL
D. Grois, D. Marpe, A. Mulayoff, B. Itzhaky, and O. Hadar, “Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders,” Proc Picture Coding Symposium (PCS), 2013, pp.394–397, 8-11 Dec. 2013. EXTERNAL
D. Grois, D. Marpe, T. Nguyen, and O. Hadar, “Comparative Assessment of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC Encoders for Low-Delay Video Applications”, Proc. SPIE Vol. 9277, Sept. 2014. EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, “Coding Efficiency Comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC Encoders,” Proc. Picture Coding Symposium (PCS), pp. 1–5, Dec. 2016. EXTERNAL
J. Bankoski, P. Wilkins, and X. Yaowu, “Technical overview of VP8, an open source video codec for the web,” Multimedia and Expo (ICME), 2011 IEEE International Conference on, pp. 16, 11-15 Jul. 2011. EXTERNAL
Chromium open-source browser project, VP9 source code. [Online]. Available: http://git.chromium.org/gitweb/?p=webm/libvpx.git;a=tree;f=vp9;h-b=aaf61dfbcab414bfacc3171501be17d191ff8506. EXTERNAL
Y. Chen “An Overview of Coding Tools in AV1: The First Video Codec from the Alliance for Open Media,” APSIPA Trans. on Sig. and Inform. Process., Cambridge University Press, Feb. 2020. EXTERNAL
M. Řeřábek, and T. Ebrahimi, “Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments,” Proc. SPIE 9217. Applications of Dig. Image Process. XXXVII, 92170U, 2014. EXTERNAL
Alliance for Open Media, Press Release. [Online]. Available: http://aomedia.org. EXTERNAL
Git repositories on aomedia [Online]. Available: https://aomedia.google-source.com/aom. EXTERNAL
AOMedia film grain synthesis specification 1 (AFGS1). [Online]. Available: https://github.com/AOMediaCodec/afgs1-spec. EXTERNAL
Ateme Titan encoder. [Online]. Available: https://www.ateme.com/product-ti-tan-software/. EXTERNAL
G. Bjontegaard, “Calculation of Average PSNR Differences Between RD-Curves,” ITU-T Q.6/SG16 VCEG 13th Meeting, Document VCEG-M33, Austin, TX, Apr. 2001. EXTERNAL
J. Ohm, G.J. Sullivan, H. Schwarz, T.K. Tan, and T. Wiegand, “Comparison of the coding efficiency of video coding standards-including High Efficiency Video Coding (HEVC),” IEEE Transactions on Circuits and Systems for Video Technology, 22 (12): 1669–1684, Dec. 2012. EXTERNAL
S.P. Lloyd, “Least squares quantization in PCM”, IEEE Trans. on Information Theory, 28 (2): 129–137, 1982. EXTERNAL
A. Norkin and N. Birkbeck, “Film Grain Synthesis for AV1 Video Codec,” 2078 Data Compression Conference, pp. 3–12, Snowbird, UT, 2018. EXTERNAL
D.E. Hilt and D.W. Seegrist, “Ridge, a computer program for calculating ridge regression estimates,” 1977. EXTERNAL
R-REC-BT.500-14 — International Telecommunication Union – Radiocommunication (ITU-R), Recommendation BT.500-14, “Methodologies for the Subjective Assessment of the Quality of Television Images,” Oct. 2019. EXTERNAL
ITU-T REC H.265 [Active]
T-REC-T.35 — ITU-T Rec. T.35, Procedure for the Allocation of ITU-T Defined Codes for Non-Standard Facilities EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-JUNZ2729.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs, MIJ 2024, Volume 133, Number 1 (pp. 40 to 50); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/JUNZ2729

Snippet:

Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs, MIJ 2024, Volume 133, Number 1 (pp. 40 to 50); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/JUNZ2729

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; <cite>Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs</cite>, MIJ 2024, Volume 133, Number 1 (pp. 40 to 50); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/JUNZ2729" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/JUNZ2729</a></span>

SMPTE's HTML Pub

Preview:

Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs, MIJ 2024, Volume 133, Number 1 (pp. 40 to 50); SMPTE, 2024
doi: 10.5594/JMI.2024/JUNZ2729
url: https://doi.org/10.5594/JMI.2024/JUNZ2729

Snippet:

<li>
Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; <cite id="bib-10-5594-jmi-2024-junz2729">Returning Greatness to Film Grain: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs</cite>, MIJ 2024, Volume 133, Number 1 (pp. 40 to 50); SMPTE, 2024
<span class="doi">10.5594/JMI.2024/JUNZ2729</span>
</li>