Making Film Grain Great Again: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 13–15
Abstract: Recently, film grain applications started to gain a lot of popularity due to an increasing demand for natural visual appearance, in the light of a dramatically increasing amount of artificially generated content. Film grain is spatially random in nature, similarly to noise, while its physical size can vary as well. In addition, film grain is independent in a temporal domain, thereby making it inherently difficult to compress for conventional video encoders. — Therefore, in order to improve a video coding gain it is desirable to remove the film grain prior to encoding, and then to add it back after decoding and prior to display as a post-processing step, thereby leading to significant bitrate savings. This approach was successfully incorporated by Alliance for Open Media (AOM) within its proprietary AV1 coding scheme as a normative process, starting from its 1st version (AV1 v1.0) in 2018. — In this work, the AV1-compatible film grain modeling for the H.265/MPEG-HEVC based video codecs has been carried out to efficiently utilize the existing AV1 film grain post-processing support. This is done by providing the estimated film grain parameters within the ITU-T Recommendation T.35 (ITU-T T.35) Supplemental Enhancement Information (SEI) message. According to the extensive experimental results conducted on popular cinematic content, very significant bitrate savings are achieved for substantially the same subjective video presentation quality.
Publication Date: 2023-10-16
DOI: 10.5594/M002021
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M002021
Author(s): Dan GroisSMPTE Member, Comcast, Philadelphia PA, USA
Alex GiladiSMPTE Member, Comcast, Philadelphia PA, USA
Thomas GuionnetAteme, Rennes, France
Thomas BurnichonAteme, Rennes, France
Nikolay TverdokhlebAteme, Rennes, France
Mickael RauletAteme, Rennes, France
Keyword(s): Film Grain, Video Compression, Coding Efficiency, Video Coding Gain, HEVC, AOM, AV1, H.265, Visual Quality, Subjective Quality Assessment
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Performance Comparison of Emerging EVC and VVC Video Coding Standards with HEVC and AV1 [Active]
D. Grois, and A. Giladi, “Perceptual quantization matrices for high dynamic range H.265/MPEG-HEVC video coding”, Proc. SPIE 11137, Applications of Digital Image Processing XLII, 111370O, 2020. EXTERNAL
D. Grois, B. Bross, D. Marpe, and K. Sühring, “HEVC/H.265 Video Coding Standard: Part 2”, Online: https://www.youtube.com/watch?v=V6a1AW5xyAw&t=5s EXTERNAL
Alliance for Open Media, Press Release Online: http://aomedia.org EXTERNAL
Y. Chen et al. (2020), “An Overview of Coding Tools in AV1: The First Video Codec from the Alliance for Open Media”, APSIPA Transactions on Signal and Information Processing, 9, E6. EXTERNAL
D. Grois, B. Bross, D. Marpe, and K. Sühring, “HEVC/H.265 Video Cding Standard: Part 1”, Online: https://www.youtube.com/watch?v=TLNkK5C1KN8&t=764s EXTERNAL
M. Řeřábek, and T. Ebrahimi, “Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments”, Proc. SPIE 9217, Applications of Digital Image Processing XXXVII, 92170U, 2014. EXTERNAL
J. Ohm, G.J. Sullivan, H. Schwarz, T.K. Tan, and T. Wiegand, "Comparison of the coding efficiency of video coding standards—including High Efficiency Video Coding (HEVC)," IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no.12, pp.1669-1684, Dec. 2012. EXTERNAL
D.E. Hilt and D.W. Seegrist, “Ridge, a computer program for calculating ridge regression estimates”, 1977. EXTERNAL
Git repositories on aomedia, Online: https://aomedia.googlesource.com/aom EXTERNAL
AOMedia film grain synthesis specification 1 (AFGS1), Online: https://github.com/AOMediaCodec/afgs1-spec EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, "Performance comparison of AV1, JEM, VP9, and HEVC encoders," Proc. SPIE 10396, Applications of Digital Image Processing XL, 103960L, 2018. EXTERNAL
G. Bjøntegaard, “Calculation of average PSNR differences between RD-curves”, ITU-T Q.6/SG16 VCEG 13th Meeting, Document VCEG-M33, Austin, USA, Apr. 2001. EXTERNAL
A. Norkin and N. Birkbeck, "Film Grain Synthesis for AV1 Video Codec," 2018 Data Compression Conference, Snowbird, UT, USA, 2018, pp. 3-12. EXTERNAL
J. Bankoski, P. Wilkins, and X. Yaowu, "Technical overview of VP8, an open source video codec for the web," Multimedia and Expo (ICME), 2011 IEEE International Conference on, pp.1,6, 11-15 Jul. 2011. EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, "Coding Efficiency Comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC Encoders," Picture Coding Symposium (PCS), pp. 1-5, Dec. 2016. EXTERNAL
D. Grois, D. Marpe, T. Nguyen, and O. Hadar, “Comparative Assessment of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC Encoders for Low-Delay Video Applications”, Proc. SPIE Vol. 9217, Sept. 2014. EXTERNAL
Ateme Titan encoder, Online: https://www.ateme.com/product-titan-software/ EXTERNAL
D. Grois, D. Marpe, A. Mulayoff, B. Itzhaky, and O. Hadar, "Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders," Picture Coding Symposium (PCS), 2013, pp.394-397, 8-11 Dec. 2013. EXTERNAL
Chromium® open-source browser project, VP9 source code, Online: http://git.chromium.org/gitweb/?p=webm/libvpx.git;a=tree;f=vp9;hb=aaf61dfbcab414bfacc3171501be17d191ff8506 EXTERNAL
D. Grois, T. Nguyen, and D. Marpe, "Coding Efficiency Comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC Encoders," Picture Coding Symposium (PCS), 2016, 4-7 Dec. 2016. EXTERNAL
S.P. Lloyd, "Least squares quantization in PCM", IEEE Transactions on Information Theory, 28 (2): 129–137, 1982. EXTERNAL
R-REC-BT.500-14 — International Telecommunication Union – Radiocommunication (ITU-R), Recommendation BT.500-14, “Methodologies for the Subjective Assessment of the Quality of Television Images,” Oct. 2019. EXTERNAL
ITU-T REC H.265 [Active]
T-REC-T.35 — ITU-T Rec. T.35, Procedure for the Allocation of ITU-T Defined Codes for Non-Standard Facilities EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M002021.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; Making Film Grain Great Again: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002021

Snippet:

Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; Making Film Grain Great Again: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002021

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; <cite>Making Film Grain Great Again: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M002021" target="_blank" rel="noopener">https://doi.org/10.5594/M002021</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Dan Grois, Alex Giladi, Thomas Guionnet, Thomas Burnichon, Nikolay Tverdokhleb, and Mickael Raulet; <cite id="bib-10-5594-m002021">Making Film Grain Great Again: Introducing AV1-Compatible Film Grain Modeling for Existing HEVC-Based Video Codecs</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M002021</span>
</li>