Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 129, No. 7, pp. 26–32
Abstract: As we envision a world of life-like TV, enhanced in all possible degrees of freedom, immersive UHD-2/8K high dynamic range (HDR) wide color gamut (WCG) high frame rate (HFR) are knocking at our doors. Although technology is improving at a constant pace, processing and transmitting such an amazing amount of information remains an incredible challenge. The British Broadcasting Corp. (BBC) transmitted an ultrahigh-definition (UHD) HDR live feed of the Fédération Internationale de Football Association (FIFA) 2018 World Cup at 36 Mb/s, however, the ATEME TITAN Live encoder does it already at 22 Mb/s and lower. Even though the future International Telecommunication Union – Telecommunication (ITU-T) International Organization for Standardization/International Electrotechnical Commission’s (ISO/IEC) versatile video coding (VVC) is promising a 50% coding efficiency gain compared to high-efficiency video coding (HEVC), compression will not be enough, thus leading to strategies like UHD forum Phase B guidelines recommending content-aware encoding. This paper shows how the future challenges of video compression can be met by leveraging both expertise in optimized compression and the latest advances in artificial intelligence, thus spending exactly the right amount of bits on each piece of video information. A practical implementation of content-aware encoding adapted to upcoming video formats is described, and results and analysis are provided.
Publication Date: 2020-08-01
DOI: 10.5594/JMI.2020.3001797
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2020.3001797
Author(s): Thomas Guionnet
bio
Thomas Guionnet received a PhD degree in computer science from the University of Rennes 1, Rennes, France, in 2003. He was with Envivio, France, for ten years, conducting research on realtime encoding, video preprocessing, and video quality assessment. He has also contributed to the International Organization for Standardization (ISO)/Motion Picture Experts Group (MPEG) – International Telecommunication Union – Telecommunication (ITU-T)/Video Coding Experts Group (VCEG) – highefficiency video coding (HEVC) standardization process. He joined ATEME, Rennes, in 2015. His research interests include encoders optimization, video quality assessment, statistical multiplexing, HDR video processing, content-aware video compression, and artificial intelligence.
Mickaél Raulet
bio
MickaéL Raulet received a PhD degree in 2006. He joined ATEME (http://ateme.com/), Rennes, Fra-nce, in 2015, where he is currently the vice president of innovation. He is leading the standardization effort at ATEME and is taking care of different activities for ATEME: Advanced Television Systems Committee (ATSC), Digital Video Broadcasting (DVB), Third Generation Partnership Project (3GPP), ISO/IEC, ITU, MPEG, Dynamic Adaptive Streaming over HTTP-Industry Forum (DASH-IF), and Ultra HD Forum (UHDForum). He is managing several of ATEME’s collaborative R&D projects.
Thomas Burnichon
bio
Thomas Burnichon is the director of technology at ATEME. He focuses on the video transcoding workflows for live, video on demand (VOD), and over-the-top (OTT) streaming applications. He is in close contact with content and service providers all over the world to identify best practices and help drive innovations such as HEVC/H.265, AOMedia Video Codec (AV1), versatile video coding (VVC), UHD-1/4K, UHD-2/8K, high dynamic range (HDR), and next generation audio (NGA).
Keyword(s): 8K, Artificial Intelligence, Content-Adaptive Encoding, HDR, HFR, OTT, HEVC, UHDTV, Versatile Video Coding, Video Compression, Video Quality, Wide Color Gamut
Copyright: © 2020 SMPTE

Bibliographic Reference(s)

“Cisco Visual Networking Index: Forecast and Trends, 2017– 2022,” 26 Nov. 2018. [Online]. Available: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html EXTERNAL
“VMAF: The Journey Continues,” Netflix Tech Blog, Oct. 25, 2018. [Online]. Available: https://medium.com/netflix-techblog/vmaf-the-journey-continues- 44b51ee9ed12 EXTERNAL
“Amaury Sport Organization, Cycling,” [Online]. Available: https://www.aso.fr/en/our-sports/cycling EXTERNAL
“LightFlow,” Epic Labs, 2018. [Online]. Available: https://lightflow.media/ EXTERNAL
“The Earth Inventory,” [Online]. Available: https://theexplor-ers.com/ EXTERNAL
C. Wang, L. Su, and W. Zhang, “COME for No-Reference Video Quality Assessment,” Proc. IEEE Conf. Multimedia Information Process. Retrieval (MIPR), pp. 232–237, Miami, FL, 2018. This paper first appeared in the Proceedings of the NAB 2019 Broadcast Engineering and Information Technology (BEIT) Conference, April 2019. Reprinted here with permission of the author(s) and the National Association of Broadcasters, Washington, DC. EXTERNAL
“Per-Title Encode Optimization,” Netflix tech blog, Dec. 14, 2015. [Online]. Available: https://medium.com/netflix-techblog/per-title-encode-optimization- 7e99442b62a2 EXTERNAL
R. M. Nasiri, J. Wang, A. Rehman, S. Wang, and Z. Wang, “Perceptual quality assessment of high frame rate video,” Proc. IEEE 17th Int. Workshop Multimedia Signal Process. (MMSP), pp. 1–6, Xiamen, China, 2015. EXTERNAL
“Ultra HD Forum Draft: Ultra HD Forum Phase B Guidelines,” Apr. 7, 2018. [Online]. Available: https://ultrahdfo-rum.org/resources/phaseb-guidelines-description/ EXTERNAL
Mario Vranješ, Snježana Rimac-Drlje, and Krešimir Grgić, “Review of Objective Video Quality Metrics and Performance Comparison Using Different Databases,” Signal Process. Image Commun. 28(1): 1–19, Jan. 2013. EXTERNAL
Yin Zhao, Lu Yu, Zhenzhong Chen, and Ce Zhu “Video Quality Assessment Based on Measuring Perceptual Noise From Spatial and Temporal Perspectives,” IEEE Trans. Circuits Syst. Video Technol., 21(12): 1890–1902, Dec. 2011. EXTERNAL
“HLS Authoring Specification for Apple Devices,” Nov. 9, 2018. [Online]. Available: https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices EXTERNAL
Shyamprasad Chikkerur, Vijay Sundaram, Martin Reisslein, and Lina J. Karam, “Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison” IEEE Trans. Broadcast., 57(2, part 1): 165–182, Jun. 2011. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2020.3001797.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Thomas Guionnet, Mickaél Raulet, and Thomas Burnichon; Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3001797

Snippet:

Thomas Guionnet, Mickaél Raulet, and Thomas Burnichon; Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3001797

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Thomas Guionnet, Mickaél Raulet, and Thomas Burnichon; <cite>Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/JMI.2020.3001797" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2020.3001797</a></span>

SMPTE's HTML Pub

Preview:

Thomas Guionnet, Mickaél Raulet, and Thomas Burnichon; Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020
doi: 10.5594/JMI.2020.3001797
url: https://doi.org/10.5594/JMI.2020.3001797

Snippet:

<li>
Thomas Guionnet, Mickaél Raulet, and Thomas Burnichon; <cite id="bib-10-5594-jmi-2020-3001797">Forward-looking content aware encoding for next generation UHD, HDR, WCG, and HFR</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020
<span class="doi">10.5594/JMI.2020.3001797</span>
</li>