MPEG-5 Part 1: Essential Video Coding

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 129, No. 7, pp. 10–16
Abstract: The Motion Picture Experts Group (MPEG) standardization group has produced a large number of standards for video compression over the last three decades. Traditionally, the MPEG standards have either focused on highest available compression efficiency [e.g., MPEG-2, advanced video coding (AVC), and high-efficiency video coding (HEVC)] or a desire to produce a royalty-free standard [e.g., Internet video coding (IVC) and web video coding (WebVC)]. In January 2019, MPEG embarked on a new standardization project that can be seen as a hybrid of the two: MPEG-5 part 1 and essential video coding (EVC) [International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23094-1]. The EVC standard was developed with a royalty-free baseline profile at its base and a royalty bearing main profile that provides excellent compression performance. The main profile adds, on top of the baseline profile, 21 different coding tools that each can be individually turned off and, when necessary, replaced by a corresponding baseline profile tool. This structure makes it easy to fall back to a smaller set of tools in the future, if, for example, licensing complications occur around a specific tool, without breaking compatibility with already deployed decoders.
Publication Date: 2020-08-01
DOI: 10.5594/JMI.2020.3001795
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2020.3001795
Author(s): Jonatan Samuelsson
bio
Jonatan Samuelsson is the cofounder and CEO of Divideon, Stockholm, Sweden, a software development and technology licensing company that develops the open-source software-defined video codec xvc. Before starting up Divideon, he worked as a researcher and project manager at Ericsson, Stockholm, Sweden. He has an MSc degree from the Royal Institute of Technology (KTH), Stockholm, Sweden, and started working with video compression research and development in 2007. He was actively involved in the standardization of high-efficiency video coding (HEVC) and is currently contributing to the standardization of versatile video coding (VVC) and essential video coding (EVC), where he is one of the editors of the standard. He has also contributed to standardization work in DVB, ATSC, IETF, and 3GPP. He has been involved in setting up the Media Coding Industry Forum (MC-IF) and is serving as an MC-IF board director and the chief communications officer.
Kiho Choi
bio
Kiho Choi received a BS degree (summa cum laude) in information and communication engineering and MS and PhD degrees from the Department of Communication and Electronics and Computer Engineering, Hanyang University, Sageun-dong, Seoul Korea, in 2008, 2010, and 2012, respectively. He was a research associate and lecturer at Hanyang University in 2013, and joined Samsung Research, Seoul, Korea, in 2014. Since 2014, he has served as a technical leader with the Department of Video-Coding Standard, Samsung Research. Since 2009, he has been an active participant in the standardization for multimedia. He has chaired adhoc groups of International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) Motion Picture Experts Group (MPEG) and JVET committees. He has authored more than 100 MPEG contribution papers and more than 30 journal or conference papers. His current research interests include image and video coding, multimedia data compression, multimedia streaming, and AI-based multimedia technology. He is an editor of the MPEG-5 part1 EVC standard.
Jianle Chen
bio
Jianle Chen received BS and PhD degrees from Zhejiang University, Hangzhou, China, in 2001 and 2006, respectively. He was formerly with Samsung Electronics, Qualcomm, and Huawei focusing on the research of video technologies. Since 2006, he has been actively involved in the development of various video coding standards, including the HEVC standard, its scalable, format range and screen content coding extensions, and most recently, the VVC standard under development in the Joint Video Experts Team (JVET). He has also been a main developer of the recursive partitioning structure with large block size, which is one of the key features of HEVC standard and its potential successors. He is currently the Director of the Multimedia R&D Group, Qualcomm, Inc., San Diego, CA. His research interests include video coding and transmission, point cloud coding, augmented reality/virtual reality (AR/VR), and neural network compression. He was an Editor of the HEVC specification version 2 [the scalable HEVC (SHVC) text specification] and SHVC Test Model. For VVC, he has been the Lead Editor of the Joint Exploration Test Model (JEM) and VVC Test Model (VTM). He is an Editor of the VVC Text Specification. He is a Senior Member of the IEEE.
Dmytro Rusanovskyy
bio
Dmytro Rusanovskyy received BS and MS (Diploma of Engineering) degrees from the Kharkiv National University of Radio Electronics, Kharkiv, Ukraine, in 1999 and 2000, respectively, and a PhD degree in signal processing from the Tampere University of Technology, Tampere, Finland, in 2009. He is currently a principal engineer at Qualcomm Inc., San Diego, CA, where he works on algorithms design and standardization in the areas of video coding, streaming, and broadcast technologies. Since 2006, he participates in the work of various Standard Developing Organizations (SDOs) and industry forums, including VCEG, MPEG, ATSC, DVB, and others, and is actively involved in the development and deployment of HEVC, EVC, and VVC, as well as 3D video and high dynamic range (HDR) extensions.
Keyword(s): Essential Video Coding (EVC), MPEG, MPEG-5, Next-generation Video Codecs, Video Coding, Video Compression
Copyright: © 2020 SMPTE

Bibliographic Reference(s)

ISO.11172-2 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 11172-2, “Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to About 1.5 Mbit/s: Video,” 1993. EXTERNAL
ISO.23094-1 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23094-1, “Essential Video Coding,” 2020. EXTERNAL
Velos Media Q & A, “Why Pay Royalties on HEVC When Other Compression Technologies Like VP9 and AV1 Are Royalty-free?” [Online]. Available: http://velosmedia.com/technology/q-and-a/ EXTERNAL
International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) TR 23008-14:2018, “Information Technology—High Efficiency Coding and Media Delivery in Heterogeneous Environments—Part 14: Conversion and Coding Practices for HDR/WCG Y’CbCr 4:2:0 Video with PQ Transfer Characteristics,” 2018. EXTERNAL
“Velos Media,” [Online]. Available: http://velosmedia.com/ EXTERNAL
G. Agnihotri, “High Efficiency Video Coding: How the Video Ecosystem is Evolving,” [Online]. Available: https://www.ipwatchdog.com /2018/07/11/ high-eff iciency-video-codingvideo-ecosystem-evolving/id=99094/ EXTERNAL
“Common Test Conditions for Essential Video Coding,” MPEG output document N19003, Brussels, Belgium, Jan. 2020. EXTERNAL
“HEVC Advance,” [Online]. Available: https://www.hevcad-vance.com/ EXTERNAL
“AV1 by Alliance for Open Media,” [Online]. Available: https://aomedia.org/ EXTERNAL
“The xvc Video Codec by Divideon,” [Online]. Available: https://xvc.io/ EXTERNAL
L. Chiariglione, “A Crisis, The Causes and a Solution,” [Online]. Available: http://blog.chiariglione.org/a-crisis-the-causes-and-a-solution/ EXTERNAL
“Sisvel Video Coding Licensing Platform,” [Online]. Available: http://www.sisvel.com/licensing-programs/audio-and-video-coding-decoding/video-coding-platform/introduction EXTERNAL
Encoding.com, “Global Media Formats Report,” [Online]. Available: https://1yy04i3k9fyt3vqjsf2mv610yvm-wpengine.netdna-ssl.com/files/2019-Global-Media-Formats-Report.pdf EXTERNAL
“RealMedia HD by RealNetworks,” [Online]. Available: https://www.realnetworks.com/realmediaHDan indication of how much the bitrate can be reduced while keeping the same objective visual quality. The EncT and DecT columns represent relative encoding time and decoding time, respectively. As seen from Tables 1 and 2, the EVC main profile outperforms the HEVC anchor by around 26% in bitrate reduction, whereas the EVC baseline profile shows around 31% bitrate reduction versus AVC. For the complexity estimates, EVC test model in the main profile shows around 5× and 1.75× run time relative to the HEVC anchor for encoder and decoder, respectively. The EVC baseline profile shows 60% encoding time reduction with approximately the same decoding time as the AVC anchor. It should be noted, however, that the EVC test model software is currently under development and that further improvements in encoding speed and decoding speed are expected. Performance of the EVC main profile for HDR/WCG content versus the HEVC anchor is shown in Table 3 in terms of BD-rate in the HDR metrics (PSNRL100, PSNRDE, and wPSNR). This test was conducted according to the EVC CTC,20 with HEVC anchor being HM16.16 configured for HDR/WCG as specified in Ref. 21. The test set comprised sequences at HD (1080p) resolution in BT.2100/PQ 10 bit representation. As seen from Table 3, for HDR/WCG content in HD (1080p) resolution, EVC main profile outperforms the HEVC anchor by around 23% in bitrate reduction. Conclusion This paper has presented EVC, the new video-coding standard from MPEG, which was developed using a novel standard design principle that has been designed to provide increased insight into the ownership of the technology included in the standard and provide a better foundation for licensing of the codec. The draft standard is built on technology submitted by Samsung, Huawei, Qualcomm, and Divideon, and includes a baseline profile only consisting of technology available under royalty-free terms. All the technology components included in the main profile can be turned off individually, thereby providing users the codec with the ability to avoid using technology that they EXTERNAL
“MPEG LA HEVC,” [Online]. Available: https://www.mpegla.com/programs/hevc/ EXTERNAL
International Telecommunications Union – Telecommunications (ITU-T) H.263, “Video Coding for Low Bit Rate Communication,” Annex J, 1996. EXTERNAL
“Requirements for a New Video Coding Standard,” [Online]. Available: https://mpeg.chiariglione.org/standards/exploration/future-video-coding/requirements-a-new-video-coding-standard EXTERNAL
T-REC-H.262 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 13818-2/ITU-T H.262, “Generic Coding of Moving Pictures and Associated Audio Information: Video,” 1996. EXTERNAL
ITU-T REC H.264 [Active]
ITU-T REC H.265 [Active]
T-REC-T.81 — ITU-T T.81 (1992), Information Technology — Digital Compression and Coding of Continuous-Tone Still Images: Requirements and Guidelines (JPEG) EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2020.3001795.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Jonatan Samuelsson, Kiho Choi, Jianle Chen, and Dmytro Rusanovskyy; MPEG-5 Part 1: Essential Video Coding, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3001795

Snippet:

Jonatan Samuelsson, Kiho Choi, Jianle Chen, and Dmytro Rusanovskyy; MPEG-5 Part 1: Essential Video Coding, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3001795

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Jonatan Samuelsson, Kiho Choi, Jianle Chen, and Dmytro Rusanovskyy; <cite>MPEG-5 Part 1: Essential Video Coding</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/JMI.2020.3001795" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2020.3001795</a></span>

SMPTE's HTML Pub

Preview:

Jonatan Samuelsson, Kiho Choi, Jianle Chen, and Dmytro Rusanovskyy; MPEG-5 Part 1: Essential Video Coding, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020
doi: 10.5594/JMI.2020.3001795
url: https://doi.org/10.5594/JMI.2020.3001795

Snippet:

<li>
Jonatan Samuelsson, Kiho Choi, Jianle Chen, and Dmytro Rusanovskyy; <cite id="bib-10-5594-jmi-2020-3001795">MPEG-5 Part 1: Essential Video Coding</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 7, August 2020); SMPTE, 2020
<span class="doi">10.5594/JMI.2020.3001795</span>
</li>