Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 2023, No. 10, pp. 11–14
- Abstract
- Unprecedented growth in video consumption applications has been witnessed over the past decade, and new heights are now being reached with the emergence of the metaverse. As the metaverse expands, a substantial increase in the volume of digital data and the computational load on networks, data centers, and user devices is brought along. This continuous processing of information leads to significant energy consumption, resulting in a staggering amount of CO2 emissions annually. To address this challenge, the development of lightweight video compression algorithms that can effectively reduce file sizes and facilitate efficient transmission over the Internet needs to be prioritized. However, the desired level of efficiency cannot be achieved by current standards. In this study, a comprehensive analysis of the most resource-intensive task, Motion Estimation (ME), is conducted in two state-of-the-art compression algorithms used for metaverse videos: VP9 and HEVC. An implementation in Matlab that centers on the ME process of both algorithms has been developed for an exhaustive performance evaluation, allowing for an objective comparison. Furthermore, novel approaches were incorporated into the code to assess sustainability factors. The insights gained from this analysis shed light on key areas that require improvement in future video compression algorithms, paving the way for sustainable and optimized video storage and transmission in the metaverse.
- Publication Date
- 2023-10-16
- DOI
10.5594/M002002- ISBN
- Print:
978-1-61482-964-5 - Link
- https://doi.org/10.5594/M002002
- Author(s)
- Natalia Molinero MingorancePolytechnic School European University, Harmony Valley Project Madrid, Spain
- Keyword(s)
- HEVC, Metaverse, Compression, Sustainability, VP9
- Copyright
- © 2023 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- J. Hunt and A. Design, “VP9 Bitstream & Decoding Process Specification,” Mar. 2016. (accessed: Nov. 15, 2022). [Online]. Available: EXTERNAL
- G. S. Foundation, “Software Carbon Intensity Standard,” GitHub, Nov. 01, 2021. https://github.com/Green-Software-Foundation/software_carbon_intensity/blob/main/Software_Carbon_Intensity/Software_Carbon_Intensity_Specification.md (accessed Dec. 16, 2023). EXTERNAL
- Dan Grois, Detlev Marpe, Tung Nguyen, Ofer Hadar, "Comparative assessment of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders for low-delay video applications," Proc. SPIE 9217, Applications of Digital Image Processing XXXVII, 92170Q (23 September 2014); https://doi.org/10.1117/12.2073323 EXTERNAL
- Meta, "2021 Sustainability report". https://sustainability.fb.com/2021-sustainability-report/ (accessed Jan. 15, 2023). EXTERNAL
- Metaverse of Things, " Metaverse Users Worldwide – Metaverse Statistics to Prepare for the Future", April. 1, 2023. https://metaverseofthing.com/metaverse/metaverse-users-worldwide/ (accessed June 1, 2023). EXTERNAL
- A. M. Joshi, M. S. Ansari and C. Sahu, "VLSI Architecture of High Speed SAD for High Efficiency Video Coding (HEVC) Encoder," 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy, 2018, pp. 1-4, doi: 10.1109/ISCAS.2018.8351271. EXTERNAL
- U.S. Environmental Protection Agency (EPA), "Greenhouse Gas Equivalencies Calculator", www.epa.gov, Aug. 28, 2015. https://www.epa.gov/energy/greenhouse-gas-equivalencies-calculator#results(accessed July 1, 2023). EXTERNAL
- T. Laude, Y. G. Adhisantoso, J. Voges, M. Munderloh, and J. Ostermann, “A Comprehensive Video Codec Comparison,” APSIPA Transactions on Signal and Information Processing, vol. 8, 2019, doi: 10.1017/atsip.2019.23. EXTERNAL
- Mathworks, “Run code and measure execution time to improve performance - MATLAB -MathWorks España,” mathworks.com. https://mathworks.com/help/matlab/ref/profiler-app.html (accessed Jan. 05, 2023). EXTERNAL
- N. Molinero, “Harmony Valley.- research project resources”, https://linktr.ee/harmonyvalley EXTERNAL
- “Greenhouse gas emission intensity of electricity generation — European Environment Agency,” www.eea.europa.eu, (accessed Jan. 26, 2023). https://www.eea.europa.eu/data-and-maps/daviz/co2-emission-intensity-12#tab-googlechartid_chart_11 (accessed Dec. 20, 2022). EXTERNAL
- A. Katsenou, J. Mao, and I. Mavromatis, “Energy-Rate-Quality Tradeoffs of State-of-the-Art Video Codecs,” Electrical Engineering and Systems Science, Image and Video Processing, Oct. 2022. EXTERNAL
- R. Monnier, K. Jerbi, and M. Uitto, “Specification of power efficient encoder-transcoder,” Sep. 2017. https://convince.wp.imtbs-tsp.eu/files/2017/09/CONVINcE-D2.2.2-Updated-specification-of-power-efficient-encoder-V1.01.pdf (accessed Dec. 23, 2022). EXTERNAL
- J.-R. Ohm, G. J. Sullivan, H. Schwarz, T. K. Tan, and T. Wiegand, “Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC),” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1669–1684, Dec. 2012, doi: 10.1109/tcsvt.2012.2221192. EXTERNAL
- M. Uitto, "Energy consumption evaluation of H.264 and HEVC video encoders in highresolution live streaming," 2016 IEEE 12th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), New York, NY, USA, 2016, pp. 1-7, doi: 10.1109/WiMOB.2016.7763234. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M002002.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Natalia Molinero Mingorance; Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002002
Snippet:
Natalia Molinero Mingorance; Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002002
HTML (ISO 690 compliant)
Preview:
Natalia Molinero Mingorance; Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002002
Snippet:
<span class="citation">Natalia Molinero Mingorance; <cite>Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M002002" target="_blank" rel="noopener">https://doi.org/10.5594/M002002</a></span>
SMPTE's HTML Pub
Preview:
Natalia Molinero Mingorance; Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
doi: 10.5594/M002002
url: https://doi.org/10.5594/M002002
doi: 10.5594/M002002
url: https://doi.org/10.5594/M002002
Snippet:
<li> Natalia Molinero Mingorance; <cite id="bib-10-5594-m002002">Green Video Compression for Metaverse: Lessons Learned from VP9 and HEVC</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5 <span class="doi">10.5594/M002002</span> </li>