V-PCC Performance Evaluation of the First MPEG Point Codec
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 130, No. 4, pp. 36–52
- Abstract
- Representation of 3D scenes has become increasingly important in several industries using virtual and augmented reality technologies. The point cloud format is well suited for such representations. Indeed, point clouds can be created with a simple capture process and modest processing, enabling a realtime, end-to-end point cloud distribution chain. However, point cloud compression is required to obtain data rates and file sizes that could be economically viable for the industry. Standardization is required to ensure interoperability. In 2021, the International Organization for Standardization (ISO) Moving Picture Experts Group (MPEG) plans to publish a standard for its first point cloud codec, MPEG-I Part 5: Visual Volumetric Video-based Coding (V3C) and Video-based Point Cloud Compression (V-PCC). This standard enables a world of new services and applications, including cultural heritage, telepresence, and new forms of entertainment. In this paper, we review the principal use cases targeted by the V-PCC standard. We present the architecture of the V-PCC codec and describe its main tools, by giving insights into complexity at the encoder and decoder levels and explaining profiles and conformance points in V-PCC. We then present the methodology established, as a collaboration between industry and academics, for the evaluation of the V-PCC codec performance and the methodology’s origins. This methodology was applied to the MPEG point cloud compression test model software (named TMC2) to consistently evaluate technologies proposed during the standardization process. Finally, we compare the performance of the main V-PCC tools available for lossy and lossless compression. Finally, the conclusion provides elements in favor of a near-term deployment of V-PCC in the media industry.
- Publication Date
- 2021-05-01
- DOI
10.5594/JMI.2021.3067962- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2021.3067962
- Author(s)
- Céline Guede
bio
Céline Guede received an engineering degree from the Polytech Orleans School, Orleans, France, in 1998, and immediately joined Technicolor as an R&D engineer. After gaining specialization in software development, she joined the Advanced Television Systems Committee (ATSC) 3.0 standardization group on next-generation broadcast in 2013, where she contributed to the evaluation and selection of scalable high efficiency video coding (SHVC)/HEVC video encoding and Moving Picture Experts Group (MPEG) MMT transport technologies. She shifted her focus to point cloud compression at the end of 2016, actively contributing several technology proposals to the emerging MPEG Point Cloud Compression standard [Video-based Point Cloud Compression (V-PCC), known as MPEG-I Part 5]. Since 2019, she has been an architect at InterDigital where she continues to actively contribute on the V-PCC standard evolution. She is currently working on the dissemination of the V-PCC technology through realtime codec demonstrations and the adoption in future TV broadcast standards such as Sistema Brasileiro de Televisão Digital (SBTVD).Pierre Andrivonbio
Pierre Andrivon received an advanced master’s degree in signal and image processing from Télécom Paris, Paris, France, in 2006. As a research engineer at Vitec, Paris, France, he developed H.264/AVC encoders and contributed to collaborative projects on realtime video processing. In 2011, he joined Technicolor, where he successively participated in the standardization of H.265/HEVC and SHVC video codecs, and the single layer high dynamic range (SL-HDR) technology jointly developed with Philips. He was a co-editor of the European Telecommunications Standards Institute Technical Specification (ETSI TS) 103 433 multipart standard. Since 2019, as a principal scientist for InterDigital, he leads the effort on point cloud and mesh compression. He contributed to the standardization of the MPEG V-PCC standard as a co-editor of the specification. He has been involved in several video standardization committees: MPEG, digital video broadcasting (DVB), ETSI, Blu-ray Disc Association (BDA), SMPTE, high definition multimedia interface (HDMI), and Consumer Technology Association (CTA). He filed more than 100 patent applications and holds +20 issued patents, mainly on video processing, video coding, and color management.Jean-Eudes Marviebio
Jean-Eudes Marvie is a principal scientist at InterDigital. He received a PhD degree from the University of Rennes, Rennes, France, in 2004. His research interests are realtime rendering, large model’s visualization and generation, procedural modeling and rendering, and mixed reality. He previously applied these techniques to the field of live broadcast, interactive previsualization for cinema production, and immersive experiences in home ecosystems such as telepresence.Julien Ricardbio
Julien Ricard is an architect on the point cloud compression team at InterDigital, Rennes, France. He participated in the development of the response to the MPEG call for proposals on the compression of point clouds and his response took second place on nine answers. Since then, he has co-authored several important proposals accepted in the MPEG V-PCC standard. For the past three years, he has been the MPEG-3 DG-PCC software coordinator for the candidate video point cloud compression test model and the official MPEG-3 DG point cloud rendering engine. In this position, he coordinates the integration of new proposals from MPEG promoters into the test model and guarantees the conformity and the quality of the source codes. To promote and evangelize around the point cloud format and the compression of this data, he participated in the creation of several demonstrations on mobile devices to show the ability to render, decode, and stream this type of data in realtime. He holds a doctorate in computer science and a master’s degree in computer engineering from the University of Lyon, Lyon, France.Bill Redmannbio
Bill Redmann’s career has always mixed technology and entertainment. While earning his master’s degree in engineering from the University of California, Los Angeles (UCLA), he built practical props for Battlestar Galactica and Buck Rogers at Universal Studios, Los Angeles. As the director of technology for Disney Imagineering and Virtual World Entertainment, he researched, developed, and fielded simulator ride systems and virtual reality attractions. At Technicolor, Rennes, France, an interest in standards in the context of digital cinema led him to join SMPTE, where he eventually became a SMPTE Fellow. Now as an InterDigital’s Director of Standards for Immersive Media Technologies, he contributes to next-generation television systems. He holds 71 issued U.S. patents relating to digital cinema, virtual and augmented reality, media production, distributed network streaming, interactive systems, displays, online communities, mobile content distribution, exercise tracking, travel planning, and electric vehicle infrastructure. His two favorites—a roller coaster you design then ride, and a keyboard for dolphins to communicate with people—both really worked.Jean-Claude Chevetbio
Jean-Claude Chevet joined Thomson, Rennes, France, in 1983 as an electronic technician at the TV R&D plant, after graduating from the Institut Universitaire de Technologie of Angers, France, in electrical engineering domain. He worked on micro-controller programming for advanced devices development in consumer electronic domain. In 1987, he worked on home automation systems, then on video processing for the HD TV and plasma TVs. In 1997, he received an engineer diploma from Institut des Techniques d’Ingénieur de l’Industrie, Auxerre, France, after three years of education at Ecole Nationale Supérieure de Physique de Strasbourg (ENSPS). He then worked as a research engineer in the video compression lab, at an MPEG-4 player development company in Rennes, France, and then in the network area (5 GHz, 802.11a). Chevet also worked on embedded systems for an H264 professional encoding equipment for the Grass-Valley company (formerly Harmonics), Rennes, France. He also worked in the human perception area (visual attention model and reframing) to develop demonstrators based on this technology and then joined the image editing and enhancement area (image processing). In 2015, he joined the ATSC 3.0 project at Technicolor as a developer of technical demonstrators integrating SHVC/HEVC video encoding. Since 2017, he has worked in the field of compression of volumetric video, notably he participated in several contributions for the new MPEG standard, in particular, for the 3DG Ad hoc Group on V-PCC. - Keyword(s)
- Immersive Video Coding, Performance Evaluation, Point Cloud Compression
- Copyright
- © 2021 SMPTE
Bibliographic Reference(s)
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “[VPCC-TM] New Contribution on Duplicate Point Avoidance in TMC2,” Macao, China, m44784, Oct. 2018. EXTERNAL
- K. Cao, Y. Xu, Y. Lu, and Z. Wen, “Owlii Dynamic Human Mesh Sequence Dataset,” ISO/IEC JTC1/SC29/WG11 m42816, 122th MPEG Meeting, San Diego, CA, USA, Apr. 2018. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “[V-PCC] On Attribute Smoothing,” Geneva, Switzerland, m51003, 2019, Oct. 2019. EXTERNAL
- D. Tian, H. Ochimizu, C. Feng, R. Cohen, and A. Vetro, “Geometric Distortion Metrics for Point Cloud Compression,” Proc. IEEE Int. Conf. Image Process. (ICIP), Beijing, China, pp. 3460–3464, 2017, doi: 10.1109/ICIP.2017.8296925. EXTERNAL
- Git Reference for Test Model v10. Jun. 3, 2020. [Online]. Available: http://mpeg x.int- ev r y.f r/sof t ware/M PEG/ PCC/ TM /mpegpcc-tmc2/commit/1018e5467ea0d18b879272bcba8c060e1cfd97a9 EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “PCC TMC2 Geometry Coding Improvements,” Gwangju, South Korea, m42111, Jan. 2018. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “[V-PCC] Report on Core Experiment CE 2.18 on Lossy Additional Points Patch for Improved Visual Quality,” Marrakech, Morocco, m45946, Jan. 2017. EXTERNAL
- E. d’Eon, B. Harrison, T. Myers, and P. A. Chou, “8i Voxelized Full Bodies, Version 2—A Voxelized Point Cloud Dataset,” ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/ JPEG) Input Document m40059/M74006, Geneva, Switzerland, Jan. 2017. EXTERNAL
- S. Schwarz, M. Pesonen, and IBC 2019, “Real-Time Decoding and AR Playback of the Emerging MPEG Video-Based Point Cloud Compression Standard,” Sep. 2019. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “PCC Requirements,” Gwangju, South Korea, w17353, Jan. 2018. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “PCC TMC2 With Additional Projection Plane,” Ljubljana, Slovenia, m43494, Jul. 2018. EXTERNAL
- C. Guede, R. Schaefer, and IBC 2019, Sep. 2019. [Online]. Available: https://www.interdigital.com/videos/v--pcc-the-first-mpeg-codec-for-point-cloud-compression EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “Container for V-PCC Editing,” Alpbach, Austria, m53943, Apr. 2020. [Online]. Available: http://wg11.sc29.org/doc_end_user/documents/130_ Alpbach/comments/comment-566 -V-PCC _ DIS_d90.zip EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “[V-PCC][New Proposal] Generalized Enhanced Occupancy Map for Depth,” Geneva, Switzerland, m47895, Oct. 2019. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “[PCC] TMC2 Pixel Interleaving in Geometry and Texture Layers,” Ljubljana, Slovenia, m43723, Jul. 2018. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “V-PCC Test Model v10,” Alpbach, Austria, w19325, Apr. 2020. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “[VPCC][software] mpeg-pcc-renderer Software v5.0,” Alpbach, Austria, m53592, Apr. 2020. EXTERNAL
- High Efficiency Video Coding, Feb. 1, 2018. [Online]. Available: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/ EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “Common Test Conditions for PCC,” Alpbach, Austria, w19324, Apr. 2020. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “[V-PCC][specification] Patch Border Filtering Specification,” Geneva, Switzerland, m51501, Oct. 2019. EXTERNAL
- R. Mekuria, S. Laserre, and C. Tulvan, “Performance Assessment of Point Cloud Compression,” IEEE Visual Comm. Image Process. (VCIP), St. Petersburg, FL, pp. 1–4, 2017, doi: 10.1109/VCIP.2017.8305132. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “V-PCC Codec Description,” Alpbach, Austria, w19332, Apr. 2020. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “V-PCC Performance Evaluation and Anchor Results,” Alpbach, Austria, w19327, Apr. 2020. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “Use Cases for Point Cloud Compression,” Genova, Switzerland, w16331, Jun. 2016. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “OpenV3C—Multiplatform Open Source Implementation of V-PCC,” Alpbach, Austria, w19375, Apr. 2020. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29/WG11, “PCC TMC2 Low Complexity Geometry Smoothing,” Ljubljana, Slovenia, m43501, Jul. 2018. EXTERNAL
- International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) JTC1/SC29 WG11, “PCC Requirements Status Update,” Alpbach, Austria, m53595, Apr. 2020. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2021.3067962.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; V-PCC Performance Evaluation of the First MPEG Point Codec, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3067962
Snippet:
Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; V-PCC Performance Evaluation of the First MPEG Point Codec, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3067962
HTML (ISO 690 compliant)
Preview:
Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; V-PCC Performance Evaluation of the First MPEG Point Codec, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3067962
Snippet:
<span class="citation">Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; <cite>V-PCC Performance Evaluation of the First MPEG Point Codec</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/JMI.2021.3067962" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2021.3067962</a></span>
SMPTE's HTML Pub
Preview:
Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; V-PCC Performance Evaluation of the First MPEG Point Codec, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021
doi: 10.5594/JMI.2021.3067962
url: https://doi.org/10.5594/JMI.2021.3067962
doi: 10.5594/JMI.2021.3067962
url: https://doi.org/10.5594/JMI.2021.3067962
Snippet:
<li> Céline Guede, Pierre Andrivon, Jean-Eudes Marvie, Julien Ricard, Bill Redmann, and Jean-Claude Chevet; <cite id="bib-10-5594-jmi-2021-3067962">V-PCC Performance Evaluation of the First MPEG Point Codec</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 4, May 2021); SMPTE, 2021 <span class="doi">10.5594/JMI.2021.3067962</span> </li>