VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 134, No. 1, pp. 57–63
Abstract: Volumetric Video (VV) allows audiences to experience real-world scenery in full 6° of freedom, i.e., selecting individual viewpoints and directions. It is often produced as point clouds or meshes with shape and texture data. This leads to a substantial volume of data that requires efficient compression. However, there is a lack of universally accepted standards for VV, resulting in many organizations implementing their own approaches. Hence, we suggest Volumetric Video Graphics Library Transmittal Format (VVglTF), an extension of the open-source 3D content format glTF, which is optimized for the Internet. We utilize glTF's rendering workflow to play VV of any duration or file size efficiently. Custom extensions in glTF expand the functionality of the basic model and offer customization for VV playback. We also developed a simple and efficient VVglTF streaming system based on HTTP. It is designed to play VV content across different network conditions efficiently. In our experiments, we validated the efficiency of our approach.
Publication Date: 2025-01-01
DOI: 10.5594/JMI.2025/GLNG7938
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2025/GLNG7938
Author(s): Kit Yung Lam
Simone Croci
Philipp Haslbauer
Aljosa Smolic
Keyword(s): Volumetric Video, glTF, Immersive Standards, Extended Reality
Copyright: © 2025 SMPTE

Bibliographic Reference(s)

I. Reimat, E. Alexiou, J. Jansen, I. Viola, S. Subramanyam, and P. Cesar, “Cwipc-sxr: Point Cloud Dynamic Human Dataset for Social xr,” Proc. of the 72th ACM Multimedia Systems Conference, pp. 300–306, 2021. EXTERNAL
V. Sterzentsenko, A. Karakottas, A. Papachristou, N. Zioulis, A. Doumanoglou, D. Zarpalas, and P. Daras, “A Low-cost, Flexible, and Portable Volumetric Capturing System,” Proc. 14th International Conference on Signal-Image Technology & Inter-net-Based Systems, pp. 200–207, 2018. EXTERNAL
A. Collet, M. Chuang, P. Sweeney, D. Gillett, D. Evseev, D. Calabrese, and S. Sullivan, “High-quality streamable free-viewpoint video,” ACM Transactions on Graphics (ToG), 2015. EXTERNAL
A. Hilsmann, P. Fechteler, W. Morgenstern, W. Paier, I. Feldmann, O. Schreer, and P. Eisert, “Going Beyond Free Viewpoint: Creating Animatable Volumetric Video of Human Performances,” IET Computer Vision, 14(6), pp. 350–358, 2020. EXTERNAL
R. Pages, K. Amplianitis, D. Monaghan, J. Ondrej, and A. Smolic, “Affordable Content creation for free-viewpoint video and VR/AR applications,” J. Visual Communication and Image. EXTERNAL
What is Volumetric Media: Specifications. [Online]. Available: https://www.volumet-ricformat.org/specifications. EXTERNAL
Volumetric Format Association (VFA). [Online]. Available: https://www.volumetric-format.org. EXTERNAL
MPEG-5 Part 2 (LCEVC). [Online]. Available: https://www.lcevc.org. EXTERNAL
Khronous Group. [Online]. Available: https://www.khronos.org/api/index_2017/gltf. EXTERNAL
G. Valenzise, M. Alain, E. Zerman, and C. Ozcinar (Eds.), Immersive Video Technologies, 2022. EXTERNAL
International Organization for Standardization/International Electrotechnical (ISO/ IEC) 14496–14:2020, “Information technology-Coding of audio-visual objects-Part 14: MP4 File format (Standard) (3rd ed.) Jan. 2020. EXTERNAL
J. Lawrence, D. Goldman, S. Achar, G. M. Blascovich, J. G. Desloge, T. Fortes, and K. Tong, “Project Starline: A High-Fidelity Telepresence System,” ACM Transactions on Graphics (TOG), 40 (6):1–16, Dec.. EXTERNAL
S. Schwarz, M. Preda, V. Baroncini, M. Budagavi, P. Cesar, P. A. Chou, and V. Zakharchenko, “Emerging MPEG standards for point cloud compression,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 9(1): 133–148, Mar. 2019. EXTERNAL
J. Kammerl, N. Blodow, R. B. Rusu, S. Gedikli, M. Beetz, and E. Steinbach, “Real-time Compression of Point Cloud Streams. Proc. 2012 IEEE International Conference on Robotics and Automation (ICRA), pp. 778–785, May 2012. EXTERNAL
L. Llola, L. Kondrad, S. Schwarz, and A. Hamza, “An overview of the MPEG standard for storage and transport of visual volumetric video-based coding,” Frontiers in Signal Processing, Vol. 2, pp. 883943, 2022. EXTERNAL
M. Hosseini, and C. Timmerer, “Dynamic Adaptive Point Cloud Streaming,” Proc. of the 23rd Packet Video Workshop, pp. 25–30, Jun. 2018. EXTERNAL
J. Park, P. A. Chou, and J. N. Hwang, “Rate-utility optimized streaming of volumet-ric media for augmented reality,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 9(1): 149–162, Mar. 2019. EXTERNAL
J. Park, P. A. Chou, & J. N. Hwang, “Volumetric Media Streaming for Augmented Reality,” Proc. 2018 IEEE GLOBECOM, pp. 1–6, Dec. 2018. EXTERNAL
S. Subramanyam, I. Viola, A. Hanjalic, and P. Cesar, “User-centered Adaptive Streaming of Dynamic Point Clouds with Low Complexity Tiling,” Proc. of the 28th ACM International Conference on Multimedia, pp. 3669–3677, Oct. 2020. EXTERNAL
B. Han, Y. Liu, and F. Qian, “ViVo: Visibility-aware mobile volumetric video streaming,” Proc. 26th Annual International Conference on Mobile Computing and Networking, pp. 1–13, Apr. 2020. EXTERNAL
Y. Huang, Y. Zhu, X. Qiao, Z. Tan, and B. Bai, “Aitransfer: Progressive AI-powered transmission for real-time point cloud video streaming,” Proc. 29th ACM International Conference on Multimedia (ACM MM), pp. 3989–3997, Oct. 2021. EXTERNAL
A. Zhang, C. Wang, B. Han, and F. Qian, “Efficient volumetric video streaming through super resolution,” Proc. 22nd International Workshop on Mobile Computing Systems and Applications, pp. 106–111, Feb. 2021. EXTERNAL
E. Zerman, C. Ozcinar, P. Gao, and A. Smolic, “Textured Mesh vs. Coloured Point Cloud: A Subjective Study for Volumetric Video Compression,” Twelfth QoMEX, pp. 1–6, May 2020. EXTERNAL
Google/draco. [Online]. Available: https://github.com/google/draco. EXTERNAL
Anh Nguyen, Jan Lassig, Anna F. Kalin, Ariana Huwiler, Philipp Haslbauer Gareth W. Young, Lam Kit Yung, Aljosa Smolic, “A Volumetric Video Application to Enhance Museum Experiences,” VRST 24: Proc. of the 30th ACM Symposium on Virtual Reality Software and Technology. [Online]. Available: https://dl.acm.org/doi/10.1145/3641825.3689695. EXTERNAL
KhronosGroup/glTF. EXT_volumetricvideo Draft Proposal #2438. [Online]. Available: https://github.com/KhronosGroup/glTF/puI1/2438. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-GLNG7938.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Kit Yung Lam, Simone Croci, Philipp Haslbauer, and Aljosa Smolic; VVGLTF: Efficient Streaming of Volumetric Video with GLTF, MIJ 2025, Volume 134, Number 1 (pp. 57 to 63); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/GLNG7938

Snippet:

Kit Yung Lam, Simone Croci, Philipp Haslbauer, and Aljosa Smolic; VVGLTF: Efficient Streaming of Volumetric Video with GLTF, MIJ 2025, Volume 134, Number 1 (pp. 57 to 63); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/GLNG7938

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Kit Yung Lam, Simone Croci, Philipp Haslbauer, and Aljosa Smolic; <cite>VVGLTF: Efficient Streaming of Volumetric Video with GLTF</cite>, MIJ 2025, Volume 134, Number 1 (pp. 57 to 63); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/GLNG7938" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/GLNG7938</a></span>

SMPTE's HTML Pub

Preview:

Kit Yung Lam, Simone Croci, Philipp Haslbauer, and Aljosa Smolic; VVGLTF: Efficient Streaming of Volumetric Video with GLTF, MIJ 2025, Volume 134, Number 1 (pp. 57 to 63); SMPTE, 2025
doi: 10.5594/JMI.2025/GLNG7938
url: https://doi.org/10.5594/JMI.2025/GLNG7938

Snippet:

<li>
Kit Yung Lam, Simone Croci, Philipp Haslbauer, and Aljosa Smolic; <cite id="bib-10-5594-jmi-2025-glng7938">VVGLTF: Efficient Streaming of Volumetric Video with GLTF</cite>, MIJ 2025, Volume 134, Number 1 (pp. 57 to 63); SMPTE, 2025
<span class="doi">10.5594/JMI.2025/GLNG7938</span>
</li>