Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 134, No. 6, pp. 25–33
Abstract: Video consumption has grown rapidly worldwide, supported by advanced devices such as smartphones, tablets, and immersive headsets like Apple Vision Pro, which enable real-time 6 Degrees of Freedom (6DoF) navigation. Yet, the lack of engaging volumetric content limits the applications of these technologies in training and entertainment. Volumetric video offers promise but faces challenges in natural 3D+t reconstruction, coding, and rendering due to high computational demands. In 2020, the groundbreaking Neural Radiance Field (NeRF) paper introduced a new method for generating natural, free-viewpoint renderings of real scenes. Follow-up research, including 3D Gaussian Splatting, has improved efficiency and flexibility; however, most approaches still require separate models per frame, which complicates video representation. Recent extensions utilize temporal redundancy to create compact, consistent, and editable volumetric video. This paper reviews state-of-the-art radiance field-based methods, analyzing their strengths and limitations, and provides an objective evaluation using a diverse multi-view dataset, with a focus on applications for entertainment and training.
Publication Date: 2025-10-01
DOI: 10.5594/JMI.2025/DSKU9413
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2025/DSKU9413
Author(s): Joshua Maraval
Nicolas Ramin
Lu Zhang
Keyword(s): Volumetric Video, Neural Radiance Fields, Gaussian Splatting, Free-Viewpoint Rendering
Copyright: © 2025 SMPTE

Bibliographic Reference(s)

A. Smolic, “3D video and free viewpoint video-From capture to display,” Pattern Recogn., 44(9): 1958–1968, 2011, doi: 10.1016/j.patcog.2010.09.005. EXTERNAL
G. Thomas, R. Gade, T. B. Moeslund, P. Carr, and A. Hilton, “Computer vision for sports: Current applications and research topics,” Comput. Vis. Image Underst., 159: 318, 2017, doi: 10.1016/j.cviu.2017.04.011. EXTERNAL
M. Hackett, B. Makled, E. Mizroch, S. Venshtain, and M. McCoy-Thompson, “Volumetric Video and Mixed Reality for Healthcare Training,” May 2022. EXTERNAL
S. Orts-Escolano, “Holoportation: Virtual 3DT in Real-time,” Proc. 29th Annu. Symp. User Interface Softw. Technol., pp. 741–754, 2016. EXTERNAL
“Intel True View-Intel in Sports,” [Online]. Available: https://www.intel.com/content/www/us/en/sports/technology/true-view.html. EXTERNAL
C. Fehn, “Depth-image-based rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV,” Proc. SPIE, 5291, May 2004. EXTERNAL
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng, “NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis,” Eur. Conf. Comput. Vis., pp. 405–421, 2020. EXTERNAL
S. Fridovich-Keil, A. Yu, M. Tancik, Q. Chen, B. Recht, and A. Kanazawa, “Plenoxels: Radiance Fields Without Neural Networks,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn., pp. 5501–5510, 2022. EXTERNAL
M. Tancik, “NeRFStudio: A Modular Framework for Neural Radiance Field Development,” ACM SIGGRAPH 2023 Conf. Proc., SIGGRAPH '23, 2023. EXTERNAL
J. T. Barron, B. Mildenhall, M. Tancik, P. Hedman, R. Martin-Brualla, and P. P. Srinivasan, “Mip-NeRF: A Multiscale Representation for Anti-aliasing Neural Radiance Fields,” Proc. IEEE/CVF Int. Conf. Comput. Vis., pp. 5855–5864, 2021. EXTERNAL
B. Roessle, N. Müller, L. Porzi, S. R. Bulò, P. Kontschieder, and M. Nießner, “GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields,” ACM Trans. Graph., 42(6), Nov. 2023, doi: 10.1145/3618402. EXTERNAL
M. Niemeyer, “RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn., pp. 5470–5480, 2022. EXTERNAL
B. Kerbl, G. Kopanas, T. Leimkühler, and G. Drettakis, “3D Gaussian Splatting for Real-time Radiance Field Rendering,” ACM Trans. Graph., 42(4), Jul. 2023. Online.. Available: https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/. EXTERNAL
M. Ye, “Gaussian grouping: Segment and Edit anything in 3D Scenes,” Proc. Eur. Conf. Comput. Vis., Cham: Springer Nature, Switzerland, 2024. EXTERNAL
L. Song, “NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields,” IEEE Trans. Vis. Comput. Graphics, 29(5): 2732–2742, 2023. EXTERNAL
J. Zhang, “Editable Free-viewpoint Video Using a Layered Neural Representation,” ACM Trans. Graph., 40(4):1–18, 2021,. EXTERNAL
A. M. Barros, M. Michel, Y. Moline, G. Corre, and F. Carrel, “A Comprehensive Survey of Visual SLAM Algorithms,” Robotics, 11(1), Jan. 2022, doi: 10.3390/robotics11010024. EXTERNAL
J. L. Schonberger and J.-M. Frahm, “Structure-from-motion Revisited,” Proc. IEEE Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 4104–4113, Jun. 2016. EXTERNAL
Z. Wang, S. Wu, W. Xie, M. Chen, and V. A. Prisacariu, “NeRF-: Neural Radiance Fields Without Known Camera Parameters,” arXiv preprint, arXiv:2102.07064, Feb. 2021. EXTERNAL
Y. Jeong, “Self-Calibrating Neural Radiance Fields,” Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 5846–5854, 2021. EXTERNAL
S.-F. Chng, S. Ramasinghe, J. Sherrah, and S. Lucey, “Gaussian Activated Neural Radiance Fields for High Fidelity Reconstruction and Pose Estimation,” Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 264–280, 2022. EXTERNAL
Z. Liu, P. An, S. Liu, and Z. Zhang, “Arbitrary View Generation Based on DIBR,” Proc. Int. Symp. Intell. Signal Process. Commun. Syst. (ISPACS), pp. 168–171, 2007. EXTERNAL
M. Levoy and P. Hanrahan, “Light Field Rendering,” Seminal Graph. Papers: Pushing the Boundaries, 2:441–452, Aug. 2023. EXTERNAL
S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The Lumigraph,” in Seminal Graph. Papers: Pushing the Boundaries, Vol. 2, pp. 453–464, 2023. EXTERNAL
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “lmageNet Classification With Deep Convolutional Neural Networks,” Adv. Neural lnt. Process. Syst. (NeurIPS), 25:1097–1105, Dec. 2012. EXTERNAL
J. Maraval, “MUSE: A Multi-View Synthesis Enhancer,” Proc. Eur. Signal Process. Conf. (EUSIPCO), pp. 665–668, 2023. EXTERNAL
P. Hedman, J. Philip, T. Price, J.-M. Frahm, G. Drettakis, and G. Brostow, “Deep Blending for Free-Viewpoint Image-Based Rendering,” ACM Trans. Graph., 37(6): 1–15, Nov. 2018. EXTERNAL
W. Liu, “Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis,” Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 5904–5912, Oct. 2019. EXTERNAL
R. Huang, S. Zhang, T. Li, and R. He, “Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis,” Proc. IEEE Int. Conf. Comput. Vis. (ICCV), pp. 2458–2467, Oct. 2017. EXTERNAL
G. Riegler and V. Koltun, “Free View Synthesis,” Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 623–640, 2020. EXTERNAL
G. Riegler and V. Koltun, “Stable View Synthesis,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 12216–12225, 2021. EXTERNAL
D. Rückert, L. Franke, and M. Stamminger, “ADOP: Approximate Differentiable One-Pixel Point Rendering,” ACM Trans. Graph., 41(4), pp.1–14, Jul. 2022. EXTERNAL
B. Mildenhall, “Local Light Field Fusion: Practical View Synthesis With Prescriptive Sampling Guidelines,” ACM Trans. Graph., 38(4), pp. 1–14, Jul. 2019. EXTERNAL
J. Flynn, “DeepView: View Synthesis With Learned Gradient Descent,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 2367–2376, 2019. EXTERNAL
S. Wizadwongsa, P. Phongthawee, J. Yenphraphai, and S. Suwajanakorn, “NeX: Real-Time View Synthesis With Neural Basis Expansion,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 8534–8543, 2021. EXTERNAL
M. Broxton, “Immersive Light Field Video With a Layered Mesh Representation,” ACM Trans. Graph., 39(4), pp. 81–86, Jul. 2020. EXTERNAL
Q. Wang, “IBRNet: Learning Multi-View Image-Based Rendering,” Proc. IEEE/ CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 4690–4699, 2021. EXTERNAL
S. J. Garbin, M. Kowalski, M. Johnson, J. Shotton, and J. Valentin, “FastNeRF: High-Fidelity Neural Rendering at 200 FPS,” Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 14346–14355, 2021. EXTERNAL
P. Hedman, P. P. Srinivasan, B. Mildenhall, J. T. Barron, and P. Debevec, “Baking Neural Radiance Fields for Real-Time View Synthesis,” Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 5875–5884, 2021. EXTERNAL
B. Deng, J. T. Barron, and P. P. Srinivasan, “JaxNeRF: An Efficient JAX Implementation of NeRF,” 2020. EXTERNAL
T. Neff, “DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields Using Depth Oracle Networks,” Computer Graphics Forum, 40(4): 45–59, Jul. 2021. tugraz.elsevierpure.com. EXTERNAL
K. Zhang, G. Riegler, N. Snavely, and V. Koltun, “NeRF++: Analyzing and Improving Neural Radiance Fields,” arXiv preprint, Oct. 2020. EXTERNAL
M. Tancik, “Block-NeRF: Scalable Large Scene Neural View Synthesis,” 2022. EXTERNAL
H. Turki, D. Ramanan, and M. Satyanarayanan, “Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 12922–12931, 2022. EXTERNAL
Z. Ma and D. Xu, “Switch-NeRF: Learning Scene Decomposition With Mixture of Experts for Large-Scale Neural Radiance Fields,” Proc. Int. Conf. Learn. Represent. (ICLR), 2022. EXTERNAL
J. Ost, F. Mannan, N. Thuerey, J. Knodt, and F. Heide, “Neural Scene Graphs for Dynamic Scenes,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 2856–2865, 2021. EXTERNAL
M. Niemeyer and A. Geiger, “GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 11453–11464, 2021. EXTERNAL
M. Mihajlovic, “KeypointNeRF: Generalizing Image-Based Volumetric Avatars Using Relative Spatial Encoding of Keypoints,” Proc. Eur. Conf. Comput. Vis. (ECCV), Cham: Springer Nature Switzerland, pp. 1–18, 2022. EXTERNAL
K. Park, “HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields,” 2021. EXTERNAL
A. Grigorev, “StylePeople: A Generative Model of Full-Body Human Avatars,” 2021. EXTERNAL
S. Lombardi, “Neural Volumes: Learning Dynamic Renderable Volumes From Images,” arXiv preprint, arXiv:1906.07751, 2019. EXTERNAL
J. T. Barron, B. Mildenhall, D. Verbin, P. P. Srinivasan, and P. Hedman, “Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 5470–5479, 2022. EXTERNAL
C. Sun, M. Sun, and H.-T. Chen, “Direct Voxel Grid Optimization: Super-Fast Convergence for Radiance Fields Reconstruction,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 5459–5469, 2022. EXTERNAL
M. Kim, S. Seo, and B. Han, “lnfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering,” Dec. 2021. EXTERNAL
B. Roessle, J. T. Barron, B. Mildenhall, P. P. Srinivasan, and M. Nießner, “Dense Depth Priors for Neural Radiance Fields From Sparse Input Views,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 12892–12901, 2022. EXTERNAL
A. Yu, R. Li, M. Tancik, H. Li, R. Ng, and A. Kanazawa, “Plenoctrees for Real-Time Rendering of Neural Radiance Fields,” Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 5752–5761, 2021. EXTERNAL
D. Rebain, “DeRF: Decomposed Radiance Fields,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 14153–14162, 2021. EXTERNAL
L. Liu, J. Gu, K. Z. Lin, T.-S. Chua, and C. Theobalt, “Neural Sparse Voxel Fields,” Adv. Neural Int. Process. Syst. (NeurIPS), vol. 33, pp. 15651–15663, 2020. EXTERNAL
T. Müller, A. Evans, C. Schied, and A. Keller, “Instant Neural Graphics Primitives With a Multiresolution Hash Encoding,” ACM Trans. Graph., vol. 41, no. 4, Art. 102, Jul. 2022, doi: 10.1145/3528223.3530127. EXTERNAL
D. Mieloch, A. Dziembowski, and M. Domański, “MPEG-I Visual. Natural Outdoor Test Sequences,” Brussels, Belgium, 2020. EXTERNAL
A. Pumarola, E. Corona, G. PonsMoll, and F. MorenoNoguer, “DNeRF: Neural Radiance Fields for Dynamic Scenes,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 10318–10327, Jun. 2021. EXTERNAL
J.-W. Liu, “DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes,” Adv. Neural Int. Process. Syst. (NeurIPS), vol. 35, pp. 36762–36775, 2022. EXTERNAL
G. Wu, “4D Gaussian Splatting for Real-Time Dynamic Scene Rendering,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 20310–20320, Jun. 2024. EXTERNAL
Y. Liang, “GauFRe: Gaussian Deformation Fields for RealTime Dynamic Novel View Synthesis,” Proc. IEEE/CVF Winter Conf. Appl. Comput. Vis. (WACV), pp. 2642–2652, Feb. 2025. EXTERNAL
S. FridovichKeil, G. Meanti, F. R. Warburg, B. Recht, and A. Kanazawa, “KPlanes: Explicit Radiance Fields in Space, Time, and Appearance,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 12479–12488, 2023. EXTERNAL
Z. Yang, H. Yang, Z. Pan, X. Zhu, and L. Zhang, “RealTime Photorealistic Dynamic Scene Representation and Rendering With 4D Gaussian Splatting,” arXiv preprint, arXiv:2310.10642, 2023. EXTERNAL
Z. Li, “Spacetime Gaussian Feature Splatting for RealTime Dynamic View Synthesis,” Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR), 2024. EXTERNAL
B. Wei, “MUVOD: A Novel MultiView Video Object Segmentation Dataset and a Benchmark for 3D Segmentation,” arXiv preprint, arXiv:2507.07519, 2025. EXTERNAL
L. Z. M. J. N. Ramin, “K3BO: KeypointBased Bounding Box Optimization for Radiance Field Reconstruction From MultiView Images,” ICME Workshop Immersive Media Compression, 2023. EXTERNAL
D. Mieloch, “MIV. New Natural Content-MartialArts,” Jan. 2023. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-DSKU9413.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Joshua Maraval, Nicolas Ramin, and Lu Zhang; Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview, MIJ 2025, Volume 134, Number 6 (pp. 25 to 33); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/DSKU9413

Snippet:

Joshua Maraval, Nicolas Ramin, and Lu Zhang; Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview, MIJ 2025, Volume 134, Number 6 (pp. 25 to 33); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/DSKU9413

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Joshua Maraval, Nicolas Ramin, and Lu Zhang; <cite>Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview</cite>, MIJ 2025, Volume 134, Number 6 (pp. 25 to 33); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/DSKU9413" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/DSKU9413</a></span>

SMPTE's HTML Pub

Preview:

Joshua Maraval, Nicolas Ramin, and Lu Zhang; Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview, MIJ 2025, Volume 134, Number 6 (pp. 25 to 33); SMPTE, 2025
doi: 10.5594/JMI.2025/DSKU9413
url: https://doi.org/10.5594/JMI.2025/DSKU9413

Snippet:

<li>
Joshua Maraval, Nicolas Ramin, and Lu Zhang; <cite id="bib-10-5594-jmi-2025-dsku9413">Advancements in Radiance Field Techniques for Volumetric Video Generation: A Technical Overview</cite>, MIJ 2025, Volume 134, Number 6 (pp. 25 to 33); SMPTE, 2025
<span class="doi">10.5594/JMI.2025/DSKU9413</span>
</li>