Demystifying the Use of Compression in Virtual Production

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 134, No. 3, pp. 44–54
Abstract: Virtual Production (VP) technologies enhance on-set filming and live concerts through high-resolution, high-brightness LED panels. Due to technical challenges like synchronization and color balancing, the industry prefers resource-intensive lossless compression for displays. Modern lossy standards (AV1, H.265) could maintain quality while reducing resource demands, yet no agreed methodology exists for assessing their in-camera impact. We present a method comparing lossless and lossy compressed footage displayed through VP screens and recorded in-camera. Our assessment compares HAP/NotchLC/Daniel2 intermediate codecs with hardware Nvidia Encoders (NVENC) using AV1/HEVC/H.264 compression at bitrates from 2–2000 Mbit/s with various GOP sizes using different perceptual quality metrics. Results demonstrate hybrid codecs achieve equivalent quality to intermediate encoders at significantly lower bitrates and storage requirements.
Publication Date: 2025-05-01
DOI: 10.5594/JMI.2025/MJPY7062
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2025/MJPY7062
Author(s): Vibhoothi Vibhoothi
Julien Zouein
Francois Pitie
Christopher Nash
James Bentley
Philip Coulam-Jones
Anil Kokaram
Keyword(s): Virtual Production, Compression, HEVC, H.264, AV1, HAP, NotchLC, Daniel2
Copyright: © 2025 SMPTE

Bibliographic Reference(s)

G. W. Perkins and S. Echeverry, “Virtual Production in Action: A Creative Implementation of Expanded Cinematography and Narratives,” ACM SIGGRAPH Posters, 2022. EXTERNAL
T. Zhang, “From digital visual effects to emerging in-camera visual effects: investigating the change of workflow, occupational roles and common challenges in Southeast Asian and East Asian countries,” Nanyang Technological University, 2024. EXTERNAL
Disguise, Welcome to the New Era of Film: Five ways virtual production is revolutionising filmmaking, Disguise, 2023. EXTERNAL
N. Kadner, The Virtual Production Field Guide Volume 1, Epic Games, 2019. EXTERNAL
P. Debevec and C. LeGendre, “HDR Lighting Dilation for Dynamic Range Reduction on Virtual Production Stages,” ACM SIGGRAPH 2022 Posters, 2022. EXTERNAL
R. Hendricks, “Rapid Industry Solutions (RiS) Initiative, On-Set Virtual Production (OSVP), and Open Services Alliance (OSA),” SMPTE Mot. Imag. J., 8(732): 78–80, Sep. 2023. EXTERNAL
B. Desowitz, “Reverse Engineering ‘Gravity’,” Animation World Network, 4 October 2013. [Online]. Available: https://www.awn.com/vfxworld/reverse-engineering-gravity. [Accessed 03 Aug. 2024]. EXTERNAL
S. Dalkian, S. Miglio and others, “nDisplay Technology: Limitless scaling of real-time content,” Technical Whitepaper, pp. 1–24, 2019. EXTERNAL
Disguise, “Eight benefits of virtual production,” Disguise, April 2021. [Online]. Available: https://www.disguise.one/en/insights/blog/eight-benefits-of-virtual-production/. [Accessed 05 Aug. 2024]. EXTERNAL
M. Kavakli and C. Cremona, “The virtual production studio concept-an emerging game changer in filmmaking,” IEEE Conf. on Virtual Reality and 3D User Interfaces (VR), pp. 29–37, 2022. EXTERNAL
F. Pires, R. Silva and R. Raposo, “A survey on virtual production and the future of compositing technologies,” Avanca Cinema J., 27(692-9), 2022. EXTERNAL
Tom Whittock, “The Key to Superior Content Rendering,” Disguise, 12 2023. [Online]. Available: https://www.disguise.one/sites/default/files/2023-12/Render-stream_Whitepaper.pdf. [Accessed 05 Aug. 2024]. EXTERNAL
M. Henrique and G. Sullivan, “YCoCg-R: A color space with RGB reversibility and low dynamic range,” ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q6, 2003. EXTERNAL
Cinegy, “Cinegy Daniel2 GPU Codec Enters Public Beta,” Cinegy, 6 Jun. 2017. [Online]. Available: https://www.cinegy.com/news/cinegy-daniel2-gpu-codec-enters-public-beta/. [Accessed 6 Aug. 2024]. EXTERNAL
Kostya, “A cursory glance at Daniel codecs,” 10 Jul. 2022. [Online]. Available: https://codecs.multimedia.cx/2022/07/a-cursory-glance-at-daniel-codecs/. [Accessed 6 Aug. 2024]. EXTERNAL
N. Porrmann, “10bit Workflow Viability + Codec Comparison,” Dandelion-burdock, Jun. 2019. [Online]. Available: https://dandelion-burdock.com/articles/10bit-work-flow-viability. [Accessed 6 Aug. 2024]. EXTERNAL
K. Murray and V. Simion, “Color Management in Virtual Production” ACM SIGGRAPH 2023, Vol. 20, Los Angeles, CA 2023. EXTERNAL
K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, “Study of subjective and objective quality assessment of video,” IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427–1441, Jun. 2010. EXTERNAL
V. Vibhoothi, A. Katsenou, F. Pitie, K. Domijan, and A. Kokaram, “Subjective assessment of the impact of a content adaptive optimiser for compressing 4K HDR content with AV1,” Proc. IEEE Int. Conf. Image Process. (ICIP), Kuala Lumpur, Malaysia, 2023. EXTERNAL
J. Y. Lin, E. C.-H. Wu, C.-C. J. Kuo, P. L. Callet, T. Goodall and A. Aaron, “Toward A Practical Perceptual Video Quality Metric,” Los Gatos: Netflix Technical Blog, 2016. EXTERNAL
Z. Li, C. Bampis, J. Novak, A. Aaron, K. Swanson, A. Moorthy and J. De Cock, “VMAF: The Journey Continues,” Netflix, 25 Oct. 2018. [Online]. Available: https://netflixtechblog.com/vmaf-the-journey-continues-44b51ee9ed12. [Accessed 11 Aug. 2024]. EXTERNAL
R. K. Mantiuk, P. Hanji, M. Ashraf, Y. Asano, and A. Chapiro, “ColorVideoVDP: A visual difference predictor for image, video and display distortions,” ACM Trans. Graph., vol. 43, no. 4, Art. no. 20, Jul. 2024. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-MJPY7062.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Vibhoothi Vibhoothi, Julien Zouein, Francois Pitie, Christopher Nash, James Bentley, Philip Coulam-Jones, and Anil Kokaram; Demystifying the Use of Compression in Virtual Production, MIJ 2025, Volume 134, Number 3 (pp. 44 to 54); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/MJPY7062

Snippet:

Vibhoothi Vibhoothi, Julien Zouein, Francois Pitie, Christopher Nash, James Bentley, Philip Coulam-Jones, and Anil Kokaram; Demystifying the Use of Compression in Virtual Production, MIJ 2025, Volume 134, Number 3 (pp. 44 to 54); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/MJPY7062

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Vibhoothi Vibhoothi, Julien Zouein, Francois Pitie, Christopher Nash, James Bentley, Philip Coulam-Jones, and Anil Kokaram; <cite>Demystifying the Use of Compression in Virtual Production</cite>, MIJ 2025, Volume 134, Number 3 (pp. 44 to 54); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/MJPY7062" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/MJPY7062</a></span>

SMPTE's HTML Pub

Preview:

Vibhoothi Vibhoothi, Julien Zouein, Francois Pitie, Christopher Nash, James Bentley, Philip Coulam-Jones, and Anil Kokaram; Demystifying the Use of Compression in Virtual Production, MIJ 2025, Volume 134, Number 3 (pp. 44 to 54); SMPTE, 2025
doi: 10.5594/JMI.2025/MJPY7062
url: https://doi.org/10.5594/JMI.2025/MJPY7062

Snippet:

<li>
Vibhoothi Vibhoothi, Julien Zouein, Francois Pitie, Christopher Nash, James Bentley, Philip Coulam-Jones, and Anil Kokaram; <cite id="bib-10-5594-jmi-2025-mjpy7062">Demystifying the Use of Compression in Virtual Production</cite>, MIJ 2025, Volume 134, Number 3 (pp. 44 to 54); SMPTE, 2025
<span class="doi">10.5594/JMI.2025/MJPY7062</span>
</li>