Multicam Live Production in a Virtual Environment
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 2021, No. 11, pp. 1–10
- Abstract
- Hardly any movie is made without the use of visual effects (VFX). The power of today's graphical processors allows a lot of the effects to be rendered in real-time, which opens the possibility of recording in-camera VFX. This technique has been used in the making of several recent movies. The TV show “The Mandalorian” uses a large active LED wall to project its 3D scenery. This way, the actors, director, and camera operators see the sets in real-time, instead of a greenscreen. Bringing this innovation to the television studio offers several challenges to overcome. The use of a multi-cam setup and synchronous switching of what is displayed on the LED wall or a consistent depth of field to name just two. We have overcome these obstacles with the Ketnet live show “Gouden K's”. Besides the big productions, we believe this technique might be even more beneficial in small productions using a limited technical crew. With a second project “PeetieClub”, VRT wanted to explore the possibilities and limitations of Virtual Studio Production using Game Engine Technology. The software-based solution we've deployed (running on common PC hardware) allows for lots of flexibility, creativity, and high-quality content in real-time. Using Unreal Engine and PTZ cameras, we've built a complete interactive 4-input Virtual Production switcher engine using one main workstation. Both projects will be described including lessons learned from an operational point of view.
- Publication Date
- 2021-11-09
- DOI
10.5594/M001932- Link
- https://doi.org/10.5594/M001932
- Author(s)
- Tom De WispelaereMSc, Manager, VRT, Vlaamse Radio en Televisie, Brussels, Belgium.Dries TastenhoyeIng, Product Owner, VRT, Vlaamse Radio en Televisie, Brussels, Belgium.Vincent Van WerdeB, Head of Design & Set Building, VRT, Vlaamse Radio en Televisie, Brussels, Belgium.Gregg YoungB, Project Manager, VRT, Vlaamse Radio en Televisie, Brussels, Belgium.Willem VermostMSc, Design & Engineering Manager, VRT, Vlaamse Radio en Televisie, Brussels, Belgium.
- Keyword(s)
- Extended Reality, Live Production, Multi-camera, Game Engine, LED Wall, Character Animator, On-set Virtual Production
- Copyright
- © 2021 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- Augmented Reality (AR), https://en.wikipedia.org/wiki/Augmented_reality EXTERNAL
- Bumpers, https://en.wikipedia.org/wiki/Bumper_(broadcasting) EXTERNAL
- Youtube, http://youtube.com/ EXTERNAL
- Adobe Character Animator, https://www.adobe.com/be_en/products/character-animator.html EXTERNAL
- Covid-19, https://en.wikipedia.org/wiki/COVID-19 EXTERNAL
- GPIO, https://en.wikipedia.org/wiki/General-purpose_input/output EXTERNAL
- Twitch, https://www.twitch.tv/ EXTERNAL
- Multicam, https://en.wikipedia.org/wiki/Multiple-camera_setup EXTERNAL
- Green key, https://en.wikipedia.org/wiki/Chroma_key EXTERNAL
- vMix, https://www.vmix.com/ EXTERNAL
- VRT, https://www.vrt.be/ EXTERNAL
- SDI, Serial Digital Interface, https://en.wikipedia.org/wiki/Serial_digital_interface EXTERNAL
- Notch, https://www.notch.one EXTERNAL
- Extended Reality (XR), https://en.wikipedia.org/wiki/Extended_reality EXTERNAL
- Virtual Local Area Network (VLAN), https://en.wikipedia.org/wiki/Virtual_LAN EXTERNAL
- NDI, https://www.ndi.tv/ EXTERNAL
- Cinema4D, https://www.maxon.net/en/cinema-4d EXTERNAL
- Malfmedia, https://www.malfmedia.co.uk/ EXTERNAL
- The Mandalorian, https://en.wikipedia.org/wiki/The_Mandalorian EXTERNAL
- LinkEllo, https://en.linkello.eu/ EXTERNAL
- Visual effects (VFX), https://en.wikipedia.org/wiki/Visual_effects EXTERNAL
- In-Ear Monitoring (IEM), https://en.wikipedia.org/wiki/In-ear_monitor EXTERNAL
- Aplha compositing, https://en.wikipedia.org/wiki/Alpha_compositing EXTERNAL
- Dante Virtual Soundcard, https://www.audinate.com/products/software/dante-virtual-soundcard EXTERNAL
- Ketnet, https://en.wikipedia.org/wiki/Ketnet EXTERNAL
- Steadicam, https://en.wikipedia.org/wiki/Steadicam EXTERNAL
- GrandMA, https://www.malighting.com/ EXTERNAL
- Moiré, https://en.wikipedia.org/wiki/Moir%C3%A9_pattern EXTERNAL
- Pan Tilt Zoom (PTZ), https://en.wikipedia.org/wiki/Pan%E2%80%93tilt%E2%80%93zoom_camera EXTERNAL
- Unreal Engine, https://www.unrealengine.com/en-US/ EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001932.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; Multicam Live Production in a Virtual Environment, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001932
Snippet:
Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; Multicam Live Production in a Virtual Environment, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001932
HTML (ISO 690 compliant)
Preview:
Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; Multicam Live Production in a Virtual Environment, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001932
Snippet:
<span class="citation">Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; <cite>Multicam Live Production in a Virtual Environment</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/M001932" target="_blank" rel="noopener">https://doi.org/10.5594/M001932</a></span>
SMPTE's HTML Pub
Preview:
Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; Multicam Live Production in a Virtual Environment, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021
doi: 10.5594/M001932
url: https://doi.org/10.5594/M001932
doi: 10.5594/M001932
url: https://doi.org/10.5594/M001932
Snippet:
<li> Tom De Wispelaere, Dries Tastenhoye, Vincent Van Werde, Gregg Young, and Willem Vermost; <cite id="bib-10-5594-m001932">Multicam Live Production in a Virtual Environment</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021 <span class="doi">10.5594/M001932</span> </li>