Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 134, No. 6, pp. 59–68
Abstract: In this paper, we present a novel method for integrating the stereoscopic content of a live act into a virtual reality (VR) environment. This opens a new level of immersion when watching the recording of a stage event using a head-mounted display. In contrast to existing solutions, we offer proper depth perception, allow for a low complexity recording and distribution, and still avoid any motion sickness caused by objects being close to the observer. To this end, we separate the digitization of the event location from the recording of the actor's performance. As a main contribution of the paper, we show how to achieve high visual quality when compositing the stereo recording of the actors with the reconstructed 3D model of the event location. To achieve this, we have developed a tool that enables simulating the 3D perception of stereo video, depending on the selected stereo parameters, such as inter-camera distance and focal length. By these means, we can ensure a seamless transition between the stereo video and the 3D model of the event location, resulting in superior visual quality. Numerous lessons learned conclude our paper, demonstrating how we overcame the practical problems encountered while recording a real theater play.
Publication Date: 2025-10-01
DOI: 10.5594/JMI.2025/BDAV7562
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2025/BDAV7562
Author(s): Joachim Keinert
Tobias Jaschke
Hendrik Hawer
Andree Josef
Frank Dittrich
Siegfried Fossel
Keyword(s): Stereo, Parallax, Actor, Live Act, Stage, Event Location, 3d-RECONSTRUCTION, Virtual Reality
Copyright: © 2025 SMPTE

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-BDAV7562.json

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Joachim Keinert, Tobias Jaschke, Hendrik Hawer, Andree Josef, Frank Dittrich, and Siegfried Fossel; Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming, MIJ 2025, Volume 134, Number 6 (pp. 59 to 68); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/BDAV7562

Snippet:

Joachim Keinert, Tobias Jaschke, Hendrik Hawer, Andree Josef, Frank Dittrich, and Siegfried Fossel; Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming, MIJ 2025, Volume 134, Number 6 (pp. 59 to 68); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/BDAV7562

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Joachim Keinert, Tobias Jaschke, Hendrik Hawer, Andree Josef, Frank Dittrich, and Siegfried Fossel; <cite>Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming</cite>, MIJ 2025, Volume 134, Number 6 (pp. 59 to 68); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/BDAV7562" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/BDAV7562</a></span>

SMPTE's HTML Pub

Preview:

Joachim Keinert, Tobias Jaschke, Hendrik Hawer, Andree Josef, Frank Dittrich, and Siegfried Fossel; Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming, MIJ 2025, Volume 134, Number 6 (pp. 59 to 68); SMPTE, 2025
doi: 10.5594/JMI.2025/BDAV7562
url: https://doi.org/10.5594/JMI.2025/BDAV7562

Snippet:

<li>
Joachim Keinert, Tobias Jaschke, Hendrik Hawer, Andree Josef, Frank Dittrich, and Siegfried Fossel; <cite id="bib-10-5594-jmi-2025-bdav7562">Bringing Stage Events with Real Actors to Your Home in VR: A Low-Complexity Solution for Immersive Media Streaming</cite>, MIJ 2025, Volume 134, Number 6 (pp. 59 to 68); SMPTE, 2025
<span class="doi">10.5594/JMI.2025/BDAV7562</span>
</li>