Immersive and Interactive AR Graphics and Environments for Broadcast Applications
Metadata
- Publisher
- SMPTE
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Motion Imaging Jour.
- Volume
- 133, No. 4, pp. 50–57
- Abstract
- This paper presents a solution for visualization and interaction with broadcast AR (augmented reality) graphics with a multi-camera spectator camera solution. This solution was developed by Disney Star's Star Lab to provide a more immersive experience for audiences and presenters and aid in storytelling around sports data. It describes the inspiration for the project: the Hololens demos by Epic Games and Microsoft. It describes the technical specifications and workflow of the system. An evaluation details technical roadblocks encountered, steps taken to solve them, and possible improvements to the system. The paper concludes with a summary of the state of the industry, how our product is novel, plans for its next stages of development, as well as an outlook for the future of interactive AR graphics and virtual sets.
- Publication Date
- 2024-07-01
- DOI
10.5594/JMI.2024/IHPC9661- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2024/IHPC9661
- Author(s)
- Caroline Stedman MishraSaurabh RanjanSanjyot Dahale
- Keyword(s)
- Mixed Reality, Unreal Engine, Microsoft Hololens, Augmented Reality, Production
- Copyright
- © 2024 SMPTE
Bibliographic Reference(s)
- Avid Technology, Accessed 17 Jun. 2022. “Avid Maestro Virtual Set Setup Guide Version 2020.3.” Avid Technology, 2020. [Online]. Available: https://resources.avid.corn/SupportFiles/attach/Maestro_Virtual_Set/Maestro_Virtual_Set_Setup_Guide_v2020.3.pdf. EXTERNAL
- Business Wire, “Pixotope Acquires TrackMen Real-Time 3D Tracking Solutions,” 21 April. 2022. Accessed 17 Jun. 2022. [Online]. Available: https://www.businesswire.com/news/home/20220421005180/en/. EXTERNAL
- Epic Games, “Announcing a $1Billion Funding Round to Support Epic's Long-Term Vision for the Metaverse,” Unreal Engine, Epic Games, 13 Apr. 2021. Accessed 17 Jun. 2022. [Online]. Available: https://www.epicgames.com/site/en-US/news/announcing-a-1-billion-funding-round-to-support-epics-long-term-vision-for-themetaverse. EXTERNAL
- Epic Games, “Developing for Hololens,” Unreal Engine, Epic Games. Accessed 17 Jun. 2022. [Online]. Available: https://docs.unrealengine.com/5.0/en-US/develping-for-hololens-in-unreal-enoine/. EXTERNAL
- Epic Games, “The LEGO Group and Epic Team up to Build a Place for Kids to Play in the Metaverse,” Unreal Engine, Epic Games, 7 Apr. 2022. Accessed 17 Jun. 2022. [Online]. Available: https://www.epicgames.com/site/en-US/news/the-lego-groupand-epic-games-team-up-to-build-a-place-for-kids-to-play-in-the-metaverse. EXTERNAL
- Epic Games, “Microsoft Hololens Development,” Unreal Engine, Epic Games. Accessed 17 Jun. 2022. [Online]. Available: https://docs.unrealengine.com/4.27/en-US/SharingAndReleasing/XRDevelopment/AR/ARPlatforms/HoloLens/. EXTERNAL
- Izmir, TR, “Zero Density Releases AI-powered Talent Tracking Product,” Zero Density, 16 Nov. 2021. Accessed 17 Jun. 2022. [Online]. Available: https://www.zerodensity.tv/zero-density-releases-ai-powered-talent-tacking-product/. EXTERNAL
- Kerawala, Sean; Sherer, Tim; Summer, Wu; Ferrone, Harrison; Coulter, David; “Unreal Development Overview,” Microsoft, 3 November 2022. Accessed 17 Jun. 2022. [Online]. Available: https://docs.microsoft.com/en-us/windows/mixed-reality/develop/unreal/unreal-development-overview?tabs=ue426%2Cmrtk%2Casa-%2CD365. EXTERNAL
- Microsoft, “Mixed Reality UX Tools,” Microsoft. Accessed 17 Jun. 2022. [Online]. Available https://microsoft.github.io/MixedReality-UXTools-UnreaI/README.html. EXTERNAL
- Mo-Sys, “Mo-Sys VP Free,” Unreal Engine, Epic Games, 7 Jan. 2022. Accessed 17 Jun. 2022. [Online]. Available: https://www.unrealengine.com/marketplace/en-US/product/mo-sys-tracking. EXTERNAL
- Pixotape, “Body Pose What?” Pixotope, 29 Dec. 2021. Accessed 17 Jun. 2022. [Online]. Available: https://blog.pixotope.com/body-pose-what. EXTERNAL
- Pixotope, “Trackmen Acquisition FAQ,” Pixotope, 21 Apr. 2022. [Online]. Available: https://www.oixotooe.com/trackmen. EXTERNAL
- Sport Cricket, “The aim of Cricket,” Accessed 16 May 2024. [Online]. Available: http://news.bbc.co.uk/sport2/hi/cricket/rules_and_equipment/4183172.stm. EXTERNAL
- Sharon, Brian, “Apollo 11 Mission AR Project Sample Available Now on the Unreal Engine Marketplace–Unreal Engine,” Unreal Engine, Epic Games, 9 Dec. 2019. Accessed 25 May 2022. [Online]. Available: https://www.unrealengine.com/en-US/blog/apollo-11-mission-ar-project-sample-available-now-on-the-unreal-engine-marketplace. EXTERNAL
- Sullivan, Mark, “Epic Games CEO Tim Sweeney Talks the Metaverse, Crypto, and Antitrust.” Fast Company, 25 Apr. 2022. Accessed 17 Jun. 2022. [Online]. Available: https://www.fastcompany.com/90741893/epic-games-ceo-tim-sweeney-talks-themetaverse-crypto-and-antitrust. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-IHPC9661.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; Immersive and Interactive AR Graphics and Environments for Broadcast Applications, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/IHPC9661
Snippet:
Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; Immersive and Interactive AR Graphics and Environments for Broadcast Applications, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/IHPC9661
HTML (ISO 690 compliant)
Preview:
Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; Immersive and Interactive AR Graphics and Environments for Broadcast Applications, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/IHPC9661
Snippet:
<span class="citation">Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; <cite>Immersive and Interactive AR Graphics and Environments for Broadcast Applications</cite>, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/IHPC9661" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/IHPC9661</a></span>
SMPTE's HTML Pub
Preview:
Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; Immersive and Interactive AR Graphics and Environments for Broadcast Applications, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024
doi: 10.5594/JMI.2024/IHPC9661
url: https://doi.org/10.5594/JMI.2024/IHPC9661
doi: 10.5594/JMI.2024/IHPC9661
url: https://doi.org/10.5594/JMI.2024/IHPC9661
Snippet:
<li> Caroline Stedman Mishra, Saurabh Ranjan, and Sanjyot Dahale; <cite id="bib-10-5594-jmi-2024-ihpc9661">Immersive and Interactive AR Graphics and Environments for Broadcast Applications</cite>, MIJ 2024, Volume 133, Number 4 (pp. 50 to 57); SMPTE, 2024 <span class="doi">10.5594/JMI.2024/IHPC9661</span> </li>