OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 129, No. 9, pp. 18–23
Abstract: A work-in-progress standard-powered media processing system is presented to demonstrate a full end-to-end interactive media service for an immersive user experience. The system converts traditional 360° videos to the Omnidirectional MediA Format (OMAF) standard-compliant format. Media processing, in general, demands complex and tailored workflows for advanced media processing and distribution such as virtual reality content stitching, packaging, and adaptive streaming. To achieve the desired result, these complex workflows require many advanced functionalities to work together on the media content. To address the needs of advanced services, the Motion Picture Experts Group (MPEG) working group is developing a new standard called Network-Based Media Processing (NBMP), a standard that aims at increased media processing efficiency, faster and lower deployment cost of interoperable media processing functions, and the ability to provide large-scale deployment by leveraging public, private, or hybrid cloud services. This paper partially covers both OMAF and NBMP standards. Additionally, an end-to-end design and proof of concept is provided to enable an immersive virtual reality experience to the end user.
Publication Date: 2020-10-01
DOI: 10.5594/JMI.2020.3010400
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2020.3010400
Author(s): Yu You
bio
Yu You is a Bell Labs distinguished member of technical staff and a principal software and system engineer at the Media Technologies Lab, Nokia Technologies, Tampere, Finland. He received a PhD degree in information science in 2004. Since then, he has worked as a senior researcher in various software and system domains from mobile run-times to cloud computing environments recently focusing on various service architectures for multimedia processing systems. Recently, he contributed to network-based media processing standards in ISO/IEC MPEG and Third-Generation Partnership Project (3GPP). He has published more than 20 scientific papers in international conferences and journals, and dozens of patents.
Ari Hourunranta
bio
Ari Hourunranta is a seasoned software (SW) engineer and architect with wide experience in multimedia and system development. Starting from as early as 1995, he pioneered mobile video technology and application development at the Nokia Research Center and Nokia Mobile Phones. He played a key role in VR/360° video streaming technology development on the Nokia OZO team and was in charge of MPEG OMAF standard implementation and cloud processing development of 360° video on the Nokia Media Technologies Research team. Since 2020, he has been working with HERE Technologies, Finland, where he continues digitizing the world, now with 360° and indoor map formats and tools.
Emre B. Aksu
bio
Emre B. Aksu is a research leader at Nokia Technologies, Tampere, Finland. He received a BSc degree in electrical and electronics engineering from Bilkent University, Ankara, Turkey, an MSc degree from Middle East Technical University, Ankara, and an eMBA degree from Bilkent University. His research team’s focus is on emerging media systems and standardization, cloud-based media processing technologies, and media-based applications of machine learning. As a standardization delegate of Nokia, he actively contributes to many MPEG standards. He holds several granted patents on media systems and is the (co)author of many publications in scientific journals and conferences.
Keyword(s): 360° Video, Network-Based Media Processing (NBMP), OMAF, Video Streaming
Copyright: © 2020 SMPTE

Bibliographic Reference(s)

ISO.23090-2 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23090-2, “Information Technology—Coded Representation of Immersive Media (MPEG-I)—Part 2: Omnidirectional Media Format (OMAF).” EXTERNAL
ISO.23090-8 — Network-based Media Processing (Draft International Standard), International Organization for Standardization/ International Electrotechnical Commission (ISO/IEC) JTC1/ SC 29/WG 11 Motion Picture Experts Group (MPEG), ISO/IEC 23090-8, 2019. [Online]. Available: https://www.iso.org/stan-dard/77839.html EXTERNAL
M. M. Hannuksela, Y.-K. Wang, and A. Hourunranta, “An Overview of the OMAF Standard for 360° Video,” Proc. Data Compression Conf., pp. 418–427, Mar. 2019, doi: 10.1109/ EXTERNAL
VR-IF Guidelines. [Online]. Available: https://www.vr-if.org/guidelines/ EXTERNAL
World Wide Stream, Nokia Bell Labs, 2019. [Online]. Available: https://www.worldwidestreams.io/ EXTERNAL
Multi-access Edge Computing (MEC), “Framework and Reference Architecture,” ETSI GS MEC 003, V2.1.1, Jan. 2019. Accessed: Aug. 2020. [Online]. Available: https://www.etsi.org/deliver/etsi_gs/MEC/001_099/003/02.01.01_60/gs_MEC003v020101p.pdf EXTERNAL
Docker Technologies, Docker Inc. Accessed: Aug. 2020. [Online]. Available: https://www.docker.com/ EXTERNAL
Airflow Workflow Engine, Apache, 2019. [Online]. Available: https://airflow.apache.org/ EXTERNAL
Mistral for OpenStack, OpenStack Foundation. Accessed: Aug. 2020. [Online]. Available: https://docs.openstack.org/mistral/latest/ EXTERNAL
Argo Container Workflow for Kubernetes, Argo project. Accessed: Aug. 2020. [Online]. Available: https://argoproj.github.io/argo/ EXTERNAL
Three.JS—JavaScript 3D Library. Accessed: Aug. 2020. [Online]. Available: https://threejs.org EXTERNAL
Nokia OMAF Player and Creator Source Code, Nokia Technologies GitHub, 2019. Accessed: Aug. 2020. [Online]. Available: https://github.com/nokiatech/omaf EXTERNAL
Business Process Model and Notation (BPMN) Version 2.0, Object Management Group (OMG), v2.0, 2011. [Online]. Available: http://www.bpmn.org/ EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2020.3010400.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Yu You, Ari Hourunranta, and Emre B. Aksu; OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3010400

Snippet:

Yu You, Ari Hourunranta, and Emre B. Aksu; OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3010400

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Yu You, Ari Hourunranta, and Emre B. Aksu; <cite>OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/JMI.2020.3010400" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2020.3010400</a></span>

SMPTE's HTML Pub

Preview:

Yu You, Ari Hourunranta, and Emre B. Aksu; OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020
doi: 10.5594/JMI.2020.3010400
url: https://doi.org/10.5594/JMI.2020.3010400

Snippet:

<li>
Yu You, Ari Hourunranta, and Emre B. Aksu; <cite id="bib-10-5594-jmi-2020-3010400">OMAF4Cloud: Standards-Enabled 360° Video Creation as a Service</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020
<span class="doi">10.5594/JMI.2020.3010400</span>
</li>