SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018)
[ACTIVE]
360-Degree Video Streaming and Its Subjective Quality
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 127, No. 7, pp. 28–38
- Abstract
- Traditional challenges for end-to-end streaming services are harder when considering 360° video content. One of these challenges relates to the lack of standardized methodologies for subjective 360° video quality assessment, especially for streaming services. This paper presents a methodology for 360° video streaming services, which inherits a lot from the existing International Telecommunications Union standards for subjective quality evaluation of 2D/3D video but also incorporates omnidirectionality. A new metric called similarity ring metric (SRM) is introduced. It measures the degree of similarity in watching patterns of a single subject or between different subjects for several subjective assessment tests. This metric enables a rejection criteria for test results. This paper also presents visual fatigue results for a subjective quality experiment.
- Publication Date
- 2018-08-01
- DOI
10.5594/JMI.2018.2838818- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2018.2838818
- Author(s)
- Igor D. D. CurcioHenri ToukomaaDeepa Naik
- Keyword(s)
- 360° Video, Subjective Quality Assessment, Test Methodology, Virtual Reality Streaming
- Copyright
- © 2018 SMPTE
Bibliographic Reference(s)
- ISO.23009-1 — ISO/IEC 23009-1, “Information Technology—Dynamic Adaptive Streaming over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats,” 2016. EXTERNAL
- C. Ozcinzar, A. D. Abreu, and A. Smolic, “Viewport-Aware Adaptive 360° Video Streaming Using Tiles for Virtual Reality,” Proc. IEEE Int. Conf. Imag. Process., Beijing, China, Sept. 17–20, 2017. EXTERNAL
- D. S. Hands, “Temporal Characteristics of Forgiveness Effect,” Electr. Let., 37:752–754, 2001. EXTERNAL
- M. Yu, H. Lakshman, and B. Girod, “A Framework to Evaluate Omnidirectional Video Coding Schemes,” Proc. IEEE Int. Symp. Mixed Augmented Reality, Fukuoka, Japan, Sept. 29–Oct. 3, 2015. EXTERNAL
- I. D. D. Curcio, H. Toukomaa, and D. Naik, “Bandwidth Reduction of Omnidirectional Viewport-Dependent Video Streaming via Subjective Quality Assessment,” Proc. ACM Int. Workshop Multimed. Alt. Real. ACM Multimed. 2017 Conf., Mountain View, CA, Oct. 27, 2017. EXTERNAL
- International Telecommunication Union - Standardization (ITU-T), “Test Plan for Evaluation of Video Quality Models for Use With Stereoscopic Three-Dimensional Television Content,” VQEG, 2012. EXTERNAL
- A. Zare et al., “HEVC-Compliant Tile-Based Streaming of Panoramic Video for Virtual Reality Applications,” Proc. 2016 ACM MM‘16, pp. 601–605, Amsterdam,The Netherlands, Oct. 15–19, 2016. EXTERNAL
- R. Schatz et al., “Toward Subjective Quality of Experience Assessment for Omnidirectional Video Streaming,” IEEE 9th Int. Conf. QoMEX, Erfurt, Germany, May 31, 2017. EXTERNAL
- E. Upenik, M. Rerabek, and T. Ebrahimi, “A Testbed for Subjective Evaluation of Omnidirectonal Visual Content,” Proc. 32nd Pic. Cod. Symp., Nuremberg, Germany, Dec. 4–7, 2016. EXTERNAL
- International Telecommunication Union - Standardization (ITU-T), “Test Plan for Subjective Assessment for VR Video Quality,” VQEG, IMG116, Oct. 11, 2016. EXTERNAL
- S. Shi, K. Nahrstedt, and R. Campbell. “Distortion over Latency: Novel Metric for Measuring Interactive Performance in Remote Rendering Systems,” ICME, Barcelona, Spain, Jul. 11–15, 2001. EXTERNAL
- I. D. D. Curcio, “Similarity Ring Metric (SRM) for Subjective Evaluation of 360° Video,” ISO/IEC JTC1/SC29/WG11 MPEG #119, m41303, Turin, Italy, Jul. 2017. EXTERNAL
- E. Uenik, M. Rerabek, and T. Ebrahimi, “On the Performance of Objective Metrics for Omnidirectional Visual Content,” Proc. Ninth Int. Conf. Qual. Multimed. Exp., Erfurt, Germany, May 31–Jun. 2, 2017. EXTERNAL
- S. Ishihara, The Series of Plates Designed as a Test for Color Deficiency, Concise Edition, Kanehara Trading: Tokyo, Japan, 1997. EXTERNAL
- C.-L. Fan et al., “Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality,” ACM 27th Workshop NOSSDAV’17, pp. 67–72, Taipei, Taiwan, Jun. 20–23, 2017. 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Bear Kids SRM values for each clip, ordered by genre Pole CLIP 1 CLIP 2 CLIP 3 CLIP 4 CLIP 5 CLIP 6 CLIP 7 CLIP 8 CLIP 9 CLIP 10 CLIP 11 CLIP 12 CLIP 13 CLIP 14 CLIP 15 CLIP 16 CLIP 17 CLIP 18 CLIP 19 CLIP 20 CLIP 21 CLIP 22 CLIP 23 CLIP 24 CLIP 25 CLIP 26 CLIP 27 CLIP 28 CLIP 29 CLIP 30 CLIP 31 CLIP 32 CLIP 33 CLIP 34 CLIP 35 CLIP 36 CLIP 37 CLIP 38 CLIP 39 CLIP 40 CLIP 41 CLIP 42 CLIP 43 CLIP 44 CLIP 45 CLIP 46 CLIP 47 CLIP 48 EXTERNAL
- TNO, Test for Stereoscopic Vision, Lameris Ootech: Nieuwegein, The Netherlands, 1972. EXTERNAL
- C. Ozcinzar, A. D. Abreu, and A. Smolic, “Look Around You: Saliency Maps for Omnidirectional Images in VR Applications View Document,” Proc. Ninth Int. Conf. Qual. Multimed. Exp., Erfurt, Germany, May 31–Jun. 2, 2017. EXTERNAL
- R-REC-BT.500-13 — Recommendation ITU-R BT.500-13, “Methodology for the Subjective Assessment of the Quality of Television Pictures,” International Telecommunication Union, Radiocommunication Sector, Geneva, 2012. EXTERNAL
- R-REC-BT.2021-1 — International Telecommunication Union - Radiocommunication (ITU-R), Recommendation BT.2021-1, “Subjective Methods for the Assessment of Stereoscopic 3DTV Systems,” Feb. 2015. EXTERNAL
- T-REC-P.800.2 — International Telecommunication Union - Standardization (ITU-T), Recommendation P.800.2, “Mean Opinion Score Interpretation and Reporting,” Jun. 2016. EXTERNAL
- T-REC-P.910 — ITU-T Recommendation P.910, “Subjective Video Quality Assessment Methods for Multimedia Applications,” International Telecommunication Union, Geneva, Switzerland, Apr. 2008. EXTERNAL
- T-REC-P.913 — International Telecommunication Union - Standardization (ITU-T), Recommendation P.913, “Methods for the Subjective Assessment of Video Quality, Audio Quality and Audiovisual Quality of Internet Video and Distribution Quality Television in Any Environment,” Mar. 2016. EXTERNAL
- T-REC-P.915 — International Telecommunication Union - Standardization (ITU-T), Recommendation P.915, “Subjective Assessment Methods for 3-D Video,” Mar. 2016. EXTERNAL
- T-REC-P.916 — International Telecommunication Union - Standardization (ITU-T), Recommendation P.916, “Information and Guidelines for Assessing and Minimizing Visual Discomfort and Visual Fatigue from 3-D Video,” Mar. 2016. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2018.2838818.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; 360-Degree Video Streaming and Its Subjective Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2838818
Snippet:
Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; 360-Degree Video Streaming and Its Subjective Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2838818
HTML (ISO 690 compliant)
Preview:
Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; 360-Degree Video Streaming and Its Subjective Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2838818
Snippet:
<span class="citation">Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; <cite>360-Degree Video Streaming and Its Subjective Quality</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at <a href="https://doi.org/10.5594/JMI.2018.2838818" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2018.2838818</a></span>
SMPTE's HTML Pub
Preview:
Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; 360-Degree Video Streaming and Its Subjective Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018
doi: 10.5594/JMI.2018.2838818
url: https://doi.org/10.5594/JMI.2018.2838818
doi: 10.5594/JMI.2018.2838818
url: https://doi.org/10.5594/JMI.2018.2838818
Snippet:
<li> Igor D. D. Curcio, Henri Toukomaa, and Deepa Naik; <cite id="bib-10-5594-jmi-2018-2838818">360-Degree Video Streaming and Its Subjective Quality</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018 <span class="doi">10.5594/JMI.2018.2838818</span> </li>