Analysis of User Exploration Patterns during Scene Cuts in Omnidirectional Videos

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2018, No. 10, pp. 1–20
Abstract: Omnidirectional video can be comprised of several scenes joined together. A scene in a video can change within the same semantic content due to switching to a different camera position (e.g., in a multi-camera sport event), referred to as intra-scene transition; in other situations, a scene in a video can change between different semantic content, referred to as inter-scene transition (e.g., a scene cut from a movie). — In this paper an attempt is made to 1) find the user exploration behavior in terms of the exploration range, angular speed and acceleration metrics; 2) Investigate whether there is any exploration behavioral change in the watching patterns between intra- and inter-scene transitions. — We find that there is an increase in the exploratory behavior for all the above-mentioned metrics, and show that there is a delay (reaction time) between the scene transition and the start of the exploration. Finally, we also show that the exploratory behavior is higher in inter-scene transitions compared to intra-scene transitions.
Publication Date: 2018-10-22
DOI: 10.5594/M001845
ISBN: Print: 978-1-61482-960-7
Link: https://doi.org/10.5594/M001845
Author(s): Dmitrii MonakhovDepartment of Signal Processing, Tampere University of Technology, Tampere, Finland
Deepa NaikDepartment of Signal Processing, Tampere University of Technology, Tampere, Finland
Igor D.D. CurcioNokia Technologies, Tampere, Finland
Henri ToukomaaNokia Technologies, Tampere, Finland
Keyword(s): 360° Video, Exploration Range, Scene Transitions, Watching Patterns, Viewport Dependent Streaming
Copyright: © 2018 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

360-Degree Video Streaming and Its Subjective Quality [Active]
ISO.23009-1 — ISO/IEC 23009-1, “Information Technology—Dynamic Adaptive Streaming over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats,” 2016. EXTERNAL
Y. Rai, J. Gutiérrez, and P. Le Callet. "A Dataset of Head and Eye Movements for 360 Degree Images", Proceedings of the 8th ACM Multimedia Systems Conference (MMSys'17), pp. 205-210. DOI: https://doi.org/10.1145/3083187.3083218 EXTERNAL
A. Singla, S. Fremerey, A. Raake, P. List and B. Feiten, "AhG8: Measurement of User Exploration Behavior for Omnidirectional (360°) Videos with a Head Mounted Display", Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 118th Meeting: Macao, CN, 18–24 October 2017. EXTERNAL
J.W. Tukey, Exploratory Data Analysis, Addison-Wesley, 1977. EXTERNAL
S. Schwarz, A. Aminlou, I.D.D. Curcio, M.M. Hannuksela, S. Moreschini, F. Da Graca Gama, A. Gotchev, I. Huttu-Hiltunen, P. Vuorela, "Tampere pole vaulting sequence for virtual reality video coding", Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting, Chengdu, CN, 15 – 21 October 2016, Document JVET-D0143, http://phenix.it-sudparis.eu/jvet/doc_end_user/documents/4_Chengdu/wg11/JVET-D0143-v1.zip. EXTERNAL
X. Corbillon, A. Devlic, G. Simon, and J. Chakareski. "Optimal Set of 360-Degree Videos for Viewport-Adaptive Streaming", Proceedings of the 2017 ACM Multimedia Conference (MM '17). pp. 943-951. DOI: https://doi.org/10.1145/3123266.3123372 EXTERNAL
T. Löwe, M. Stengel, E. Förster, S. Grogorick and M. Magnor, "Visualization and Analysis of Head Movement and Gaze Data for Immersive Video in Head-mounted Displays", Proceedings of the Workshop on Eye Tracking and Visualization (ETVIS), 2015, Chicago, IL, U.S.A. EXTERNAL
I.D.D. Curcio, H. Toukomaa, and D. Naik, "Bandwidth Reduction of Omnidirectional Viewport-Dependent Video Streaming via Subjective Quality Assessment", Proceedings of the ACM 2nd International Workshop on Multimedia Alternate Realities (AltMM '17), pp. 9-14, 2017 DOI: https://doi.org/10.1145/3132361.3132364 EXTERNAL
I.D.D. Curcio, “Similarity Ring Metric (SRM) for Subjective Evaluation of 360-Degree Video”, ISO/IEC JTC1/SC29/WG11 MPEG #119 meeting, m41303, Torino, Italy, July 2017. EXTERNAL
C-L. Fan, J. Lee, W-C. Lo, C-Y. Huang, K-T. Chen, and C-H. Hsu. "Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality", Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'17), pp. 67-72. DOI: https://doi.org/10.1145/3083165.3083180 EXTERNAL
V. Sitzmann, A. Serrano, A. Pavel, M. Agrawala, D. Gutierrez, B. Masia, and G. Wetzstein, “Saliency in VR: How do people explore virtual environments?,” IEEE Transactions on Visualization and Computer Graphics, vol. PP, no. 99, doi: 10.1109/TVCG.2018.2793599 EXTERNAL
Y. Xu, Y. Dong, J. Wu, Z. Sun, Z. Shi, J. Yu, and S. Gao, "Gaze Prediction in Dynamic 360◦ Immersive Videos", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 18-22 June 2018, Salt Lake City, U.S.A. EXTERNAL
F. Qian, L. Ji, B. Han, and V. Gopalakrishnan. "Optimizing 360 video delivery over cellular networks", Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (ATC '16), pp. 1-6. DOI: https://doi.org/10.1145/2980055.2980056 EXTERNAL
W-C. Lo, C-L. Fan, J. Lee, C-Y. Huang, K-T. Chen, and C-H. Hsu. "360° Video Viewing Dataset in Head-Mounted Virtual Reality", Proceedings of the 8th ACM Multimedia Systems Conference (MMSys'17), pp. 211-216. DOI: https://doi.org/10.1145/3083187.3083219 EXTERNAL
T-REC-P.916 — International Telecommunication Union - Standardization (ITU-T), Recommendation P.916, “Information and Guidelines for Assessing and Minimizing Visual Discomfort and Visual Fatigue from 3-D Video,” Mar. 2016. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001845.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Dmitrii Monakhov, Deepa Naik, Igor D.D. Curcio, and Henri Toukomaa; Analysis of User Exploration Patterns during Scene Cuts in Omnidirectional Videos, SMPTE Meetings and Conferences ( October 2018); SMPTE, 2018, ISBN: 978-1-61482-960-7. Available at https://doi.org/10.5594/M001845

Snippet:

Dmitrii Monakhov, Deepa Naik, Igor D.D. Curcio, and Henri Toukomaa; Analysis of User Exploration Patterns during Scene Cuts in Omnidirectional Videos, SMPTE Meetings and Conferences ( October 2018); SMPTE, 2018, ISBN: 978-1-61482-960-7. Available at https://doi.org/10.5594/M001845

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Dmitrii Monakhov, Deepa Naik, Igor D.D. Curcio, and Henri Toukomaa; <cite>Analysis of User Exploration Patterns during Scene Cuts in Omnidirectional Videos</cite>, SMPTE Meetings and Conferences ( October 2018); SMPTE, 2018, ISBN: 978-1-61482-960-7. Available at <a href="https://doi.org/10.5594/M001845" target="_blank" rel="noopener">https://doi.org/10.5594/M001845</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Dmitrii Monakhov, Deepa Naik, Igor D.D. Curcio, and Henri Toukomaa; <cite id="bib-10-5594-m001845">Analysis of User Exploration Patterns during Scene Cuts in Omnidirectional Videos</cite>, SMPTE Meetings and Conferences ( October 2018); SMPTE, 2018, ISBN: 978-1-61482-960-7
<span class="doi">10.5594/M001845</span>
</li>