Hybrid Images for Personalized Media Streaming Optimization

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 133, No. 4, pp. 23–34
Abstract: Efficient delivery of media while maintaining or improving the quality of experience (QoE) poses a constant challenge. On the media playback side, various factors, such as device characteristics, viewing conditions, and individual visual acuity, affect QoE. This paper proposes a novel method to estimate viewers' visible frequency ranges to optimize media delivery tailored to individual users and playback contexts. Our approach utilizes hybrid images created by combining high and low-frequency components of two different images. By measuring user perception in hybrid image tasks, we can estimate the minimum video resolution required to maintain quality, reducing unnecessary data transmission without sacrificing user experience. Our experimental results demonstrate a strong correlation between the proposed method and traditional approaches while offering the advantages of lower complexity of cognitive process and user effort. This technique paves the way for personalized and adaptive media delivery in various viewing conditions and on diverse devices.
Publication Date: 2024-07-01
DOI: 10.5594/JMI.2024/DPLO3149
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2024/DPLO3149
Author(s): Doh-Suk Kim
Scott Daly
Ludovic Malfait
Neel Chaudhari
Jeffrey Riedmiller
Keyword(s): QoE, Hybrid Image, Playback-Side Context, Image Resolution
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

ISO.23009-1.2019 — International Organization for Standardization/International Electrotechnical Commision (ISO/IEC) 23009-1:2019, “Information Technology—Dynamic Adaptive Streaming Over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats (4th Ed.),” 2019. [Online]. Available: https://www.iso.org/standard/79329.html EXTERNAL
R. Pantos and W. May, “HTTP Live Streaming, RFC 8216,” Internet Engineering Task Force (IETF), 2017. EXTERNAL
J. Xue and C. W. Chen, “A study on perception of mobile video with surrounding contextual influences,” in Proc. QoMEX, 2012, pp. 248–253, 2012. EXTERNAL
N. Ye, K. Wolski, and R. K. Mantiuk, “Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance,” in Proc. 2019IEEE/CVF Conf. on Comp. Vis. and Pattern Recognition (CVPR), pp. 5429–5437, Long Beach, CA, Jun. 2019. EXTERNAL
A. Oliva, A. Torralba, and P. G. Schyns, “Hybrid images,” in Proc. ACM SIGGRAPH 2006, pp. 527–532, 2006. EXTERNAL
S. Daly, T. Kunkel, G.-M. Su, and A. Choudhury, “Spatiochromatic and temporal natural image statistics modelling: Applications from display analysis to neural networks,” in Electronic Imaging Symposium on Electronic Imaging, 35 (15):188–1-188-7, Jan. 2023. EXTERNAL
S. M. Thurman, P. G. Davey, K. L. McCray, V. Paronian, and A. R. Seitz, “Predicting individual contrast sensitivity functions from acuity and letter contrast sensitivity measurements,” J. Vision, 16 (15): 1–15, 2016. EXTERNAL
H. Levitt, “Transformed up-down methods in psychoacoustics,” J. Acoust. Soc. Amer., Vol. 49, pp. 467–477, 1971. EXTERNAL
J. Gille, L. Arend, and J. O. Larimer, “Display characterization by eye: contrast ratio and discrimination throughout the grayscale,” B. E. Rogowitz and T. N. Pappas, in Proc. SPIE- The International Society for Optical Engineering 5292, p. 218, San Jose, CA, Jun. 2004. EXTERNAL
Yu Hu, Ming Ronnier Luo, Baiyue Zhao, and Mingkai Cao, “Developing a Visual Method to Characterize Displays,” in presented at the 27th IS&T Color Imaging Conference, Paris, France, Oct. 2019. EXTERNAL
R. Bala, R. V. Klassen, and K. M. Braun, “Efficient and Simple Methods for Display Tone-Response Characterization,” J. Society for Information Display, 15 (11):947, 2007. EXTERNAL
S. Daly and H. C. Lee, Visual characterization using a display model, United States Patent: 5,754,222, 1996. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-DPLO3149.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Doh-Suk Kim, Scott Daly, Ludovic Malfait, Neel Chaudhari, and Jeffrey Riedmiller; Hybrid Images for Personalized Media Streaming Optimization, MIJ 2024, Volume 133, Number 4 (pp. 23 to 34); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/DPLO3149

Snippet:

Doh-Suk Kim, Scott Daly, Ludovic Malfait, Neel Chaudhari, and Jeffrey Riedmiller; Hybrid Images for Personalized Media Streaming Optimization, MIJ 2024, Volume 133, Number 4 (pp. 23 to 34); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/DPLO3149

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Doh-Suk Kim, Scott Daly, Ludovic Malfait, Neel Chaudhari, and Jeffrey Riedmiller; <cite>Hybrid Images for Personalized Media Streaming Optimization</cite>, MIJ 2024, Volume 133, Number 4 (pp. 23 to 34); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/DPLO3149" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/DPLO3149</a></span>

SMPTE's HTML Pub

Preview:

Doh-Suk Kim, Scott Daly, Ludovic Malfait, Neel Chaudhari, and Jeffrey Riedmiller; Hybrid Images for Personalized Media Streaming Optimization, MIJ 2024, Volume 133, Number 4 (pp. 23 to 34); SMPTE, 2024
doi: 10.5594/JMI.2024/DPLO3149
url: https://doi.org/10.5594/JMI.2024/DPLO3149

Snippet:

<li>
Doh-Suk Kim, Scott Daly, Ludovic Malfait, Neel Chaudhari, and Jeffrey Riedmiller; <cite id="bib-10-5594-jmi-2024-dplo3149">Hybrid Images for Personalized Media Streaming Optimization</cite>, MIJ 2024, Volume 133, Number 4 (pp. 23 to 34); SMPTE, 2024
<span class="doi">10.5594/JMI.2024/DPLO3149</span>
</li>