Testing 4K HDR-WCG Professional Video Content for Subjective Quality Using a Remote Testing Approach

Bibliographic Reference(s)

• Z. Sinno and A.C. Bovik, “Large-Scale Study of Perceptual Video Quality,” IEEE Transactions on Image Process„ 28 (2): pp. 612–627, Feb. 2019. EXTERNAL
• Hosu, Vlad, Hahn, Franz, Jenadeleh, Mohsen, Lin, Hanhe, Men, Hui and Szir “The Konstanz natural video database (KoNViD-1k),” in Proc. IEEE 2017 Ninth Internationa Conference on Quality of Multimedia Experience (QoMEX), pp. 1–6, 2017. EXTERNAL
• M. Narwaria, R. K. Mantiuk, M. Perreira Da Silva, P. Le Callet, “HDR-VDP-2.2: A Calibrated Method for Objective Quality Prediction of High Dynamic Range and Standard Images,” Journal of Electronic Imaging, 24(1), 2015. EXTERNAL
• Dolby Vision Profile Levels. [Online]. Available: https://professionalsupport.dolby.com/s/articie/What-is-Dolby-Vision-Profile?language=en_US. EXTERNAL
• N. Moroney, “Unconstrained Web-based Color Naming Experiment,” in Proc. SPIE–The International Society of Optical Engineering 5008, pp. 36–46, Jan. 2003. EXTERNAL
• N. Moroney and G. Beretta, “The worldwide gamma,” in IS&T Color Imaging Conference 2010. EXTERNAL
• J. Gille and J. Larimer, Using the Human Eye to Characterize Displays, Human Vision and Electronic Imaging VI, in Proc. SPIE–The International Society of Optical Engineering 4299, pp. 439–454, 2001. EXTERNAL
• L. Krasula, A. Choudhury, S. Daly, Z. Li, R. Atkins, L. Malfait, A. Mavlankar, “Subjective video quality for 4K HDR-WCG content using a browser-based approach for” at-home” testing,” Electronic Imaging, Vol. 35, pp. 263–1-8, 2023. EXTERNAL
• International Telecommunication-Telecomunication (ITU-T) Technical Report PSTR-CROWDS, “Subjective evaluation of media quality using a crowdsourcing approach,” May 2018. EXTERNAL
• John Tukey, “Comparing individual means in the Analysis of Variance,” Biometrics, 5(2): pp. 99–114, 1949. EXTERNAL
• T. Hoβfeld, R. Schatz and S. Egger, “SOS: The MOS is not enough!” 2011 Third International Workshop on Quality of Multimedia Experience, Mechelen, pp. 131–136, 2011. EXTERNAL
• Z. Li, C. G. Bampis, L. Krasula, L. Janowski, I. Katsavounidis, “A Simple Model for Subject Behavior in Subjective Experiments,” arXiv:2004.02067, doi: 10.48550/arXiv.2004.02067. EXTERNAL
• A. K. Venkataramanan, C. Wu, A. C. Bovik, I. Katsavounidis, and Z. Shahid, “A Hitchhiker's Guide to Structural Similarity,” IEEE Access, vol. 9, pp. 28872–28896, 2021, doi: 10.1109/ACCESS.2021.3056504. EXTERNAL
• H.R. Sheikh and A.C. Bovik, “Image information and visual quality,” IEEE Transactions on Image Process., 15 (2): pp. 430–444, Feb. 2006. EXTERNAL
• S. Li, F. Zhang, L. Ma, and K. N. Ngan, “Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments,” IEEE Transactions on Multimedia, 13 (5): pp. 935–949, Oct. 2011, doi: 10.1109/TMM.2011.2152382. EXTERNAL
• Z. Li, K. Swanson, C. G. Bampis, L. Krasula, A. Aaron, “Toward a Better Quality Metric for the Video Community,” Netflix Technology Blog. [Online]. Available: https://tinyurl.com/2p8fce64. EXTERNAL
• M. Narwaria, M. Perreira da Silva, P. Le Callet, “HDR-VQM: An Objective Quality Measure for High Dynamic Range Video,” Signal Processing: Image Communication, 35: pp. 44–60, 2015. EXTERNAL
• R. Mantiuk, K. J. Kim, A. G. Rempel, W. Heidrich, “HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions,” ACM Transactions on Graphics, 30(4), pp. 40:1–40:14, 2011, doi: 10.1145/2010324.1964935. EXTERNAL
• H. Schober and R. Hilz, “Contrast Sensitivity of the Human Eye for Square Wave Gratings,” J. Optical Society of America 55(9): pp. 1086–1091, 1965. EXTERNAL
• Z. Li, C. Bampis, J. Novak, A. Aaron, K. Swanson, A. Moorthy, J. De Cock, “VMAF: The Journey Continues,” Netflix Technology Blog. [Online]. Available: https://tinyurl.com/bdf6z3jz. EXTERNAL
• ITU-R BT.709.6 [Active]
• ITU-R BT.2100-2 [Active]
• T-REC-P.808 — International Telecommunication Union-Telecommunication (ITU-T) Recommendation P.808, “Subjective evaluation of speech quality with a crowdsourcing approach,” Jun. 2021. EXTERNAL
• T-REC-P.910 — ITU-T Recommendation P.910, “Subjective Video Quality Assessment Methods for Multimedia Applications,” International Telecommunication Union, Geneva, Switzerland, Apr. 2008. EXTERNAL