Reference-Free Measurement of Dialog Intelligibility in (Post-) Production, Content Analyses, and Live Broadcast Applications

Bibliographic Reference(s)

• ANSI.S3.5.1997 — American National Standard Institute (ANSI), S3.5-1997r2017, “Methods for Calculation of the Speech Intelligibility Index.” EXTERNAL
• IEC.60268-16 — International Electrotechnical Commission, Sound System Equipment-Part 16: Objective Rating of Speech Intelligibility by Speech Transmission Index. IEC 60268-16, 2011. EXTERNAL
• J. Starzynski, R. Orban, and R. Bleidt, eds., Improving Dialogue Intelligibility in Media. AES Technical Document AES TD1009.0.0.1, AES Technical Committee on Broadcast and Online Delivery, 2025. [Online]. Available: https://aes.org/community/technical-council/aestd1009/. EXTERNAL
• H. Fletcher and R. H. Galt, “The Perception of Speech and Its Relation to Telephony,” J. Acoust. Soc. Am., 22 (2): 89–151, 1950. EXTERNAL
• N. R. French and J. C. Steinberg, “Factors Governing the Intelligibility of Speech Sounds,” J. Acoust. Soc. Am., 19 (1): 90–119, 1947. EXTERNAL
• K. S. Rhebergen, N. J. Versfeld, and W. A. Dreschler, “Extended Speech Intelligibility Index for the Prediction of the Speech Reception Threshold in Fluctuating Noise,” J. Acoust. Soc. Am., 120 (6): 3988–3997, 2006. EXTERNAL
• M. Torcoli, M. M. Halimeh, T. Leitz, Y. Grewe, M. Kratschmer, B. Neugebauer, A. Murtaza, H. Fuchs, and E. A. P. Habets, “Speech Loudness in Broadcasting and Streaming,” Proc. Audio Engineering Society (AES) 156th Convention, Jun. 2024. EXTERNAL
• R. L. Goldsworthy and J. E. Greenberg, “Analysis of Speech-Based Speech Transmission Index Methods with Implications for Nonlinear Operations,” J. Acoust. Soc. Am., 116 (6): 3679–3689, 2004. EXTERNAL
• T. Biberger and S. D. Ewert, “Envelope- and Intensity-Based Prediction of Psychoacoustic Masking and Speech Intelligibility,” J. Acoust. Soc. Am., 140 (2): 1023–1038, 2016. EXTERNAL
• F. Dubbelboer and T. Houtgast, “The Concept of Signal-to-Noise Ratio in the Modulation Domain and Speech Intelligibility,” J. Acoust. Soc. Am., 124 (6): 3937–3946, 2008. EXTERNAL
• S. Jørgensen, S. D. Ewert, and T. Dau, “A Multi-Resolution Envelope-Power Based Model for Speech Intelligibility,” J. Acoust. Soc. Am., 134 (1): 436–446, 2013. EXTERNAL
• C. H. Taal, R. C. Hendriks, R. Heusdens, and J. Jensen, “A Short-Time Objective Intelligibility Measure for Time-Frequency Weighted Noisy Speech,” Proc. IEEE Int. Cont. Acoust.. Speech Signal Process. (ICASSP): 4214–4217, 2010. EXTERNAL
• M. R. Schädler, A. Warzybok, S. D. Ewert, and B. Kollmeier, “A Simulation Framework for Auditory Discrimination Experiments: Revealing the Importance of Across-Frequency Processing in Speech Perception,” J. Acoust. Soc. Am., 139 (5): 2708–2722, 2016. EXTERNAL
• M. R. Schädler, A. Warzybok, S. Hochmuth, and B. Kollmeier, “Matrix Sentence Intelligibility Prediction Using an Automatic Speech Recognition System,” Int.J. Audiol., 54 (Suppl. 2): 100–107, 2015. EXTERNAL
• B. Kollmeier, M. R. Schädler, A. Warzybok, B. T. Meyer, and T. Brand, “Sentence Recognition Prediction for Hearing-Impaired Listeners in Stationary and Fluctuation Noise With FADE: Empowering the Attenuation and Distortion Concept by Plomp with a Quantitative Processing Model,” Trends Hear., 20: 1–17, 2016. EXTERNAL
• R. Huber, M. Krüger, and B. T. Meyer, “Single-Ended Prediction of Listening Effort Using Deep Neural Networks,” Hear. Res., 359: 40–49, 2018. EXTERNAL
• R. Huber, A. Pusch, N. Moritz, J. Rennies, H. Schepker, and B. T. Meyer, “Objective Assessment of a Speech Enhancement Scheme with an Automatic Speech Recognition-Based System,” Proc. Speech Communication 13th ITG-Symp.: 1–5, Sep. 2018. EXTERNAL
• J. Rennies, M. Berdau, R. Huber, H. Baumgartner, S. Weihe, and T. Brand, “Real-Time Assessment of Listening Effort Using Non-Intrusive Binaural Prediction Models,” Proc. DAS/DAGA 2025: 18–21, Mar. 2025. EXTERNAL
• J. Barker, M. A. Akeroyd, W. Bailey, T. J. Cox, J. F. Culling, J. Firth, S. Graetzer, and G. Naylor, “The 2nd Clarity Prediction Challenge: A Machine Learning Challenge for Hearing Aid Intelligibility Prediction,” Proc. IEEE Int. Cont. Acoust., Speech Signal Process. (ICASSP): 11551–11555, 2024. EXTERNAL
• J. Barker, M. A. Akeroyd, T. J. Cox, J. F. Culling, J. Firth, S. Graetzer, H. Griffiths, L. Harris, G. Naylor, Z. Podwinska, E. Porter, and R. V. Munoz, “The 1st Clarity Prediction Challenge: A Machine Learning Challenge for Hearing Aid Intelligibility Prediction,” Proc. Interspeech 2022: 3508–3512, 2022. EXTERNAL
• A. F. McKinney and B. Cauchi, “Non-Intrusive Speech Intelligibility Prediction from Binaural Signals Processed for Hearing Aid Users,” Report of the 1st Clarity Prediction Challenge, 2022. [Online]. Available: https://claritychallenge.org/papers/cpcl/cpc1_e035_report.pdf. EXTERNAL
• A. H. Andersen, J. M. De Haan, Z.-H. Tan, and J. Jensen, “A Non-Intrusive Short-Time Objective Intelligibility Measure,” Proc. IEEE Int. Cont. Acoust., Speech Signal Process. (ICASSP): 5085–5089, 2017. EXTERNAL
• R. Huber, H. Baumgartner, T. Bruns, J. Thomas, J.-E. Appell, and J. Rennies “Tatort Sprachverständlichkeit - Wie schlimm ist es wirklich? Proc. DAGA 2027: 1269–1272, Mar. 2021. EXTERNAL
• D. Rieger, C. Simon, M. Torcoli, and H. Fuchs, “Dialogue Enhancement With MPEG-H Audio: An Update on Technology and Adoption,” Proc. Audio Engineering Society (AES) Convention 154: 1–8, May 2023. EXTERNAL
• N. Westhausen, R. Huber, H. Baumgartner, J. Rennies and B. T. Meyer, “Speech Enhancement of TV Broadcast Material by LSTM Deep Neural Networks,” IEEE/ACM Trans. Audio Speech Lang. Process., 29: 3541–3550, 2022. EXTERNAL
• J. Rennies, H. Baumgartner, A. Volgenandt, N. Wiedemann, and M. Kahsnitz, “Listening Effort of TV Mixes Depending on Characteristic Background Signals,” Proc. DAGA 2077: 752–755, Mar. 2017. EXTERNAL