This paper focuses on a novel methodology of subjective speech quality measurement and repeatability of its results between laboratory conditions and simulated environmental conditions. A single set of speech samples was distorted by various background noises and low bit-rate coding techniques. This study aimed to compare results of subjective speech quality tests with and without a parallel task deploying the ITU-T P.835 methodology. Afterward, tests results performed with and without a parallel task were compared using Pearson correlation, CI95, and numbers of opposite pair-wise comparisons. The tests show differences in results in the case of a parallel task.

Department of Measurement Faculty of Electrical Engineering Czech Technical University Prague Czech Republic

Zobrazit více v PubMed

ITU-T Rec. P.800. Telephony transmission quality, Methods for subjective determination of transmission quality International Telecommunication Union, Geneva: 1996

ITU-T Rec. P.863. Perceptual Objective Listening Quality Assessment. International Telecommunication Union, Geneva: 2011

ITU-T Rec. P.835. The subjective test methodology for evaluating speech communication systems that include noise suppression algorithm International Telecommunication Union, Geneva, 2003

Holub J, Avetisyan H, Isabelle S. Subjective speech quality measurement repeatability: comparison of laboratory test results. Int J Speech Technol [Internet]. 2017;20(1):69–74. Available from: http://link.springer.com/10.1007/s10772-016-9389-6 DOI

Goodman D, Nash R. Subjective quality of the same speech transmission conditions in seven different countries. In: ICASSP ‘82 IEEE International Conference on Acoustics, Speech, and Signal Processing [Internet]. Institute of Electrical and Electronics Engineers; p. 984–7. Available from: http://ieeexplore.ieee.org/document/1171565/

Arifianto D, Sulistomo TR. Subjective evaluation of voice quality over GSM network for quality of experience (QoE) measurement. In: 2015 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS) [Internet]. IEEE; 2015;p. 148–52. Available from: http://ieeexplore.ieee.org/document/7432755/

Cote N. Integral and Diagnostic Intrusive Prediction of Speech Quality. Springer; 2011, ISBN 978-3-642-18462-8

Bunton K, Keintz CK. The Use of a Dual-Task Paradigm for Assessing Speech Intelligibility in Clients with Parkinson Disease. J Med Speech Lang Pathol. 2008. September 1;16(3):141–155 PubMed PMC

Choi S, Lotto A, Lewis D, Hoover B, Stelmachowicz P. Attentional modulation of word recognition by children in a dual-task paradigm. J Speech Lang Hear Res. 2008. August;51(4):1042–54. doi: 10.1044/1092-4388(2008/076) PubMed DOI PMC

Helfer KS, Chevalier J, Freyman RL. Aging, spatial cues, and single- versus dual-task performance in competing speech perception. J Acoust Soc Am. 2010. December;128(6):3625–33. doi: 10.1121/1.3502462 PubMed DOI PMC

Kwak C, Han W. Comparison of single-task versus dual-task for listening effort. J Audiol Otol. 2017. October 17 doi: 10.7874/jao.2017.00136 PubMed DOI PMC

Wu YH, Stangl E, Zhang X, Perkins J, Eilers E. Psychometric functions of dual-task paradigms for measuring listening effort. Ear Hear. 2016. Nov-Dec;37(6):660–670 doi: 10.1097/AUD.0000000000000335 PubMed DOI PMC

Navon D, and Gopher D. On the economy of the human-processing system. Psychol. Rev. 86; 1979; 214–255.

Wickens CD 1991. Processing resources and attention In Multiple Task Performance (ed. Damos D.L.), pp. 3–34. Taler & Francis, Ltd., Bristol.

Beilock S Carr L, MacMahon T H, &Starkes, J L C. When paying attention becomes counterproductive: Impact of divided versus skill-focused attention on novice and experienced performance of sensorimotor skills. Journal of Experimental Psychology: Applied, 2002; 8, 6–16. PubMed

Schinkel-Bielefeld N, Zhang J; Qin Y; Leschanowsky A K; Fu S. Perception of Coding Artifacts by Non-native Speakers—A Study with Mandarin Chinese and German Speaking Listeners, February 2018; JAES Volume 66 Issue 1/2 pp. 60–70; January 2018, doi: 10.17743/jaes.2017.0042 DOI

ITU-T G.722.2, Wideband coding of speech at around 16 kbit/s using Adaptive Multi-Rate Wideband (AMR-WB), International Telecommunication Union, Geneva: 2013

ETSI TS 126 445, Universal Mobile Telecommunications System (UMTS); LTE; EVS Codec Detailed Algorithmic Description, European Telecommunication Standardization Institution, Sophia-Antipolis, 2014

ETSI EG 202 396–1, Speech Processing, Transmission and Quality Aspects (STQ); Speech quality performance in the presence of background noise; Part 1: Background noise simulation technique and background noise database, European Telecommunication Standardization Institution, Sophia-Antipolis, 2008

ETSI TS 103–106. European Telecommunications Standards Institute. Speech and multimedia Transmission Quality (STQ); Speech quality performance in the presence of background noise: Background noise transmission for mobile terminals-objective test methods. European Telecommunication Standardization Institution, Sophia-Antipolis, 2014

ETSI EG 202-396-3, Speech Processing, Transmission and Quality Aspects (STQ); Speech Quality performance in the presence of background noise Part 3: Background noise transmission—Objective test methods. European Telecommunication Standardization Institution, Sophia-Antipolis, 2008

ITU-T TD12rev1. Statistical evaluation. Procedure for P.OLQA v.1.0. Berger J, editor. International Telecommunication Union, Geneva: 2009.