Using a standard protocol and sample audio cases to enhance reproducibility, tests of coding quality are often performed jointly by laboratories around the world. Multiple Stimuli with Hidden Reference and Anchor (MUSHRA) is one such standard protocol. The same audio samples are used in all labs and as a result, listeners inevitably are judging quality in either their native language or one that they do not understand. It is not clear if a lack of understanding the language and its phonemes can influence the listener’s perception and his or her quality ratings during the test. This study used German and Mandarin Chinese speaking listeners, as well as test material in these two languages. The authors analyzed how ratings and listening times were affected by the foreign language. When results were pooled over all conditions, no significant differences between the ratings were found. However, for items of high audio quality, it was observed that listeners needed more time to evaluate samples that were not their native language, and it took more effort to compare different audio signals. As in MUSHRA tests – contrary to ITU-T P.800 tests - listeners can compensate for any difficulty they may have in perceiving artifacts by more effort and longer listening times, it seems to be no problem to include nonnative listeners in these tests at the expense of making them slightly less efficient.
Schinkel-Bielefeld, Nadja; Zhang, Jiandong; Qin, Yili; Leschanowsky, Anna Katharina; Fu, Shanshan
Affiliations: Fraunhofer Institute for Integrated Circuits IIS, Erlangen, Germany; Academy of Broadcasting Planning, SAPPRFT, Beijing, P.R. China; Pleasant Audio Consulting Ltd., Beijing, P.R. China(See document for exact affiliation information.)
JAES Volume 66 Issue 1/2 pp. 60-70; January 2018
Publication Date: February 14, 2018
No AES members have commented on this report yet.
If you are not yet an AES member and have something important to say about this report then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.