The need to perform subjective evaluations of audio is forever present. Such techniques are know to be inefficient and prone to unreliability. This can be partially overcome by using so-called expert as opposed to naive listeners. Expertise is addressed in some depth to clarify its meaning and to illustrate the benefits in terms of reliability and repeatability of listening tests. The generalized listener selection (GLS) procedure is presented for establishing permanent expert listening panels for a wide range of subjective tests. The method allows for the rapid selection and assessment of listeners based upon a number of criteria. Correct sampling of the population is achieved by an assessment of on-line questionnaires, followed by an audiometric evaluation. The last stage of the GLS procedure consists of three listening tests, identical in structure, designed to evaluate the discrimination skills and reliability of subjects. Means for the assessment of both intrarater reliability and interrater agreement are presented.
Zacharov, Nick; Mattila, Ville-Veikko
Affiliation: Nokia Research Center,Tampere, Finland
AES Convention: 110 (May 2001) Paper Number: 5405
Publication Date: May 1, 2001
Subject: Psychoacoustics, Perception, and Listening Tests
No AES members have commented on this paper yet.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.