The need to perform subjective evaluations of audio is forever present. Such techniques are know to be inefficient and prone to unreliability. This can be partially overcome by using so-called expert as opposed to naive listeners. Expertise is addressed in some depth to clarify its meaning and to illustrate the benefits in terms of reliability and repeatability of listening tests. The generalized listener selection (GLS) procedure is presented for establishing permanent expert listening panels for a wide range of subjective tests. The method allows for the rapid selection and assessment of listeners based upon a number of criteria. Correct sampling of the population is achieved by an assessment of on-line questionnaires, followed by an audiometric evaluation. The last stage of the GLS procedure consists of three listening tests, identical in structure, designed to evaluate the discrimination skills and reliability of subjects. Means for the assessment of both intrarater reliability and interrater agreement are presented.
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can
subscribe to this RSS feed.
Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.
