We present a toolbox for multi-stimulus perceptual evaluation of audio samples. Different from MUSHRA (typical for evaluating audio codecs), the audio samples under test are represented by sliders on a single axis, encouraging careful rating, relative to adjacent samples, where both the reference and anchor are optional. Intended as a more flexible, versatile test design environment, subjects can rate the same samples on different scales simultaneously, with separate comment boxes for each sample, an arbitrary rating scale, and various randomization options. Other tools include a pairwise evaluation tool and a loudness equalization stage. We discuss some notable experiences and considerations based on various studies where these tools were used. We have found this test design to be highly effective when perceptually evaluating qualities pertaining to music and audio production.
Authors:
De Man, Brecht; Reiss, Joshua D.
Affiliation:
Queen Mary University of London, London, UK
AES Convention:
136 (April 2014)
eBrief:151
Publication Date:
April 25, 2014
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.