Presenting plausible virtual sounds to a user is an important challenge within audio augmented reality (AAR), where virtual sounds must appear as a real part of the audio environment. Reproducing an environment’s acoustics is one step towards this, however there is limited understanding of how the spatial resolution and spectral bandwidth of such reproductions contribute to plausibility, and therefore which approaches an AAR developer should target. We present two studies comparing room impulse responses (varying in spatial resolution and spectral bandwidth) and playback devices (headphones and audio glasses) to investigate their influence on the plausibility and user perception of virtual sounds. We do so using both a listening test in a controlled environment, and then an AAR game played in two real-world locations. Our results suggest that, particularly in a real-world AAR application context, users have low sensitivity for differences between reverberation models, but that the reproduction of an environment’s acoustics positively influences the plausibility and externalisation of a virtual sound. These benefits are most pronounced when played over headphones, but users were positive about the use of audio glasses for an AAR application, despite their lower perceptual fidelity. Overall, our findings suggest both lower fidelity environmental acoustics and audio glasses are appropriate for future AAR applications, allowing developers to use less computing resources and maintain real-world awareness without compromising user experience.
Authors:
Bhattacharyya, Jake; Picinali, Lorenzo; Vinciarelli, Alessandro; Brewster, Stephen
Affiliations:
University of Glasgow; Imperial College London; University of Glasgow; University of Glasgow(See document for exact affiliation information.)
AES Conference:
AES 2024 International Audio for Games Conference (April 2024)
Paper Number:
1
Publication Date:
April 27, 2024
Subject:
audio augmented reality
acoustic transparency
virtual sound plausibility
environmental acoustics
audio game
audio augmented reality game
audio glasses
Download Now (4.5 MB)
This paper is Open Access which means you can download it for free.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.