HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH). It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP). We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis. Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.

Authors: Ivanyi, Balazs; Tsalidis, Christian; Naylor, Scott; Tjemsland, Truls; Adjorlu, Ali; Kepp, Nille Elise; Serafin, Stefania
Affiliations: Aalborg University, Copenhagen, Denmark; Copenhagen Hearing and Balance Centre, Rigshospitalet & University of Copenhagen, Copenhagen, Denmark(See document for exact affiliation information.)
AES Conference: 2022 AES International Conference on Audio for Virtual and Augmented Reality (August 2022)
Paper Number: 1
Publication Date: August 15, 2022
Subject: Paper

Click to purchase paper as a non-member or you can login as an AES member to see more options.

No AES members have commented on this paper yet.

Subscribe to this discussion

To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.