How does sound impact learners’ emotions? This is an important question because emotion plays an important role in learning. Research shows that confusion, frustration, boredom, engagement and interest are emotions experienced during complex learning [11][15]. Work in this area found that visual and audio materials can elicit emotions that influence the attention of learners [36]. In the current work, we focus on learner’s affect and sound design for virtual reality learning environments and present the design of the Multilayered Affect-Audio Research System, MAARS. We describe the sound design workflow, affective sound design heuristics, the audio presentation system and each of the operational components. The goal is to have a system that enables the rapid creation of auditory experimental conditions in VR in order to accelerate the research in this area and to help answer the question of how sound and its designs impact learners’ affective states and cognitive performance in virtual reality learning environments.
Authors:
Olsen, Alvaro F; Roginska, Agnieszka; Plass, Jan L.
Affiliation:
New York University, NY, USA
AES Conference:
2022 AES International Conference on Audio for Virtual and Augmented Reality (August 2022)
Paper Number:
19
Publication Date:
August 15, 2022
Subject:
Paper
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.