Conventional sonifications directly assign different aspects of data to auditory features and the results are not always “musical” as they do not adhere to a recognizable structure, genre, style, etc. Our system tackles this problem by learning orthogonal features in the latent space of a given musical corpus and using those features to create derivative compositions. We propose using a Singular Autoencoder (SAE) algorithm that identifies the most important Principal Components (PCs) in the latent space. As a proof-of-concept, we created sonifications of ionizing radiation measurements obtained from the Safecast project. Although the system successfully generates new compositions by manipulating the latent space, with each principal component changing different musical aspects, these changes may not be readily noticeable by listeners, despite the PCs being mathematically decorrelated. This finding suggests that higher-level features (such as associated emotion, etc.) may be needed for better results.
Authors:
Diaz, Kevin; Villegas, Julián
Affiliations:
Software Engineer; Senior Associate Professor(See document for exact affiliation information.)
AES Convention:
155 (October 2023)
Paper Number:
10675
Publication Date:
October 25, 2023
Subject:
Signal Processing
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this Signal Processing yet.
To be notified of new comments on this Signal Processing you can subscribe to this RSS feed. Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this Signal Processing then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.