Advancing knowledge and understanding about performed music is hampered by a lack of annotation data for music expressivity. To enable large-scale collection of annotations and explorations of performed music, the authors have created a workflow that is enabled by CosmoNote, aWeb-based citizen science tool for annotating musical structures created by the performer and experienced by the listener during expressive piano performances. To enable annotation tasks with CosmoNote, annotators can listen to the recorded performances and view synchronized music visualization layers including the audio waveform, recorded notes, extracted audio features such as loudness and tempo, and score features such as harmonic tension. Annotators have the ability to zoom into specific parts of a performance and see visuals and listen to the audio from just that part. The annotation of performed musical structures is done by using boundaries of varying strengths, regions, comments, and note groups. By analyzing the annotations collected with CosmoNote, performance decisions will be able to be modeled and analyzed in order to aid in the understanding of expressive choices in musical performances and discover the vocabulary of performed musical structures.

Authors: Fyfe, Lawrence; Bedoya, Daniel; Chew, Elaine
Affiliations: STMS Laboratoire (UMR9912) – CNRS, IRCAM, Sorbonne Universit´e, Minist`ere de la Culture, Paris 75004, France; STMS Laboratoire (UMR9912) – CNRS, IRCAM, Sorbonne Universit´e, Minist`ere de la Culture, Paris 75004, France; Department of Engineering, King’s College London, London WC2R 2LS, United Kingdom(See document for exact affiliation information.)
JAES Volume 70 Issue 11 pp. 962-978; November 2022
Publication Date: November 15, 2022

Download Now (1.5 MB)

This paper is Open Access which means you can download it for free.

No AES members have commented on this paper yet.

Subscribe to this discussion

To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.