Automated sound-to-color transformation system makes it possible to display the corresponding color map that matches the actual note played on the guitar at the same instant. One application of this is to provide intelligent color effect ‘light show’ for live instruments on stage during performance. By using time and frequency information of the input signal, a computer can analyze sound events and determine which tone is currently being played. The knowledge about guitar tone sound event being played on the audio input provides a basis for the implementation of a digital sound-to-light converter. The converter streams live audio input, analyzes frames based on the signal’s power threshold, determines fundamental frequency of the current tone, maps this information to color, and displays the targeted light color in real-time. The final implementation includes full screen presentation mode with real time display of both pitch and intensity of the sound.
Author:
Osmanovic, Nermin
Affiliation:
Microsoft Corporation, Redmond, WA, USA
AES Convention:
127 (October 2009)
Paper Number:
7859
Publication Date:
October 1, 2009
Subject:
Production and Analysis of Musical Sounds
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.