The EyesWeb system (www.eyesweb.org) is an open platform for real-time multimodal processing. It has now reached a mature stage, and is being used both for research in multimodal interfaces and for for applications such as naturally interacting systems for museum exhibits, performing arts, therapy and rehabilitation. This paper presents the latest development concerning audio processing in EyesWeb with a special focus on multimodal processing. The integrated audio processing support includes modules for the analysis and synthesis of audio streams, for musical processing through the MIDI protocol, and for interoperability with other audio processing platforms, technologies and standards. Advanced real-time audio support for the mapping of multimodal input into multimedia output is described in the full paper.

Authors: Camurri, Antonio; Coletta, Paolo; Drioli, Carlo; Massari, Alberto; Volpe, Gualtiero
Affiliations: ISTC-CNR, Padova; University of Genova(See document for exact affiliation information.)
AES Convention: 118 (May 2005) Paper Number: 6390
Publication Date: May 1, 2005
Subject: Miscellaneous Audio Topics

Click to purchase paper as a non-member or you can login as an AES member to see more options.

No AES members have commented on this paper yet.

Subscribe to this discussion

To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.