We propose a solution to enable speech-driven alien language synthesis in an in-game voice-chat system. Our technique selectively replaces the users input speech with a corresponding alien language output synthesized on-the-fly. It is optimized for a client-server architecture and uses a concatenative synthesis framework. To limit memory requirements, as well as preserve forwarding capabilities on the server, the concatenative synthesis is performed in the coded domain. For gaming applications, our approach can be used to selectively scramble the speech of opposing team members in order to provide compelling in-game voice feedback without exposing their strategy. The system has been implemented with multiple alien races in a virtual environment with effective, entertaining results.

Authors: Tsingos, Nicolas; Robinson, Charles
Affiliation: Dolby Laboratories, San Francisco, CA, USA
AES Conference: 41st International Conference: Audio for Games (February 2011)
Paper Number: 2-3
Publication Date: February 2, 2011
Subject: Music, Synthesis, and Speech Processing

Click to purchase paper as a non-member or you can login as an AES member to see more options.

No AES members have commented on this paper yet.

Subscribe to this discussion

To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.