This paper documents the design and play-testing of a videogame that incorporates electroencephalography (EEG) technology to augment traditional controls. A survival horror game was created using Unity3D. The player navigates the game using conventional keyboard and mouse movement, however, they also wear an Emotiv EPOC headset that transmits their level of calm to the game via OSC. In order to complete the game, the player must remain as calm as possible. An adaptive audio engine was developed to act as an auditory display for this complex parameter in lieu of a distracting visual indicator. Every element of the audio was designed to adapt to the constantly fluctuating value. Procedural audio modules were created in Max, where player EEG data was simultaneously mapped to a myriad of modulators. FMOD Studio was used for non-procedural elements due to its facilitation of real-time control parameters, as well as its integration with Unity3D.

Author: Craig, Jordan
Affiliation: New York University, New York, NY, USA
AES Convention: 142 (May 2017) Paper Number: 9802
Publication Date: May 11, 2017
Subject: Miscellaneous 2

Download Now (858 KB)

This paper is Open Access which means you can download it for free.

No AES members have commented on this paper yet.

Subscribe to this discussion

To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.