When constructing virtual realities, the task of the sound designer is usually to create a suitable immersive sound scene to fit the situation in the virtual world. This paper presented a real-time method (spatially modified synthesis, i.e., SpaMoS) for modifying the reproduction of a spatial sound recording based on the listener movement in the virtual reality to provide the perception of believable movement inside the recorded sound scene. The method decomposes the omnidirectional signal of a B-format recording into granular virtual omnidirectional sources and then places them on an arbitrary surface defining a convex hull. The placement is based on an energetic analysis performed on the B-format signal. This synthesis is complemented with a separate diffuse synthesis that ideally reproduces the ambience and reverberation from the original signal. Listening experiments show that the method is plausible and the quality of the method is very good when the listener is inside the specific cylinder-shaped surface.
Click to purchase paper as a non-member or you can login as an AES member to see more options.
No AES members have commented on this paper yet.
To be notified of new comments on this paper you can
subscribe to this RSS feed.
Forum users should login to see additional options.
If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.
