- My project is on binaural audio. Binaural audio is three dimensional sound, where the listener typically has headphones on that can replicate where audio is heard, above, below, behind, etc (see: https://www.youtube.com/watch?v=IUDTlvagjJA as a good example). The concept has been around a while and has been explored quite a bit. Though it has never caught on in any industry for a few reasons. There are also a few interesting algorithms to study in relation to rendering binaural audio without the use of expensive equipment. It is important because binaural audio could elevate media experience if executed properly or if it can be done inexpensively.
- There are a few products out there that record binaural audio. The KU-100 Neumann is shaped like a head, so that the recording pieces in each ear receive the correct amount of delays, sound shadows, and sound bounces that a normal human head would receive when listening. VR technologies are experimenting with binaural audio, with hopes of having a 3D audio world (that is responsive) to accompany the visuals. SoundScape Renderer is software specializing in spacial audio recording http://spatialaudio.net/ssr/ that could be done without the use of an expensive recording machine. This is the first post on my new blog. I’m just getting this new blog going, so stay tuned for more. Subscribe below to get notified when I post new updates.
Project Demo
Project Update
After some consideration the report coverage has been changed. When covering strictly binaural audio there is not much documented about algorithms, more is written about how it is recorded, the equipment used, and why its failed. These are fine on their own for a report but not for this class, maybe that can be saved for a class on Music Retrieval Techniques. So, the report has been expanded from binaural audio to dynamic binaural audio which could have a large stake in the future VR, which there is much more written about. Dynamic binaural audio is the same as regular binaural audio only the audio stays relative to your head position. Picture the Barbershop YouTube video example from the proposal, with dynamic binaural audio, if you were to move your head the audio would move with it. If for example you are wearing a VR setup that places you court-side to a basketball game, dynamic binaural audio would allow you to hear the basketball bounce as you follow it with your eyes.
Here is an excellent article on dynamic binaural audio in VR:
https://spectrum.ieee.org/consumer-electronics/audiovideo/vr-for-your-ears-dynamic-3d-audio-is-coming-soon
The resulting coverage change meant a project name was due for a change, “Binaural Audio and Associated Algorithms” became “Dynamic Binaural Audio and VR”.
Report Outline has not been finished and the demo has not been started.
Dynamic Binaural Audio and VR 