SADIE: Spatial Audio for Domestic Interactive Entertainment
Interactive media systems such as games consoles have become commonplace in UK domestic environments offering increased connectivity and media integration. Whilst many systems support 3-D visuals and Ultra-High Definition video, most do not address the importance of 3-D sound for immersive experiences. New formats developed for cinema incorporate height channels, which could naturally complement the virtual reality experience for gaming. However, sound immersion is difficult to achieve in the home as it is impractical to have dozens of transducers placed around the living room. SADIE pioneers new approaches for rendering interactive spatial sound in the home that includes sound source rendering with height.
For gaming, there is also the complex issue of listener position. For example, in games based on kinetic motion tracking the listener moves in reaction to the game play and the formation of a stable soundfields becomes difficult as they are no longer located at the acoustic sweet-spot. Real-time soundfield compensation through tracking of the listener can be used to counteract this, but the listener movement also makes digital equalisation of the room acoustics a considerable challenge. The result is a flawed virtual environment in which visual and auditory cues are not spatially coincident.
SADIE addresses the improvement of spatial audio quality for immersive interactive media experiences in the home. It undertakes novel science to improve soundfield immersion and the formation of 3-D sound sources beyond the horizontal plane, lifting the constraints of loudspeaker placement and dynamic source-listener movements whilst conserving good sound reproduction quality.
The research pioneers new methods for soundfield rendering formed through characterisation of the cues required for perception of sources with height in dynamic listening. The work is poised to have significant transformative impact on sound reproduction in homes in the UK, whilst also addressing wider questions on auditory perception and acoustic signal processing that serve other research disciplines outside of interactive media.
If you have any queries about the project or our research please don't hesitate to contact us or follow us on Twitter @SADIEProjectUK
The SADIE project is conducted at the Audiolab at the Department of Electronics, University of York, as a sister project in the DC Labs. The research is funded by the Engineering and Physical Sciences Research Council (EP/M001210/1)