A Simplified Approach to Immersive Audio to Enhance the Sense of “BeingThere” during COVID Lockdowns.

Ben Schwarz
6 min readJan 12, 2021
A piano quartet in an unusual setup, all in a semicircle including the piano, which is usually behind
See links just below to launch the videos

In a nutshell

The three stereo recordings below are of Mozart’s piano quartet K478 (1st movement). All video is identical. The first two have sound images that are dynamically adapted to the video image. The first one has a moderate adaptation and the second has more significant changes to the audio field so that you hear instruments in the same part of the audio field as the video. The third recording is a regular fixed stereo sound provided for reference. Please wear headphones or better still listen with real stereo speakers well positioned to the screen’s side. We suggest listening in the following order:

  • UPDATE (22/03/2021): 45-second demo with three stereo images is here.
  • Full-length video with moderately adaptative audio is here (extract here).
  • Full-length video with strongly adaptative audio is here (extract here)
  • Full-length video with regular fixed stereo audio is here (extract here)

To take this project further, one option could be to produce a live concert (not necessarily classical music) with a similar low-tech approach. Another would be to embrace more sophisticated technology such as NextGen Audio (NGA) like MPEG-H, Dolby…

--

--

Ben Schwarz

Innovation consulting, TV technology, Blockchain, VR, Writing, Public Relations, QoE, Music, Sustainability