Apparatus and method for merging geometry - based spatial audio coding streams

Simple SummaryContent extracted from patent full text and abstract with AI.

This patent describes an apparatus and method for combining (merging) multiple geometry-based spatial audio coding streams into a single, unified audio data stream. The system is able to demultiplex complex multi-layer audio streams into simpler single-layer streams and then merge them intelligently based on audio parameters such as sound pressure, position, and diffuseness. This allows the creation of a customized or composite sound scene from different audio sources or environments, providing flexibility in sound scene manipulation and efficient audio data handling—for example, for immersive audio applications.

Use CasesContent extracted from patent full text and abstract with AI.

• Teleconferencing or videoconferencing systems where multiple participants in different environments need to be seamlessly integrated into a single virtual sound space.
• Merging sound scenes from different recording environments in media production (film, TV, VR).
• Interactive audio experiences in virtual reality (VR) or augmented reality (AR), where dynamic spatial audio scenes are composed on the fly.
• Live event broadcasting, where multiple stage or room audio sources are combined for an enhanced spatial audio experience for remote listeners.
• Game audio engines, enabling the combination of multiple in-game sound environments.
• Post-production audio mixing for creating immersive soundtracks by merging different audio recordings.

BenefitsContent extracted from patent full text and abstract with AI.

• Allows flexible and efficient merging of spatial audio streams from different sources or environments.
• Enables real-time manipulation of the spatial properties (position, orientation, diffuseness) of sound sources within merged scenes.
• Supports high-quality, immersive spatial audio experiences for end-users, regardless of loudspeaker setups or listening positions.
• Reduces network and computational load by merging streams before synthesis or transmission, optimizing bandwidth usage.
• Permits insertion of artificial (synthetic) sound sources for mixed reality or enhanced audio effects.
• Facilitates advanced audio scene editing, including selective enhancement, suppression, or movement of sound sources, thus supporting a wide range of applications from teleconferencing to entertainment.

Technical Classifications (CPCs)

Inventors & Applicants

Patent Abstract

An apparatus for generating a merged audio data stream is provided. The apparatus comprises a demultiplexer (180) for obtaining a plurality of single-layer audio data streams, wherein the demultiplexer (180) is adapted to receive one or more input audio data streams, wherein each input audio data stream comprises one or more layers, wherein the demultiplexer (180) is adapted to demultiplex each one of the input audio data streams having one or more layers into two or more demultiplexed audio data streams having exactly one layer, such that the two or more demultiplexed audio data streams together comprise the one or more layers of the input audio data stream. Furthermore, the apparatus comprises a merging module (190) for generating the merged audio data stream, having one or more layers, based on the plurality of single-layer audio data streams. Each layer of the input data audio streams, of the demultiplexed audio data streams, of the single-layer data streams and of the merged audio data stream comprises a pressure value of a pressure signal, a position value and a diffuseness value as audio data.