Apparatus, Method and Computer Program for Encoding, Decoding, Scene Processing and Other Procedures Related to Dirac Based Spatial Audio Coding

Simple SummaryContent extracted from patent full text and abstract with AI.

This invention provides a universal, flexible apparatus and software framework for spatial audio coding based on DirAC (Directional Audio Coding). It can accept, convert, and combine different spatial audio formats—such as multi-channel, Ambisonics (first and higher order), spatial audio objects, and DirAC itself—into a unified representation and efficiently encode or process them. The framework allows different input audio scene descriptions to be merged, manipulated, transmitted, and rendered as immersive 3D audio—either for loudspeakers or headphones, and enables interactive control over individual audio objects within the scene.

Use CasesContent extracted from patent full text and abstract with AI.

• Immersive virtual reality and augmented reality experiences requiring accurate and interactive 3D audio rendering.
• Next-generation teleconferencing or remote collaboration with spatialized voices and sound sources.
• Movie, video, and music production or broadcasting, including streaming services, capable of flexible spatial audio delivery to varying end-user devices.
• Gaming platforms offering dynamic and interactive soundscapes with independent object manipulation (e.g., highlighting specific in-game sounds).
• Live event streaming or sports with immersive, real-time spatial audio reproduction over various output setups.
• Mobile applications for spatial audio communication, compatible with limited data rates and various reproduction setups.
• Hearing aid or assistive listening devices where specific sound sources can be enhanced or repositioned interactively.

BenefitsContent extracted from patent full text and abstract with AI.

• Supports virtually all spatial audio formats (Ambisonics, multi-channel, object-based, etc.) in a single, unified framework.
• Highly efficient parametric encoding, enabling low-bitrate transmission without sacrificing spatial quality.
• Allows interactive manipulation of individual audio objects (e.g., adjusting volume or position) even after decoding, enhancing user experience.
• Output agnostic—can render audio for arbitrary loudspeaker configurations or headphones, adapting to the user's setup.
• Improves compatibility across legacy systems and modern spatial audio solutions by converting and combining diverse formats.
• Enables flexible scene composition and editing for content creators, broadcasters, and end-users alike.
• Scalable from simple stereo to complex multi-object and high-order 3D audio scenarios, suitable for diverse use-cases—consumer, professional, and communications.
• Reduces computational and transmission costs using DirAC's compact parametric representation structure.

Technical Classifications (CPCs)

Inventors & Applicants

Patent Abstract

An apparatus for generating a description of a combined audio scene, comprises: an input interface (100) for receiving a first description of a first scene in a first format and a second description of a second scene in a second format, wherein the second format is different from the first format; a format converter (120) for converting the first description into a common format and for converting the second description into the common format, when the second format is different from the common format; and a format combiner (140) for combining the first description in the common format and the second description in the common format to obtain the combined audio scene.