Apparatus, Method or Computer Program for Synthesizing a Spatially Extended Sound Source Using Modification Data on a Potentially Modifying Object

Simple SummaryContent extracted from patent full text and abstract with AI.

This patent describes a system and method for rendering spatially extended sound sources (SESS) that can account for complex geometries and dynamically-changing environments, including the effects of occluding or modifying objects (like walls, bushes, or barriers) between the sound source and the listener. The system divides the space around the listener into spatial sectors and stores pre-calculated, frequency-dependent rendering data for each sector. When synthesizing the audio, the system detects which sectors are affected by occlusions or modifications, applies corresponding frequency-selective attenuation, and combines data from relevant sectors to generate an audio output providing a realistic and immersive spatial sound experience, accurately modeling real-world effects such as partial obstruction or varying distances.

Use CasesContent extracted from patent full text and abstract with AI.

• Headphone and loudspeaker-based 3D audio reproduction for virtual or augmented reality environments.
• Immersive audio experiences in gaming, movies, and simulation training where spatial realism and occlusion effects enhance immersion.
• Architectural and acoustic simulations to model how sound spreads and is blocked by various structures or objects.
• Hearing aid or audio accessibility devices that enhance spatial awareness for users in complex environments.
• Advanced teleconferencing or telepresence where spatial audio cues and environment-based modifications add realism.

BenefitsContent extracted from patent full text and abstract with AI.

• Significantly improves realism of spatial audio by allowing for real-time rendering of sound sources with arbitrary shape and size, including partial occlusion effects.
• Provides computational efficiency by using pre-calculated and sector-based look-up tables, reducing run-time processing needs.
• Flexibly adapts to dynamic situations, such as moving sources, listener, or occluding objects, making it suitable for interactive applications.
• Enables frequency-dependent modeling of occlusion and distance, closely mimicking how sound naturally changes in real environments.
• Modular design facilitates integration into existing audio processing pipelines and standards (e.g., MPEG-I).
• Supports both object-based and scene-based audio, making it widely applicable across content types and playback systems.

Technical Classifications (CPCs)

Inventors & Applicants

Patent Abstract

An apparatus for synthesizing a spatially extended sound source, comprises: an input interface (4020) for receiving a description of an audio scene, the description of the audio scene comprising spatially extended sound source data on the spatially extended sound source and modification data on a potentially modifying object (7010), and for receiving a listener data; a sector identification processor (4000) for identifying a limited modified spatial sector for the spatially extended sound source (7000) within a rendering range for the listener, the rendering range for the listener being larger than the limited modified spatial sector, based on the spatially extended sound source data and the listener data and the modification data; a target data calculator (5000) for calculating target rendering data from the one or more rendering data items belonging to the modified limited spatial sector; and an audio processor (300, 3000) for processing an audio signal representing the spatially extended sound source using the target rendering data.