Apparatus and Method for Rendering Audio Objects

Simple SummaryContent extracted from patent full text and abstract with AI.

This invention provides an apparatus and method for rendering 3D audio objects more efficiently and flexibly. It achieves three-dimensional spatial audio by using a two-stage panning process: first, audio is panned horizontally within a layer of speakers, and then vertically between layers (or between a real and a virtual speaker above or below). This approach allows accurate placement of virtual audio sources (as if coming from above, below, or between layers) even when the physical speaker setup does not include elevated or floor speakers. The technique relies on amplitude panning gains and optional spectral shaping, making it computationally efficient and adaptable to various speaker arrangements and listener positions.

Use CasesContent extracted from patent full text and abstract with AI.

• Home theater systems to provide convincing 3D or immersive sound without needing ceiling or floor speakers.
• Virtual reality and gaming audio systems to enhance realism by accurately positioning sounds in all directions, including above and below the listener.
• Automotive sound systems to deliver immersive, enveloping sound experiences regardless of the speaker configuration inside the car.
• Professional audio installations (e.g., cinemas, auditoriums, studios) that want to simulate height effects with fewer speakers.
• Consumer electronics like soundbars, TVs, and smart speakers that need to simulate surround and vertical sound in compact setups.
• Headphone-based 3D audio rendering for VR/AR or music applications.

BenefitsContent extracted from patent full text and abstract with AI.

• Enables 3D/immersive audio rendering even with standard or limited speaker configurations (no need for actual height speakers).
• Highly flexible: adapts to any speaker layout and can adjust to moving or tracked listeners and even changing speaker positions.
• Computationally efficient: uses amplitude panning (no phase processing), resulting in low processing requirements and high rendering stability.
• Provides improved localization and stability of virtual sound positions, including above/below the listener.
• Applicable to various audio formats (channel-based, object-based, scene-based), broadening compatibility and use.
• Easily integrates with consumer products (soundbars, smart speakers) and large-scale systems, without complex initialization or calibration.
• Enhances user experience in home, automotive, gaming, and professional audio applications by creating a more immersive sound environment.

Technical Classifications (CPCs)

Inventors & Applicants

Patent Abstract

A more efficient rendering of audio objects, which allows 3D panning, is achieved by performing the panning into two stages, namely at least one horizontal in-layer panning leading to a first virtual (speaker) position and a second virtual or real (speaker) position, which is vertically offset, and another panning vertically between the two positions. Although acting in such a manner seems to increase the computational complexity, this staged processing increases, in fact, the stability of the rendering and the location of the intended virtual position. Moreover, the staged processing, enables to perform, according to an embodiment, the panning by use of amplitude panning gains only, i.e. phase processing is not necessary, thereby rendering the computational complexity low. Even further, the rendering is flexible with respect to applicability to a variety of loudspeaker setups.