English
Related papers

Related papers: Few-Shot Audio-Visual Learning of Environment Acou…

200 papers

We propose a multimodal deep learning model for VR auralization that generates spatial room impulse responses (SRIRs) in real time to reconstruct scene-specific auditory perception. Employing SRIRs as the output reduces computational…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-08 Zhiyu Li , Xinwen Yue , Shenghui Zhao , Jing Wang

The estimation of room impulse responses (RIRs) between static loudspeaker and microphone locations can be done using a number of well-established measurement and inference procedures. While these procedures assume a time-invariant acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-14 Kathleen MacWilliam , Thomas Dietzen , Randall Ali , Toon van Waterschoot

We propose a novel approach for blind room impulse response (RIR) estimation systems in the context of a downstream application scenario, far-field automatic speech recognition (ASR). We first draw the connection between improved RIR…

Deep learning approaches have emerged that aim to transform an audio signal so that it sounds as if it was recorded in the same room as a reference recording, with applications both in audio post-production and augmented reality. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-16 Christian J. Steinmetz , Vamsi Krishna Ithapu , Paul Calamia

An immersive acoustic experience enabled by spatial audio is just as crucial as the visual aspect in creating realistic virtual environments. However, existing methods for room impulse response estimation rely either on data-demanding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Derong Jin , Ruohan Gao

This paper focuses on room fingerprinting, a task involving the analysis of an audio recording to determine the specific volume and shape of the room in which it was captured. While it is relatively straightforward to determine the basic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Jacob Bitterman , Daniel Levi , Hilel Hagai Diamandi , Sharon Gannot , Tal Rosenwein

Realistic audio synthesis that captures accurate acoustic phenomena is essential for creating immersive experiences in virtual and augmented reality. Synthesizing the sound received at any position relies on the estimation of impulse…

Sound · Computer Science 2024-11-12 Zitong Lan , Chenhao Zheng , Zhiwei Zheng , Mingmin Zhao

Knowing the geometry of a space is desirable for many applications, e.g. sound source localization, sound field reproduction or auralization. In circumstances where only acoustic signals can be obtained, estimating the geometry of a room is…

Sound · Computer Science 2019-07-03 Linh Nguyen , Jaime Valls Miro , Xiaojun Qiu

Room equalisation aims to increase the quality of loudspeaker reproduction in reverberant environments, compensating for colouration caused by imperfect room reflections and frequency dependant loudspeaker directivity. A common technique in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 James Brooks-Park , Martin Bo Møller , Jan Østergaard , Søren Bech , Steven van de Par

We investigate the impact of more realistic room simulation for training far-field keyword spotting systems without fine-tuning on in-domain data. To this end, we study the impact of incorporating the following factors in the room impulse…

Sound · Computer Science 2020-11-19 Eric Bezzam , Robin Scheibler , Cyril Cadoux , Thibault Gisselbrecht

Rendering immersive spatial audio in virtual reality (VR) and video games demands a fast and accurate generation of room impulse responses (RIRs) to recreate auditory environments plausibly. However, the conventional methods for simulating…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Jackie Lin , Georg Götz , Sebastian J. Schlecht

Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpredictable and detrimental factors in performance, especially…

Sound · Computer Science 2021-04-22 Jaejun Lee , Donmoon Lee , Hyeong-Seok Choi , Kyogu Lee

Psychoacoustic experiments have shown that directional properties of the direct sound, salient reflections, and the late reverberation of an acoustic room response can have a distinct influence on the auditory perception of a given room.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Thomas Deppisch , Sebastià V. Amengual Garí , Paul Calamia , Jens Ahrens

The room impulse response (RIR) encodes, among others, information about the distance of an acoustic source from the sensors. Deep neural networks (DNNs) have been shown to be able to extract that information for acoustic distance…

Sound · Computer Science 2024-08-27 Tobias Gburrek , Adrian Meise , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

This report details MERL's system for room impulse response (RIR) estimation submitted to the Generative Data Augmentation Workshop at ICASSP 2025 for Augmenting RIR Data (Task 1) and Improving Speaker Distance Estimation (Task 2). We first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-22 Christopher Ick , Gordon Wichern , Yoshiki Masuyama , François G. Germain , Jonathan Le Roux

Recording and annotating real sound events for a sound event localization and detection (SELD) task is time consuming, and data augmentation techniques are often favored when the amount of data is limited. However, how to augment the…

Prediction of room impulse responses (RIRs) is essential for room acoustics, spatial audio, and immersive applications, yet conventional simulations and measurements remain computationally expensive and time-consuming. This work proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Imran Muhammad , Gerald Schuller

Realistic sound simulation plays a critical role in many applications. A key element in sound simulation is the room impulse response (RIR), which characterizes how sound propagates from a source to a listener within a given space. Recent…

Sound · Computer Science 2025-09-19 Chen Si , Qianyi Wu , Chaitanya Amballa , Romit Roy Choudhury

The characteristics of a sound field are intrinsically linked to the geometric and spatial properties of the environment surrounding a sound source and a listener. The physics of sound propagation is captured in a time-domain signal known…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Christopher Ick , Gordon Wichern , Yoshiki Masuyama , François Germain , Jonathan Le Roux

Knowing the room geometry may be very beneficial for many audio applications, including sound reproduction, acoustic scene analysis, and sound source localization. Room geometry inference (RGI) deals with the problem of reflector…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-29 Cagdas Tuna , Altan Akat , H. Nazim Bicer , Andreas Walther , Emanuël A. P. Habets