English
Related papers

Related papers: Adapting a Text-to-Audio Model for Room Impulse Re…

200 papers

We present a Generative Adversarial Network (GAN) based room impulse response generator (IR-GAN) for generating realistic synthetic room impulse responses (RIRs). IR-GAN extracts acoustic parameters from captured real-world RIRs and uses…

Sound · Computer Science 2021-04-08 Anton Ratnarajah , Zhenyu Tang , Dinesh Manocha

Blind room impulse response (RIR) estimation is a core task for capturing and transferring acoustic properties; yet existing methods often suffer from limited modeling capability and degraded performance under unseen conditions. Moreover,…

Sound · Computer Science 2026-02-11 Jackie Lin , Jiaqi Su , Nishit Anand , Zeyu Jin , Minje Kim , Paris Smaragdis

Rings like gold, thuds like wood! The sound we hear in a scene is shaped not only by the spatial layout of the environment but also by the materials of the objects and surfaces within it. For instance, a room with wooden walls will produce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Mahnoor Fatima Saad , Sagnik Majumder , Kristen Grauman , Ziad Al-Halah

The estimation of room impulse responses (RIRs) between static loudspeaker and microphone locations can be done using a number of well-established measurement and inference procedures. While these procedures assume a time-invariant acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-14 Kathleen MacWilliam , Thomas Dietzen , Randall Ali , Toon van Waterschoot

We present a neural-network-based fast diffuse room impulse response generator (FAST-RIR) for generating room impulse responses (RIRs) for a given acoustic environment. Our FAST-RIR takes rectangular room dimensions, listener and speaker…

Sound · Computer Science 2022-02-08 Anton Ratnarajah , Shi-Xiong Zhang , Meng Yu , Zhenyu Tang , Dinesh Manocha , Dong Yu

The Image Source Method (ISM) is one of the most employed techniques to calculate acoustic Room Impulse Responses (RIRs), however, its computational complexity grows fast with the reverberation time of the room and its computation time can…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 David Diaz-Guerra , Antonio Miguel , Jose R. Beltran

Measuring the acoustic characteristics of a space is often done by capturing its impulse response (IR), a representation of how a full-range stimulus sound excites it. This work generates an IR from a single image, which can then be applied…

Sound · Computer Science 2021-08-17 Nikhil Singh , Jeff Mentch , Jerry Ng , Matthew Beveridge , Iddo Drori

In the context of building acoustics and the acoustic diagnosis of an existing room, this paper introduces and investigates a new approach to estimate mean absorption coefficients solely from a room impulse response (RIR). This inverse…

Neural and Evolutionary Computing · Computer Science 2021-09-02 Cédric Foy , Antoine Deleforge , Diego Di Carlo

Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpredictable and detrimental factors in performance, especially…

Sound · Computer Science 2021-04-22 Jaejun Lee , Donmoon Lee , Hyeong-Seok Choi , Kyogu Lee

Accurate and efficient simulation of room impulse responses is crucial for spatial audio applications. However, existing acoustic ray-tracing tools often operate as black boxes and only output impulse responses (IRs), providing limited…

Sound · Computer Science 2025-03-25 Yongyi Zang , Qiuqiang Kong

Room equalisation aims to increase the quality of loudspeaker reproduction in reverberant environments, compensating for colouration caused by imperfect room reflections and frequency dependant loudspeaker directivity. A common technique in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 James Brooks-Park , Martin Bo Møller , Jan Østergaard , Søren Bech , Steven van de Par

The training of modern speech processing systems often requires a large amount of simulated room impulse response (RIR) data in order to allow the systems to generalize well in real-world, reverberant environments. However, simulating…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Yi Luo , Jianwei Yu

We present a novel approach that improves the performance of reverberant speech separation. Our approach is based on an accurate geometric acoustic simulator (GAS) which generates realistic room impulse responses (RIRs) by modeling both…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Rohith Aralikatti , Anton Ratnarajah , Zhenyu Tang , Dinesh Manocha

How would the sound in a studio change with a carpeted floor and acoustic tiles on the walls? We introduce the task of material-controlled acoustic profile generation, where, given an indoor scene with specific audio-visual characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mahnoor Fatima Saad , Ziad Al-Halah

Automatic speech recognition (ASR) on multi-talker recordings is challenging. Current methods using 3D spatial data from multi-channel audio and visual cues focus mainly on direct waves from the target speaker, overlooking reflection wave…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yiwen Shao , Shi-Xiong Zhang , Dong Yu

In recent years, text-to-audio models have revolutionized the field of automatic audio generation. This paper investigates their application in generating synthetic datasets for training data-driven models. Specifically, this study analyzes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Francesca Ronchini , Luca Comanducci , Fabio Antonacci

This paper presents BUT ReverbDB - a dataset of real room impulse responses (RIR), background noises and re-transmitted speech data. The retransmitted data includes LibriSpeech test-clean, 2000 HUB5 English evaluation and part of 2010 NIST…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-04 Igor Szoke , Miroslav Skacel , Ladislav Mosner , Jakub Paliesek , Jan "Honza" Cernocky

We investigate the impact of more realistic room simulation for training far-field keyword spotting systems without fine-tuning on in-domain data. To this end, we study the impact of incorporating the following factors in the room impulse…

Sound · Computer Science 2020-11-19 Eric Bezzam , Robin Scheibler , Cyril Cadoux , Thibault Gisselbrecht

We propose a multimodal deep learning model for VR auralization that generates spatial room impulse responses (SRIRs) in real time to reconstruct scene-specific auditory perception. Employing SRIRs as the output reduces computational…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-08 Zhiyu Li , Xinwen Yue , Shenghui Zhao , Jing Wang

Deep learning approaches have emerged that aim to transform an audio signal so that it sounds as if it was recorded in the same room as a reference recording, with applications both in audio post-production and augmented reality. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-16 Christian J. Steinmetz , Vamsi Krishna Ithapu , Paul Calamia