English
Related papers

Related papers: MEAN-RIR: Multi-Modal Environment-Aware Network fo…

200 papers

As humans, we hear sound every second of our life. The sound we hear is often affected by the acoustics of the environment surrounding us. For example, a spacious hall leads to more reverberation. Room Impulse Responses (RIR) are commonly…

Artificial Intelligence · Computer Science 2023-10-10 Yinfeng Yu , Changan Chen , Lele Cao , Fangkai Yang , Fuchun Sun

Rings like gold, thuds like wood! The sound we hear in a scene is shaped not only by the spatial layout of the environment but also by the materials of the objects and surfaces within it. For instance, a room with wooden walls will produce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Mahnoor Fatima Saad , Sagnik Majumder , Kristen Grauman , Ziad Al-Halah

Measuring the acoustic characteristics of a space is often done by capturing its impulse response (IR), a representation of how a full-range stimulus sound excites it. This work generates an IR from a single image, which can then be applied…

Sound · Computer Science 2021-08-17 Nikhil Singh , Jeff Mentch , Jerry Ng , Matthew Beveridge , Iddo Drori

Intelligent reflecting surface (IRS) is an emerging technology for future wireless communications including 5G and especially 6G. It consists of a large 2D array of (semi-)passive scattering elements that control the electromagnetic…

Signal Processing · Electrical Eng. & Systems 2021-04-21 Gilderlan T. de Araújo , André L. F. de Almeida , Rémy Boyer

Room impulse response estimation is essential for tasks like speech dereverberation, which improves automatic speech recognition. Most existing methods rely on either statistical signal processing or deep neural networks designed to…

Sound · Computer Science 2025-07-14 Louis Lalay , Mathieu Fontaine , Roland Badeau

Predicting Room Impulse Responses (RIRs) remains a challenge due to the high dimensionality of audio signals and the need for perceptual accuracy. This paper introduces a neural network framework that predicts multi-band Energy Decay Curves…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Imran Muhammad , Gerald Schuller

After natural disasters, accurate evaluations of damage to housing are important for insurance claims response and planning of resources. In this work, we introduce a novel multimodal retrieval-augmented generation (MM-RAG) framework. On…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Jiayi Miao , Dingxin Lu , Zhuqi Wang

The generation of room impulse responses (RIRs) using deep neural networks has attracted growing research interest due to its applications in virtual and augmented reality, audio postproduction, and related fields. Most existing approaches…

Sound · Computer Science 2025-07-17 Silvia Arellano , Chunghsin Yeh , Gautam Bhattacharya , Daniel Arteaga

Room impulse response (RIR), which measures the sound propagation within an environment, is critical for synthesizing high-fidelity audio for a given environment. Some prior work has proposed representing RIR as a neural field function of…

Sound · Computer Science 2023-09-29 Susan Liang , Chao Huang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Sound propagation is the process by which sound energy travels through a medium, such as air, to the surrounding environment as sound waves. The room impulse response (RIR) describes this process and is influenced by the positions of the…

Sound · Computer Science 2024-09-25 Anton Jeran Ratnarajah

Room impulse responses are a core resource for dereverberation, robust speech recognition, source localization, and room acoustics estimation. We present RIR-Mega, a large collection of simulated RIRs described by a compact, machine…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Mandip Goswami

Acoustic environment characterization opens doors for sound reproduction innovations, smart EQing, speech enhancement, hearing aids, and forensics. Reverberation time, clarity, and direct-to-reverberant ratio are acoustic parameters that…

Sound · Computer Science 2020-10-22 Paul Callens , Milos Cernak

The room impulse response (RIR) encodes, among others, information about the distance of an acoustic source from the sensors. Deep neural networks (DNNs) have been shown to be able to extract that information for acoustic distance…

Sound · Computer Science 2024-08-27 Tobias Gburrek , Adrian Meise , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Implicit Neural Representations (INRs) aim to parameterize discrete signals through implicit continuous functions. However, formulating each image with a separate neural network~(typically, a Multi-Layer Perceptron (MLP)) leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Wenyong Zhou , Taiqiang Wu , Zhengwu Liu , Yuxin Cheng , Chen Zhang , Ngai Wong

Changes in room acoustics, such as modifications to surface absorption or the insertion of a scattering object, significantly impact measured room impulse responses (RIRs). These changes can affect the performance of systems used in echo…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Karolina Prawda

State-of-the-art deep-learning-based voice activity detectors (VADs) are often trained with anechoic data. However, real acoustic environments are generally reverberant, which causes the performance to significantly deteriorate. To mitigate…

Sound · Computer Science 2021-06-28 Amir Ivry , Israel Cohen , Baruch Berdugo

Standard decoding approaches rely on model-based channel estimation methods to compensate for varying channel effects, which degrade in performance whenever there is a model mismatch. Recently proposed Deep learning based neural decoders…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan

We address the problem of estimating room impulse responses (RIRs) in noisy, uncontrolled environments where non-stationary sounds such as speech or footsteps corrupt conventional deconvolution. We propose AnyRIR, a non-intrusive method…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Kyung Yun Lee , Nils Meyer-Kahlen , Karolina Prawda , Vesa Välimäki , Sebastian J. Schlecht

Room Impulse Responses (RIRs) characterize acoustic environments and are crucial in multiple audio signal processing tasks. High-quality RIR estimates drive applications such as virtual microphones, sound source localization, augmented…

Sound · Computer Science 2025-04-30 Sagi Della Torre , Mirco Pezzoli , Fabio Antonacci , Sharon Gannot

We propose a mesh-based neural network (MESH2IR) to generate acoustic impulse responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create a high-quality sound experience in interactive applications and audio…

Sound · Computer Science 2022-07-13 Anton Ratnarajah , Zhenyu Tang , Rohith Chandrashekar Aralikatti , Dinesh Manocha