English
Related papers

Related papers: Multimodal Deep Learning Method for Real-Time Spat…

200 papers

An immersive acoustic experience enabled by spatial audio is just as crucial as the visual aspect in creating realistic virtual environments. However, existing methods for room impulse response estimation rely either on data-demanding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Derong Jin , Ruohan Gao

In Extended Reality (XR), rendering sound that accurately simulates real-world acoustics is pivotal in creating lifelike and believable virtual experiences. However, existing XR spatial audio rendering methods often struggle with real-time…

The spatial impulse response (SIR) method is a well-known approach to calculate transient acoustic fields of arbitrary-shape transducers. It involves the evaluation of a time-dependent surface integral. Although analytic expressions of the…

Numerical Analysis · Mathematics 2021-11-01 Dimitris Perdios , Florian Martinez , Marcel Arditi , Jean-Philippe Thiran

Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Kaspar Müller , Franz Zotter

Realistic audio synthesis that captures accurate acoustic phenomena is essential for creating immersive experiences in virtual and augmented reality. Synthesizing the sound received at any position relies on the estimation of impulse…

Sound · Computer Science 2024-11-12 Zitong Lan , Chenhao Zheng , Zhiwei Zheng , Mingmin Zhao

Room impulse response (RIR) generation remains a critical challenge for creating immersive virtual acoustic environments. Current methods suffer from two fundamental limitations: the scarcity of full-band RIR datasets and the inability of…

Sound · Computer Science 2025-10-30 Ali Vosoughi , Yongyi Zang , Qihui Yang , Nathan Paek , Randal Leistikow , Chenliang Xu

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

We present a novel approach to improve the performance of learning-based speech dereverberation using accurate synthetic datasets. Our approach is designed to recover the reverb-free signal from a reverberant speech signal. We show that…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-13 Rohith Aralikatti , Zhenyu Tang , Dinesh Manocha

This contribution introduces a dataset of 7th-order Ambisonic Room Impulse Responses (HOA-RIRs), created using the Image Source Method. By employing higher-order Ambisonics, our dataset enables precise spatial audio reproduction, a critical…

Sound · Computer Science 2025-06-02 Shivam Saini , Jürgen Peissig

Knowing the room geometry may be very beneficial for many audio applications, including sound reproduction, acoustic scene analysis, and sound source localization. Room geometry inference (RGI) deals with the problem of reflector…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-29 Cagdas Tuna , Altan Akat , H. Nazim Bicer , Andreas Walther , Emanuël A. P. Habets

Learned sparse retrieval (LSR) is a family of neural methods that encode queries and documents into sparse lexical vectors that can be indexed and retrieved efficiently with an inverted index. We explore the application of LSR to the…

Information Retrieval · Computer Science 2024-02-28 Thong Nguyen , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

The generation of room impulse responses (RIRs) using deep neural networks has attracted growing research interest due to its applications in virtual and augmented reality, audio postproduction, and related fields. Most existing approaches…

Sound · Computer Science 2025-07-17 Silvia Arellano , Chunghsin Yeh , Gautam Bhattacharya , Daniel Arteaga

Accurate and efficient simulation of room impulse responses is crucial for spatial audio applications. However, existing acoustic ray-tracing tools often operate as black boxes and only output impulse responses (IRs), providing limited…

Sound · Computer Science 2025-03-25 Yongyi Zang , Qiuqiang Kong

Purpose: To introduce a novel deep learning method for Robust and Accelerated Reconstruction (RoAR) of quantitative and B0-inhomogeneity-corrected R2* maps from multi-gradient recalled echo (mGRE) MRI data. Methods: RoAR trains a…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Max Torop , Satya VVN Kothapalli , Yu Sun , Jiaming Liu , Sayan Kahali , Dmitriy A. Yablonskiy , Ulugbek S. Kamilov

The room impulse response (RIR) encodes, among others, information about the distance of an acoustic source from the sensors. Deep neural networks (DNNs) have been shown to be able to extract that information for acoustic distance…

Sound · Computer Science 2024-08-27 Tobias Gburrek , Adrian Meise , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

We investigate the effects of four strategies for improving the ecological validity of synthetic room impulse response (RIR) datasets for monoaural Speech Enhancement (SE). We implement three features on top of the traditional image source…

Sound · Computer Science 2025-07-15 Enric Gusó , Joanna Luberadzka , Umut Sayin , Xavier Serra

The Image Source Method (ISM) is one of the most employed techniques to calculate acoustic Room Impulse Responses (RIRs), however, its computational complexity grows fast with the reverberation time of the room and its computation time can…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 David Diaz-Guerra , Antonio Miguel , Jose R. Beltran

Modern neural-network-based speech processing systems are typically required to be robust against reverberation, and the training of such systems thus needs a large amount of reverberant data. During the training of the systems, on-the-fly…

Sound · Computer Science 2023-04-18 Yi Luo , Rongzhi Gu

For audio in augmented reality (AR), knowledge of the users' real acoustic environment is crucial for rendering virtual sounds that seamlessly blend into the environment. As acoustic measurements are usually not feasible in practical AR…

Sound · Computer Science 2024-09-24 Francesc Lluís , Nils Meyer-Kahlen

Deep Learning (DL) methods can reconstruct highly accelerated magnetic resonance imaging (MRI) scans, but they rely on application-specific large training datasets and often generalize poorly to out-of-distribution data. Self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2026-04-24 Hongze Yu , Jeffrey A. Fessler , Yun Jiang