English
Related papers

Related papers: RIR-SF: Room Impulse Response Based Spatial Featur…

200 papers

We introduce a computationally efficient and tunable feedback delay network (FDN) architecture for real-time room impulse response (RIR) rendering that addresses the computational and latency challenges inherent in traditional convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-02 Armin Gerami , Ramani Duraiswami

We propose a self-speaker adaptation method for streaming multi-talker automatic speech recognition (ASR) that eliminates the need for explicit speaker queries. Unlike conventional approaches requiring target speaker embeddings or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Weiqing Wang , Taejin Park , Ivan Medennikov , Jinhan Wang , Kunal Dhawan , He Huang , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

Recently, speech enhancement technologies that are based on deep learning have received considerable research attention. If the spatial information in microphone signals is exploited, microphone arrays can be advantageous under some adverse…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-19 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a Transformer-based architecture. We particularly focus on the scene context provided by the visual information, to ground the ASR. We extract…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Georgios Paraskevopoulos , Srinivas Parthasarathy , Aparna Khare , Shiva Sundaram

We present a Generative Adversarial Network (GAN) based room impulse response generator (IR-GAN) for generating realistic synthetic room impulse responses (RIRs). IR-GAN extracts acoustic parameters from captured real-world RIRs and uses…

Sound · Computer Science 2021-04-08 Anton Ratnarajah , Zhenyu Tang , Dinesh Manocha

The Room Acoustics and Speaker Distance Estimation (SDE) Challenge at ICASSP 2025 explores the effectiveness of augmented room impulse response (RIR) data for improving SDE model performance. This challenge at GenDARA involves generating…

Sound · Computer Science 2026-05-04 Anton Ratnarajah , Mehmet Ergezer , Arun Nair , Mrudula Athi

We investigate the effects of four strategies for improving the ecological validity of synthetic room impulse response (RIR) datasets for monoaural Speech Enhancement (SE). We implement three features on top of the traditional image source…

Sound · Computer Science 2025-07-15 Enric Gusó , Joanna Luberadzka , Umut Sayin , Xavier Serra

Spatial information is a critical clue for multi-channel multi-speaker target speech recognition. Most state-of-the-art multi-channel Automatic Speech Recognition (ASR) systems extract spatial features only during the speech separation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Yiwen Shao , Yong Xu , Sanjeev Khudanpur , Dong Yu

Room Impulse Responses (RIRs) characterize acoustic environments and are crucial in multiple audio signal processing tasks. High-quality RIR estimates drive applications such as virtual microphones, sound source localization, augmented…

Sound · Computer Science 2025-04-30 Sagi Della Torre , Mirco Pezzoli , Fabio Antonacci , Sharon Gannot

The room impulse response (RIR) encodes, among others, information about the distance of an acoustic source from the sensors. Deep neural networks (DNNs) have been shown to be able to extract that information for acoustic distance…

Sound · Computer Science 2024-08-27 Tobias Gburrek , Adrian Meise , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpredictable and detrimental factors in performance, especially…

Sound · Computer Science 2021-04-22 Jaejun Lee , Donmoon Lee , Hyeong-Seok Choi , Kyogu Lee

An immersive acoustic experience enabled by spatial audio is just as crucial as the visual aspect in creating realistic virtual environments. However, existing methods for room impulse response estimation rely either on data-demanding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Derong Jin , Ruohan Gao

Data-driven acoustic echo cancellation (AEC) methods, predominantly trained on synthetic or constrained real-world datasets, encounter performance declines in unseen echo scenarios, especially in real environments where echo paths are not…

Sound · Computer Science 2025-06-09 Fei Zhao , Shulin He , Xueliang Zhang

This paper presents BUT ReverbDB - a dataset of real room impulse responses (RIR), background noises and re-transmitted speech data. The retransmitted data includes LibriSpeech test-clean, 2000 HUB5 English evaluation and part of 2010 NIST…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-04 Igor Szoke , Miroslav Skacel , Ladislav Mosner , Jakub Paliesek , Jan "Honza" Cernocky

The main motivation for Automatic Speech Recognition (ASR) is efficient interfaces to computers, and for the interfaces to be natural and truly useful, it should provide coverage for a large group of users. The purpose of these tasks is to…

Computation and Language · Computer Science 2013-03-25 Urmila Shrawankar , VM Thakare

Realistic sound simulation plays a critical role in many applications. A key element in sound simulation is the room impulse response (RIR), which characterizes how sound propagates from a source to a listener within a given space. Recent…

Sound · Computer Science 2025-09-19 Chen Si , Qianyi Wu , Chaitanya Amballa , Romit Roy Choudhury

The training of modern speech processing systems often requires a large amount of simulated room impulse response (RIR) data in order to allow the systems to generalize well in real-world, reverberant environments. However, simulating…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Yi Luo , Jianwei Yu

Speaker-attributed automatic speech recognition (SA-ASR) in multi-party meeting scenarios is one of the most valuable and challenging ASR task. It was shown that single-channel frame-level diarization with serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Mohan Shi , Jie Zhang , Zhihao Du , Fan Yu , Qian Chen , Shiliang Zhang , Li-Rong Dai

With the growing adoption of wearable devices such as smart glasses for AI assistants, wearer speech recognition (WSR) is becoming increasingly critical to next-generation human-computer interfaces. However, in real environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-19 Yufeng Yang , Yiteng Huang , Yong Xu , Li Wan , Suwon Shon , Yang Liu , Yifeng Fan , Zhaojun Yang , Olivier Siohan , Yue Liu , Ming Sun , Florian Metze

In the future robots will interact more and more with humans and will have to communicate naturally and efficiently. Automatic speech recognition systems (ASR) will play an important role in creating natural interactions and making robots…

Robotics · Computer Science 2020-11-13 Jonas Gonzalez-Billandon , Lukas Grasse , Matthew Tata , Alessandra Sciutti , Francesco Rea