English
Related papers

Related papers: Data Augmentation Using Neural Acoustic Fields Wit…

200 papers

An environment acoustic model represents how sound is transformed by the physical characteristics of an indoor environment, for any given source/receiver location. Traditional methods for constructing acoustic models involve expensive and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Arjun Somayazulu , Sagnik Majumder , Changan Chen , Kristen Grauman

This paper describes noisy speech recognition for an augmented reality headset that helps verbal communication within real multiparty conversational environments. A major approach that has actively been studied in simulated environments is…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-18 Yicheng Du , Aditya Arie Nugraha , Kouhei Sekiguchi , Yoshiaki Bando , Mathieu Fontaine , Kazuyoshi Yoshii

Room impulse responses are a core resource for dereverberation, robust speech recognition, source localization, and room acoustics estimation. We present RIR-Mega, a large collection of simulated RIRs described by a compact, machine…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Mandip Goswami

Speaker extraction aims to extract target speech signal from a multi-talker environment with interference speakers and surrounding noise, given the target speaker's reference information. Most speaker extraction systems achieve satisfactory…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Chengyun Deng , Shiqian Ma , Yi Zhang , Yongtao Sha , Hui Zhang , Hui Song , Xiangang Li

Neural network models for audio tasks, such as automatic speech recognition (ASR) and acoustic scene classification (ASC), are susceptible to noise contamination for real-life applications. To improve audio quality, an enhancement module,…

Ensuring performance robustness for a variety of situations that can occur in real-world environments is one of the challenging tasks in sound event classification. One of the unpredictable and detrimental factors in performance, especially…

Sound · Computer Science 2021-04-22 Jaejun Lee , Donmoon Lee , Hyeong-Seok Choi , Kyogu Lee

Knowing the room geometry may be very beneficial for many audio applications, including sound reproduction, acoustic scene analysis, and sound source localization. Room geometry inference (RGI) deals with the problem of reflector…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-29 Cagdas Tuna , Altan Akat , H. Nazim Bicer , Andreas Walther , Emanuël A. P. Habets

Acoustic environment characterization opens doors for sound reproduction innovations, smart EQing, speech enhancement, hearing aids, and forensics. Reverberation time, clarity, and direct-to-reverberant ratio are acoustic parameters that…

Sound · Computer Science 2020-10-22 Paul Callens , Milos Cernak

Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developing a noise robust acoustic-to-articulatory speech inversion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yashish M. Siriwardena , Ahmed Adel Attia , Ganesh Sivaraman , Carol Espy-Wilson

Data augmentation is a widely used technique for improving model performance in machine learning, particularly in computer vision and natural language processing. Recently, there has been increasing interest in applying augmentation…

Machine Learning · Computer Science 2023-05-05 Raad Khraishi , Ramin Okhrati

State-of-the-art deep-learning-based voice activity detectors (VADs) are often trained with anechoic data. However, real acoustic environments are generally reverberant, which causes the performance to significantly deteriorate. To mitigate…

Sound · Computer Science 2021-06-28 Amir Ivry , Israel Cohen , Baruch Berdugo

In this paper, we present HOMULA-RIR, a dataset of room impulse responses (RIRs) acquired using both higher-order microphones (HOMs) and a uniform linear array (ULA), in order to model a remote attendance teleconferencing scenario.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-22 Federico Miotello , Paolo Ostan , Mirco Pezzoli , Luca Comanducci , Alberto Bernardini , Fabio Antonacci , Augusto Sarti

We investigate the effects of four strategies for improving the ecological validity of synthetic room impulse response (RIR) datasets for monoaural Speech Enhancement (SE). We implement three features on top of the traditional image source…

Sound · Computer Science 2025-07-15 Enric Gusó , Joanna Luberadzka , Umut Sayin , Xavier Serra

The characteristics of a sound field are intrinsically linked to the geometric and spatial properties of the environment surrounding a sound source and a listener. The physics of sound propagation is captured in a time-domain signal known…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Christopher Ick , Gordon Wichern , Yoshiki Masuyama , François Germain , Jonathan Le Roux

We propose a mesh-based neural network (MESH2IR) to generate acoustic impulse responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create a high-quality sound experience in interactive applications and audio…

Sound · Computer Science 2022-07-13 Anton Ratnarajah , Zhenyu Tang , Rohith Chandrashekar Aralikatti , Dinesh Manocha

Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Kaspar Müller , Franz Zotter

A new impulse response (IR) dataset called "MeshRIR" is introduced. Currently available datasets usually include IRs at an array of microphones from several source positions under various room conditions, which are basically designed for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-26 Shoichi Koyama , Tomoya Nishida , Keisuke Kimura , Takumi Abe , Natsuki Ueno , Jesper Brunnström

We present Spatial LibriSpeech, a spatial audio dataset with over 650 hours of 19-channel audio, first-order ambisonics, and optional distractor noise. Spatial LibriSpeech is designed for machine learning model training, and it includes…

Rings like gold, thuds like wood! The sound we hear in a scene is shaped not only by the spatial layout of the environment but also by the materials of the objects and surfaces within it. For instance, a room with wooden walls will produce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Mahnoor Fatima Saad , Sagnik Majumder , Kristen Grauman , Ziad Al-Halah

How would the sound in a studio change with a carpeted floor and acoustic tiles on the walls? We introduce the task of material-controlled acoustic profile generation, where, given an indoor scene with specific audio-visual characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mahnoor Fatima Saad , Ziad Al-Halah