English
Related papers

Related papers: Scene-Aware Audio Rendering via Deep Acoustic Anal…

200 papers

This paper introduces a curated dataset of urban scenes for audio-visual scene analysis which consists of carefully selected and recorded material. The data was recorded in multiple European cities, using the same equipment, in multiple…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-12 Shanshan Wang , Annamaria Mesaros , Toni Heittola , Tuomas Virtanen

In real life, room effect, also known as room reverberation, and the present background noise degrade the quality of speech. Recently, deep learning-based speech enhancement approaches have shown a lot of promise and surpassed traditional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Jean-Marc Valin , Ritwik Giri , Shrikant Venkataramani , Umut Isik , Arvindh Krishnaswamy

Deep learning techniques have achieved specific results in recording device source identification. The recording device source features include spatial information and certain temporal information. However, most recording device source…

Sound · Computer Science 2022-12-06 Chunyan Zeng , Dongliang Zhu , Zhifeng Wang , Minghu Wu , Wei Xiong , Nan Zhao

A toolbox for creation and rendering of dynamic virtual acoustic environments (TASCAR) that allows direct user interaction was developed for application in hearing aid research and audiology. This technical paper describes the general…

Sound · Computer Science 2025-05-01 Giso Grimm , Joanna Luberadzka , Volker Hohmann

Accurate acoustic simulations of enclosed spaces require precise boundary conditions, typically expressed through surface impedances for wave-based methods. Conventional measurement techniques often rely on simplifying assumptions about the…

Sound · Computer Science 2026-04-09 Jonas M. Schmid , Johannes D. Schmid , Martin Eser , Steffen Marburg

Localizing a moving sound source in the real world involves determining its direction-of-arrival (DOA) and distance relative to a microphone. Advancements in DOA estimation have been facilitated by data-driven methods optimized with large…

Sound · Computer Science 2023-09-19 Saksham Singh Kushwaha , Iran R. Roman , Magdalena Fuentes , Juan Pablo Bello

In time-cost scale model studies, predicting acoustic performance by using simulation methods is a commonly used method that is preferred. In this field, building acoustic simulation tools are complicated by several challenges, including…

We present a framework for accelerated iterative reconstructions using a fast and approximate forward model that is based on k-space methods for photoacoustic tomography. The approximate model introduces aliasing artefacts in the gradient…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Andreas Hauptmann , Ben Cox , Felix Lucka , Nam Huynh , Marta Betcke , Paul Beard , Simon Arridge

Real-world audio recordings are often degraded by factors such as noise, reverberation, and equalization distortion. This paper introduces HiFi-GAN, a deep learning method to transform recorded speech to sound as though it had been recorded…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-23 Jiaqi Su , Zeyu Jin , Adam Finkelstein

In ultrasound tomography, the speed of sound inside an object is estimated based on acoustic measurements carried out by sensors surrounding the object. An accurate forward model is a prominent factor for high-quality image reconstruction,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-24 Janne Koponen , Timo Lähivaara , Jari Kaipio , Marko Vauhkonen

In this paper, we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques. We first discuss acoustic models that can effectively exploit variable-length…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-30 Dong Yu , Jinyu Li

We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic room data from multiple modalities. The dataset includes high-quality and densely captured room impulse response data paired with multi-view images, and…

Knowledge of loudspeaker responses are useful in a number of applications, where a sound system is located inside a room that alters the listening experience depending on position within the room. Acquisition of sound fields for sound…

The imitation of percussive sounds via the human voice is a natural and effective tool for communicating rhythmic ideas on the fly. Thus, the automatic retrieval of drum sounds using vocal percussion can help artists prototype drum patterns…

Sound · Computer Science 2021-10-19 Alejandro Delgado , SkoT McDonald , Ning Xu , Charalampos Saitis , Mark Sandler

Collecting sufficient amount of data that can represent various acoustic environmental attributes is a critical problem for distributed acoustic machine learning. Several audio data augmentation techniques have been introduced to address…

Sound · Computer Science 2021-01-07 Chunheng Jiang , Jae-wook Ahn , Nirmit Desai

Room geometry inference algorithms rely on the localization of acoustic reflectors to identify boundary surfaces of an enclosure. Rooms with highly absorptive walls or walls at large distances from the measurement setup pose challenges for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-12 H. Nazim Bicer , Cagdas Tuna , Andreas Walther , Emanuël A. P. Habets

Generating accurate sounds for complex audio-visual scenes is challenging, especially in the presence of multiple objects and sound sources. In this paper, we propose an {\em interactive object-aware audio generation} model that grounds…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Tingle Li , Baihe Huang , Xiaobin Zhuang , Dongya Jia , Jiawei Chen , Yuping Wang , Zhuo Chen , Gopala Anumanchipalli , Yuxuan Wang

Visual scenes are composed of visual concepts and have the property of combinatorial explosion. An important reason for humans to efficiently learn from diverse visual scenes is the ability of compositional perception, and it is desirable…

Machine Learning · Computer Science 2023-06-16 Jinyang Yuan , Tonglin Chen , Bin Li , Xiangyang Xue

Replay attacks remain a critical vulnerability for automatic speaker verification systems, particularly in real-time voice assistant applications. In this work, we propose acoustic maps as a novel spatial feature representation for replay…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Michael Neri , Tuomas Virtanen

We study the problem of multimodal physical scene understanding, where an embodied agent needs to find fallen objects by inferring object properties, direction, and distance of an impact sound source. Previous works adopt feed-forward…

Robotics · Computer Science 2024-07-17 Jie Yin , Andrew Luo , Yilun Du , Anoop Cherian , Tim K. Marks , Jonathan Le Roux , Chuang Gan