English
Related papers

Related papers: Auralization based on multi-perspective ambisonic …

200 papers

Acoustic reflector localization is an important issue in audio signal processing, with direct applications in spatial audio, scene reconstruction, and source separation. Several methods have recently been proposed to estimate the 3D…

Sound · Computer Science 2017-01-06 Luca Remaggi , Philip J. B. Jackson , Philip Coleman , Wenwu Wang

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Brandon Yushan Feng , Susmija Jabbireddy , Amitabh Varshney

This paper considers methods for audio display in a CAVE-type virtual reality theater, a 3 m cube with displays covering all six rigid faces. Headphones are possible since the user's headgear continuously measures ear positions, but…

Sound · Computer Science 2011-06-08 Bowon Lee , Camille Goudeseune , Mark A. Hasegawa-Johnson

Nowadays, virtual reality interfaces allow the user to change perspectives in six degrees of freedom (6DoF) virtually, and consistently with the visual part, the acoustic perspective needs to be updated interactively. Single-perspective…

Sound · Computer Science 2022-10-11 Kaspar Müller , Franz Zotter

In Extended Reality (XR), rendering sound that accurately simulates real-world acoustics is pivotal in creating lifelike and believable virtual experiences. However, existing XR spatial audio rendering methods often struggle with real-time…

Room impulse response (RIR), which measures the sound propagation within an environment, is critical for synthesizing high-fidelity audio for a given environment. Some prior work has proposed representing RIR as a neural field function of…

Sound · Computer Science 2023-09-29 Susan Liang , Chao Huang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Spatial audio in Extended Reality (XR) provides users with better awareness of where virtual elements are placed, and efficiently guides them to events such as notifications, system alerts from different windows, or approaching avatars.…

Human-Computer Interaction · Computer Science 2024-08-20 Hyunsung Cho , Alexander Wang , Divya Kartik , Emily Liying Xie , Yukang Yan , David Lindlbauer

The room impulse response (RIR) encodes, among others, information about the distance of an acoustic source from the sensors. Deep neural networks (DNNs) have been shown to be able to extract that information for acoustic distance…

Sound · Computer Science 2024-08-27 Tobias Gburrek , Adrian Meise , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Acoustic-Resolution Photoacoustic Microscopy (AR-PAM) is promising for subcutaneous vascular imaging, but its spatial resolution is constrained by the Point Spread Function (PSF). Traditional deconvolution methods like Richardson-Lucy and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Youshen Xiao , Sheng Liao , Xuanyang Tian , Fan Zhang , Xinlong Dong , Yunhui Jiang , Xiyu Chen , Ruixi Sun , Yuyao Zhang , Fei Gao

A room's acoustic properties are a product of the room's geometry, the objects within the room, and their specific positions. A room's acoustic properties can be characterized by its impulse response (RIR) between a source and listener…

Sound · Computer Science 2024-01-17 Mason Wang , Samuel Clarke , Jui-Hsien Wang , Ruohan Gao , Jiajun Wu

Any audio recording encapsulates the unique fingerprint of the associated acoustic environment, namely the background noise and reverberation. Considering the scenario of a room equipped with a fixed smart speaker device with one or more…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-05 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Virtual acoustic environments enable the creation and simulation of realistic and eco-logically valid daily-life situations vital for hearing research and audiology. Reverberant indoor environments are particularly important. For real-time…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-03 Stefan Fichna , Steven van de Par , Bernhard U. Seeber , Stephan D. Ewert

Virtual acoustic environments enable the creation and simulation of realistic and ecologically valid daily-life situations with applications in hearing research and audiology. Hereby, reverberant indoor environments play an important role.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-28 Stefan Fichna , Steven van de Par , Stephan D. Ewert

Learning from audio-visual data offers many possibilities to express correspondence between the audio and visual content, similar to the human perception that relates aural and visual information. In this work, we present a method for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Shanshan Wang , Archontis Politis , Annamaria Mesaros , Tuomas Virtanen

Modern neural-network-based speech processing systems are typically required to be robust against reverberation, and the training of such systems thus needs a large amount of reverberant data. During the training of the systems, on-the-fly…

Sound · Computer Science 2023-04-18 Yi Luo , Rongzhi Gu

Spatial audio formats like Ambisonics are playback device layout-agnostic and well-suited for applications such as teleconferencing and virtual reality. Conventional Ambisonic encoding methods often rely on spherical microphone arrays for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Yue Qiao , Vinay Kothapally , Meng Yu , Dong Yu

Implicit neural representations (INRs) are a rapidly growing research field, which provides alternative ways to represent multimedia signals. Recent applications of INRs include image super-resolution, compression of high-dimensional…

The characteristics of a sound field are intrinsically linked to the geometric and spatial properties of the environment surrounding a sound source and a listener. The physics of sound propagation is captured in a time-domain signal known…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Christopher Ick , Gordon Wichern , Yoshiki Masuyama , François Germain , Jonathan Le Roux

Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations. By parameterizing signals as neural networks, INRs provide a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Dhananjaya Jayasundara , Vishal M. Patel

Conventional multiple-point active noise control (ANC) systems require placing error microphones within the region of interest (ROI), inconveniencing users. This paper designs a feasible monitoring microphone arrangement placed outside the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-27 Yile Angela Zhang , Fei Ma , Thushara Abhayapala , Prasanga Samarasinghe , Amy Bastine