English
Related papers

Related papers: Perceptually Transparent Binaural Auralization of …

200 papers

In this study we describe a methodology to realize visual images cognition in the broader sense, by a cross-modal stimulation through the auditory channel. An original algorithm of conversion from bi-dimensional images to sounds has been…

Neurons and Cognition · Quantitative Biology 2017-05-16 Takahisa Kishino , Sun Zhe , Roberto Marchisio , Ruggero Micheletto

Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to…

Machine Learning · Computer Science 2024-04-03 Yi Di Yuan , Swee Liang Wong , Jonathan Pan

We introduce and explore a new multimodal input representation for vision-language models: acoustic field video. Unlike conventional video (RGB with stereo/mono audio), our video stream provides a spatially grounded visualization of sound…

Human-Computer Interaction · Computer Science 2026-01-27 Daehwa Kim , Chris Harrison

Spatial audio is fundamental to immersive virtual experiences, yet synthesizing high-fidelity binaural audio from sparse observations remains a significant challenge. Existing methods typically rely on implicit neural representations…

Sound · Computer Science 2026-04-13 Chunhao Bi , Houqiang Zhong , Zhixin Xu , Li Song , Zhengxue Cheng

Most often, virtual acoustic rendering employs real-time updated room acoustic simulations to accomplish auralization for a variable listener perspective. As an alternative, we propose and test a technique to interpolate room impulse…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Kaspar Müller , Franz Zotter

We aim to develop a technology that makes the sound from earphones and headphones easier to hear without increasing the sound pressure or eliminating ambient noise. To this end, we focus on harnessing the phenomenon of binaural unmasking…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-23 Rina Kotani , Chiaki Miyazaki , Shiro Suzuki

Personalized binaural audio reproduction is the basis of realistic spatial localization, sound externalization, and immersive listening, directly shaping user experience and listening effort. This survey reviews recent advances in deep…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Xikun Lu , Yunda Chen , Zehua Chen , Jie Wang , Mingxing Liu , Hongmei Hu , Chengshi Zheng , Stefan Bleeck , Jinqiu Sang

To enhance immersive experiences, binaural audio offers spatial awareness of sounding objects in AR, VR, and embodied AI applications. While existing audio spatialization methods can generally map any available monaural audio to binaural…

Sound · Computer Science 2025-06-03 Tianrui Pan , Jie Liu , Zewen Huang , Jie Tang , Gangshan Wu

A method of binaural rendering from microphone array signals of arbitrary geometry is proposed. To reproduce binaural signals from microphone array recordings at a remote location, a spherical microphone array is generally used for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Naoto Iijima , Shoichi Koyama , Hiroshi Saruwatari

This study describes a binaural machine hearing system that is capable of performing auditory stream segregation in scenarios where multiple sound sources are present. The process of stream segregation refers to the capability of human…

Sound · Computer Science 2016-06-27 Christopher Schymura , Thomas Walther , Dorothea Kolossa

Spatial audio is an essential medium to audiences for 3D visual and auditory experience. However, the recording devices and techniques are expensive or inaccessible to the general public. In this work, we propose a self-supervised audio…

Sound · Computer Science 2019-05-15 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

Smart glasses are increasingly recognized as a key medium for augmented reality, offering a hands-free platform with integrated microphones and non-ear-occluding loudspeakers to seamlessly mix virtual sound sources into the real-world…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-24 Thomas Deppisch , Nils Meyer-Kahlen , Sebastià V. Amengual Garí

Auditory perception involves cues in the monaural auditory pathways as well as binaural cues based on differences between the ears. So far auditory models have often focused on either monaural or binaural experiments in isolation. Although…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-24 Thomas Biberger , Stephan D. Ewert

The capture and reproduction of spatial audio is becoming increasingly popular, with the mushrooming of applications in teleconferencing, entertainment and virtual reality. Many binaural reproduction methods have been developed and studied…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-27 Ami Berger , Vladimir Tourbabin , Jacob Donley , Zamir Ben-Hur , Boaz Rafaely

Encoding more information into wave fields is a central goal in imaging, communication, and wave control. Optical holography benefits from polarization multiplexing, but acoustic holography remains largely limited to pressure-only encoding…

Applied Physics · Physics 2026-04-28 Yuan Tian , Hao Ge , Jiangpo Zheng , Xiujuan Zhang , Ming-Hui Lu , Yan-Feng Chen

To improve sound quality in hearing devices, the hearing device output should be appropriately equalized. To achieve optimal individualized equalization typically requires knowledge of all transfer functions between the source, the hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Henning Schepker , Reinhild Rohden , Florian Denk , Birger Kollmeier , Matthias Blau , Simon Doclo

A primary challenge in developing synthetic spatial hearing systems, particularly underwater, is accurately modeling sound scattering. Biological organisms achieve 3D spatial hearing by exploiting sound scattering off their bodies to…

Sound · Computer Science 2026-03-03 Siminfar Samakoush Galougah , Pranav Pulijala , Ramani Duraiswami

We report 3D-printed acoustic holographic lenses for the formation of ultrasonic fields of complex spatial distribution inside the skull. Using holographic lenses, we experimentally, numerically and theoretically produce acoustic beams…

Spherical Harmonics ROOM), an open-source Python library for room acoustics simulation using Ambisonics, available at https://github.com/Yhonatangayer/shroom and installable via \texttt{pip install pyshroom}. \textbf{shroom} projects…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Yhonatan Gayer

The paper presents results from a project aiming to create horizontally distributed surround sound sources and virtual sound images as auditory BCI (aBCI) stimuli. The purpose is to create evoked brain wave response patterns depending on…

Human-Computer Interaction · Computer Science 2012-10-11 Nozomu Nishikawa , Yoshihiro Matsumoto , Shoji Makino , Tomasz M. Rutkowski