English
Related papers

Related papers: Deep Neural Networks for Multiple Speaker Detectio…

200 papers

The increasing deployment of large antenna arrays at base stations has significantly improved the spatial resolution and localization accuracy of radio-localization methods. However, traditional signal processing techniques struggle in…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Baptiste Chatelier , Vincent Corlay , Musa Furkan Keskin , Matthieu Crussière , Henk Wymeersch , Luc Le Magoarou

Subjective evaluations are critical for assessing the perceptual realism of sounds in audio-synthesis driven technologies like augmented and virtual reality. However, they are challenging to set up, fatiguing for users, and expensive. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-22 Pranay Manocha , Anurag Kumar , Buye Xu , Anjali Menon , Israel D. Gebru , Vamsi K. Ithapu , Paul Calamia

Audio-visual sound source localization task aims to spatially localize sound-making objects within visual scenes by integrating visual and audio cues. However, existing methods struggle with accurately localizing sound-making objects in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Sung Jin Um , Dongjin Kim , Sangmin Lee , Jung Uk Kim

We propose a machine-learning-based technique to determine the number density of radio sources as a function of their flux density, for use in next-generation radio surveys. The method uses a convolutional neural network trained on…

Instrumentation and Methods for Astrophysics · Physics 2024-01-17 Elisa Todarello , Andre Scaffidi , Marco Regis , Marco Taoso

We present a unified model capable of simultaneously grounding both spoken language and non-speech sounds within a visual scene, addressing key limitations in current audio-visual grounding models. Existing approaches are typically limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hyeonggon Ryu , Seongyu Kim , Joon Son Chung , Arda Senocak

Visual perception is an effective way to obtain the spatial characteristics of wireless channels and to reduce the overhead for communications system. A critical problem for the visual assistance is that the communications system needs to…

Signal Processing · Electrical Eng. & Systems 2024-12-17 Weihua Xu , Feifei Gao , Yong Zhang , Chengkang Pan , Guangyi Liu

The goal of the multi-sound source localization task is to localize sound sources from the mixture individually. While recent multi-sound source localization methods have shown improved performance, they face challenges due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Dongjin Kim , Sung Jin Um , Sangmin Lee , Jung Uk Kim

In this paper, we present a deep neural network-based online multi-speaker localisation algorithm. Following the W-disjoint orthogonality principle in the spectral domain, each time-frequency (TF) bin is dominated by a single speaker, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Hodaya Hammer , Shlomo E. Chazan , Jacob Goldberger , Sharon Gannot

Room geometry inference algorithms rely on the localization of acoustic reflectors to identify boundary surfaces of an enclosure. Rooms with highly absorptive walls or walls at large distances from the measurement setup pose challenges for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-12 H. Nazim Bicer , Cagdas Tuna , Andreas Walther , Emanuël A. P. Habets

Estimation of the location of sound sources is usually done using microphone arrays. Such settings provide an environment where we know the difference between the received signals among different microphones in the terms of phase or…

Sound · Computer Science 2026-01-08 Helena Peic Tukuljac , Herve Lissek , Pierre Vandergheynst

We propose a spatial diffuseness feature for deep neural network (DNN)-based automatic speech recognition to improve recognition accuracy in reverberant and noisy environments. The feature is computed in real-time from multiple microphone…

Computation and Language · Computer Science 2015-09-02 Andreas Schwarz , Christian Huemmer , Roland Maas , Walter Kellermann

Most of the prior studies in the spatial \ac{DoA} domain focus on a single modality. However, humans use auditory and visual senses to detect the presence of sound sources. With this motivation, we propose to use neural networks with audio…

Sound · Computer Science 2021-05-14 Xinyuan Qian , Maulik Madhavi , Zexu Pan , Jiadong Wang , Haizhou Li

Speech data collected in real-world scenarios often encounters two issues. First, multiple sources may exist simultaneously, and the number of sources may vary with time. Second, the existence of background noise in recording is inevitable.…

Sound · Computer Science 2020-05-21 Yuan-Kuei Wu , Chao-I Tuan , Hung-yi Lee , Yu Tsao

A method for sound field decomposition based on neural networks is proposed. The method comprises two stages: a sound field separation stage and a single-source localization stage. In the first stage, the sound pressure at microphones…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-14 Ryo Matsuda , Makoto Otani

Source localization is the process of estimating the location of signal sources based on the signals received at different antennas of an antenna array. It has diverse applications, ranging from radar systems and underwater acoustics to…

Signal Processing · Electrical Eng. & Systems 2024-02-13 Parisa Ramezani , Özlem Tuğfe Demir , Emil Björnson

Hearing aids are typically equipped with multiple microphones to exploit spatial information for source localisation and speech enhancement. Especially for hearing aids, a good source localisation is important: it not only guides source…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Siyuan Song , Stijn Kindt , Jasper Maes , Alexander Bohlender. Nilesh Madhu

This paper presents a robust multi-channel speaker extraction algorithm designed to handle inaccuracies in reference information. While existing approaches often rely solely on either spatial or spectral cues to identify the target speaker,…

Sound · Computer Science 2025-12-24 Aviad Eisenberg , Sharon Gannot , Shlomo E. Chazan

The identification of sound sources is a common problem in acoustics. Different parameters are sought, among these are signal and position of the sources. We present an adjoint-based approach for sound source identification, which employs…

Sound · Computer Science 2023-01-23 Mathias Lemke , Lewin Stein

In this paper we consider the problem of localizing a set of broadband sources from a finite window of measurements. In the case of narrowband sources this can be reduced to the problem of spectral line estimation, where our goal is simply…

Signal Processing · Electrical Eng. & Systems 2022-10-24 Coleman DeLude , Rakshith Sharma , Santhosh Karnik , Christopher Hood , Mark Davenport , Justin Romberg

In cluttered environments where visual sensors encounter heavy occlusion, such as in agricultural settings, tactile signals can provide crucial spatial information for the robot to locate rigid objects and maneuver around them. We introduce…

Robotics · Computer Science 2024-12-16 Moonyoung Lee , Uksang Yoo , Jean Oh , Jeffrey Ichnowski , George Kantor , Oliver Kroemer