English
Related papers

Related papers: Multi-Sound-Source Localization Using Machine Lear…

200 papers

We propose to use neural networks for simultaneous detection and localization of multiple sound sources in human-robot interaction. In contrast to conventional signal processing techniques, neural network-based sound source localization…

Sound · Computer Science 2018-09-18 Weipeng He , Petr Motlicek , Jean-Marc Odobez

Sound source localization in visual scenes aims to localize objects emitting the sound in a given image. Recent works showing impressive localization performance typically rely on the contrastive learning framework. However, the random…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Zengjie Song , Yuxi Wang , Junsong Fan , Tieniu Tan , Zhaoxiang Zhang

Visual events are usually accompanied by sounds in our daily lives. We pose the question: Can the machine learn the correspondence between visual scene and the sound, and localize the sound source only by observing sound and visual scene…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Arda Senocak , Tae-Hyun Oh , Junsik Kim , Ming-Hsuan Yang , In So Kweon

Sound source localization (SSL) is the task of locating the source of sound within an image. Due to the lack of localization labels, the de facto standard in SSL has been to represent an image and audio as a single embedding vector each,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Inho Kim , Youngkil Song , Jicheol Park , Won Hwa Kim , Suha Kwak

The task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding. Despite advancements in state-of-the-art (SOTA) models,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xavier Juanola , Gloria Haro , Magdalena Fuentes

In many signal processing applications, metadata may be advantageously used in conjunction with a high dimensional signal to produce a desired output. In the case of classical Sound Source Localization (SSL) algorithms, information from a…

Sound · Computer Science 2023-08-09 Eric Grinstein , Vincent W. Neo , Patrick A. Naylor

Conventional speaker localization algorithms, based merely on the received microphone signals, are often sensitive to adverse conditions, such as: high reverberation or low signal to noise ratio (SNR). In some scenarios, e.g. in meeting…

Sound · Computer Science 2015-08-14 Bracha Laufer-Goldshtein , Ronen Talmon , Sharon Gannot

Acoustic indoor localization offers the potential for highly accurate position estimation while generally exhibiting low hardware requirements compared to Radio Frequency (RF)-based solutions. Furthermore, angular-based localization…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-19 Georg K. J. Fischer , Thomas Schaechtle , Moritz Schabinger , Alexander Richter , Ivo Häring , Fabian Höflinger , Stefan J. Rupitsch

Accurately estimating sound source positions is crucial for robot audition. However, existing sound source localization methods typically rely on a microphone array with at least two spatially preconfigured microphones. This requirement…

Robotics · Computer Science 2025-06-23 Jiang Wang , Runwu Shi , Benjamin Yen , He Kong , Kazuhiro Nakadai

Human-robot interaction in natural settings requires filtering out the different sources of sounds from the environment. Such ability usually involves the use of microphone arrays to localize, track and separate sound sources online.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-04 Francois Grondin , Francois Michaud

This paper presents a sound source localization strategy that relies on a microphone array embedded in an unmanned ground vehicle and an asynchronous close-talking microphone near the operator. A signal coarse alignment strategy is combined…

Robotics · Computer Science 2025-07-30 Victor Liu , Timothy Du , Jordy Sehn , Jack Collier , François Grondin

Sound source localization (SSL) technology plays a crucial role in various application areas such as fault diagnosis, speech separation, and vibration noise reduction. Although beamforming algorithms are widely used in SSL, their resolution…

Sound · Computer Science 2024-10-01 Wenbo Ma , Yan Lu , Yijun Liu

Accurately localizing 3D sound sources and estimating their semantic labels -- where the sources may not be visible, but are assumed to lie on the physical surface of objects in the scene -- have many real applications, including detecting…

Sound · Computer Science 2024-12-31 Yuhang He , Sangyun Shin , Anoop Cherian , Niki Trigoni , Andrew Markham

Audio-visual sound source localization task aims to spatially localize sound-making objects within visual scenes by integrating visual and audio cues. However, existing methods struggle with accurately localizing sound-making objects in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Sung Jin Um , Dongjin Kim , Sangmin Lee , Jung Uk Kim

This paper presents a novel approach for indoor acoustic source localization using microphone arrays and based on a Convolutional Neural Network (CNN). The proposed solution is, to the best of our knowledge, the first published work in…

Sound · Computer Science 2019-02-01 Juan Manuel Vera-Diaz , Daniel Pizarro , Javier Macias-Guarasa

This article is a survey on deep learning methods for single and multiple sound source localization. We are particularly interested in sound source localization in indoor/domestic environment, where reverberation and diffuse noise are…

Sound · Computer Science 2022-07-20 Pierre-Amaury Grumiaux , Srđan Kitić , Laurent Girin , Alexandre Guérin

The problem of source localization with ad hoc microphone networks in noisy and reverberant enclosures, given a training set of prerecorded measurements, is addressed in this paper. The training set is assumed to consist of a limited number…

Sound · Computer Science 2016-10-18 Bracha Laufer-Goldshtein , Ronen Talmon , Sharon Gannot

Accurate indoor positioning for unmanned aerial vehicles (UAVs) is critical for logistics, surveillance, and emergency response applications, particularly in GPS-denied environments. Existing indoor localization methods, including optical…

Signal Processing · Electrical Eng. & Systems 2025-05-28 Cunyi Yin , Chenwei Wang , Jing Chen , Hao Jiang , Xiren Miao , Shaocong Zheng Zhenghua Chen Senior , Hong Yan

Multi-rotor aerial autonomous vehicles (MAVs) primarily rely on vision for navigation purposes. However, visual localization and odometry techniques suffer from poor performance in low or direct sunlight, a limited field of view, and…

Robotics · Computer Science 2024-03-01 Gabriele Serussi , Tamir Shor , Tom Hirshberg , Chaim Baskin , Alex Bronstein

Recent data- and learning-based sound source localization (SSL) methods have shown strong performance in challenging acoustic scenarios. However, little work has been done on adapting such methods to track consistently multiple sources…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 David Diaz-Guerra , Archontis Politis , Tuomas Virtanen