English
Related papers

Related papers: Lightweight and Optimized Sound Source Localizatio…

200 papers

The task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding. Despite advancements in state-of-the-art (SOTA) models,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xavier Juanola , Gloria Haro , Magdalena Fuentes

This paper investigates the joint localization, detection, and tracking of sound events using a convolutional recurrent neural network (CRNN). We use a CRNN previously proposed for the localization and detection of stationary sources, and…

Sound · Computer Science 2019-04-30 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

This paper proposes a fully automated method for recovering the location of a source and medium parameters in shallow waters. The scenario involves an unknown source emitting low-frequency sound waves in a shallow water environment, and a…

Sound · Computer Science 2023-07-31 Angèle Niclas , Josselin Garnier

This paper describes a sound source localization (SSL) technique that combines an $\alpha$-stable model for the observed signal with a neural network-based approach for modeling steering vectors. Specifically, a physics-informed neural…

Having accurate localization capabilities is one of the fundamental requirements of autonomous robots. For underwater vehicles, the choices for effective localization are limited due to limitations of GPS use in water and poor environmental…

Robotics · Computer Science 2022-10-04 Akshay Hinduja , Yunsik Ohm , Jiahe Liao , Carmel Majidi , Michael Kaess

To achieve human-like behaviour during speech interactions, it is necessary for a humanoid robot to estimate the location of a human talker. Here, we present a method to optimize the parameters used for the direction of arrival (DOA)…

Robotics · Computer Science 2023-07-25 Pranav Barot , Katja Mombaur , Ewen MacDonald

In many signal processing applications, metadata may be advantageously used in conjunction with a high dimensional signal to produce a desired output. In the case of classical Sound Source Localization (SSL) algorithms, information from a…

Sound · Computer Science 2023-08-09 Eric Grinstein , Vincent W. Neo , Patrick A. Naylor

We present a system for localizing sound sources in a room with several ad-hoc microphone arrays. Each circular array performs direction of arrival (DOA) estimation independently using commercial software. The DOAs are fed to a fusion…

Multiple microphone arrays have many applications in robot audition, including sound source localization, audio scene perception and analysis, etc. However, accurate calibration of multiple microphone arrays remains a challenge because…

Robotics · Computer Science 2022-10-12 Yuanzheng He , Jiang Wang , Daobilige Su , Kazuhiro Nakadai , Junfeng Wu , Shoudong Huang , Youfu Li , He Kong

Over the past few years, there has been a great deal of research on navigation tasks in indoor environments using deep reinforcement learning agents. Most of these tasks use only visual information in the form of first-person images to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Haru Kondoh , Asako Kanezaki

This paper introduces a new approach to sound source localization using head-related transfer function (HRTF) characteristics, which enable precise full-sphere localization from raw data. While previous research focused primarily on using…

Sound · Computer Science 2024-02-07 Gil Geva , Olivier Warusfel , Shlomo Dubnov , Tammuz Dubnov , Amir Amedi , Yacov Hel-Or

Learning to localize the sound source in videos without explicit annotations is a novel area of audio-visual research. Existing work in this area focuses on creating attention maps to capture the correlation between the two modalities to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Dennis Fedorishin , Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraju

Sound source localization (SSL) demonstrates remarkable results in controlled settings but struggles in real-world deployment due to dual imbalance challenges: intra-task imbalance arising from long-tailed direction-of-arrival (DoA)…

Sound · Computer Science 2026-01-27 Zexia Fan , Yu Chen , Qiquan Zhang , Kainan Chen , Xinyuan Qian

Underwater acoustic localization has traditionally been challenging due to the presence of unknown environmental structure and dynamic conditions. The problem is richer still when such structure includes occlusion, which causes the loss of…

Signal Processing · Electrical Eng. & Systems 2023-02-06 Amir Weiss , Toros Arikan , Hari Vishnu , Grant B. Deane , Andrew C. Singer , Gregory W. Wornell

Asynchronous microphone array calibration is a prerequisite for many audition robot applications. A popular solution to the above calibration problem is the batch form of Simultaneous Localisation and Mapping (SLAM), using the time…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-02 Chengjie Zhang , Jiang Wang , He Kong

This purpose of this paper is to locate a single localized source from three range measurements with multiplicative noises. Although some minimization approaches for additive noise have been found, studies on the existence of solutions are…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Kiwoon Kwon

Multi-source localization is an important and challenging technique for multi-talker conversation analysis. This paper proposes a novel supervised learning method using deep neural networks to estimate the direction of arrival (DOA) of all…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Aswin Shanmugam Subramanian , Chao Weng , Shinji Watanabe , Meng Yu , Dong Yu

This paper addresses the problem of localizing audio sources using binaural measurements. We propose a supervised formulation that simultaneously localizes multiple sources at different locations. The approach is intrinsically efficient…

Sound · Computer Science 2016-04-18 Antoine Deleforge , Radu Horaud , Yoav Schechner , Laurent Girin

Humans can easily perceive the direction of sound sources in a visual scene, termed sound source localization. Recent studies on learning-based sound source localization have mainly explored the problem from a localization perspective.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Arda Senocak , Hyeonggon Ryu , Junsik Kim , Tae-Hyun Oh , Hanspeter Pfister , Joon Son Chung

Realizing relative localization by leveraging inter-robot local measurements is a challenging problem, especially in the presence of measurement noise. Motivated by this challenge, in this paper we propose a novel and systematic 3-D…

Robotics · Computer Science 2026-04-03 Chenyang Liang , Liangming Chen , Baoyi Cui , Jie Mei