English
Related papers

Related papers: Sound Event Detection and Localization with Distan…

200 papers

This report presents the dataset and the evaluation setup of the Sound Event Localization & Detection (SELD) task for the DCASE 2020 Challenge. The SELD task refers to the problem of trying to simultaneously classify a known set of sound…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-30 Archontis Politis , Sharath Adavanne , Tuomas Virtanen

Sound event localisation and detection (SELD) is a problem in the field of automatic listening that aims at the temporal detection and localisation (direction of arrival estimation) of sound events within an audio clip, usually of long…

In this paper, we propose a convolutional recurrent neural network for joint sound event localization and detection (SELD) of multiple overlapping sound events in three-dimensional (3D) space. The proposed network takes a sequence of…

Sound · Computer Science 2018-12-18 Sharath Adavanne , Archontis Politis , Joonas Nikunen , Tuomas Virtanen

We aim to perform sound event localization and detection (SELD) using wearable equipment for a moving human, such as a pedestrian. Conventional SELD tasks have dealt only with microphone arrays located in static positions. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Masahiro Yasuda , Shoichiro Saito , Akira Nakayama , Noboru Harada

This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by merging both audio…

Sound · Computer Science 2024-01-31 Adrian S. Roman , Baladithya Balamurugan , Rithik Pothuganti

Sound event detection (SED) and localization refer to recognizing sound events and estimating their spatial and temporal locations. Using neural networks has become the prevailing method for SED. In the area of sound localization, which is…

Sound · Computer Science 2019-11-06 Yin Cao , Qiuqiang Kong , Turab Iqbal , Fengyan An , Wenwu Wang , Mark D. Plumbley

DNN-based methods have shown high performance in sound event localization and detection(SELD). While in real spatial sound scenes, reverberation and the imbalanced presence of various sound events increase the complexity of the SELD task.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-18 Siwei Huang , Jianfeng Chen , Jisheng Bai , Yafei Jia , Dongzhe Zhang

This technical report details our systems submitted for Task 3 of the DCASE 2024 Challenge: Audio and Audiovisual Sound Event Localization and Detection (SELD) with Source Distance Estimation (SDE). We address only the audio-only SELD with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Jun Wei Yeow , Ee-Leng Tan , Jisheng Bai , Santi Peksi , Woon-Seng Gan

Sound event localization and detection (SELD) combines the identification of sound events with the corresponding directions of arrival (DOA). Recently, event-oriented track output formats have been adopted to solve this problem; however,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-11 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Sung Won Han

Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only problem, but visual information has been recently included.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Davide Berghi , Peipei Wu , Jinzheng Zhao , Wenwu Wang , Philip J. B. Jackson

Polyphonic sound event localization and detection (SELD), which jointly performs sound event detection (SED) and direction-of-arrival (DoA) estimation, detects the type and occurrence time of sound events as well as their corresponding DoA…

Sound · Computer Science 2021-02-12 Yin Cao , Turab Iqbal , Qiuqiang Kong , Fengyan An , Wenwu Wang , Mark D. Plumbley

Sound event localization and detection (SELD) is a combined task of identifying the sound event and its direction. Deep neural networks (DNNs) are utilized to associate them with the sound signals observed by a microphone array. Although…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Kento Nagatomo , Masahiro Yasuda , Kohei Yatabe , Shoichiro Saito , Yasuhiro Oikawa

Sound event localization and detection with source distance estimation (3D SELD) involves not only identifying the sound category and its direction-of-arrival (DOA) but also predicting the source's distance, aiming to provide full…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-22 Hengyi Hong , Qing Wang , Jun Du , Ruoyu Wei , Mingqi Cai , Xin Fang

Sound Event Localization and Detection (SELD) is a problem related to the field of machine listening whose objective is to recognize individual sound events, detect their temporal activity, and estimate their spatial location. Thanks to the…

This study presents an audio-visual information fusion approach to sound event localization and detection (SELD) in low-resource scenarios. We aim at utilizing audio and video modality information through cross-modal learning and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Ya Jiang , Qing Wang , Jun Du , Maocheng Hu , Pengfei Hu , Zeyan Liu , Shi Cheng , Zhaoxu Nian , Yuxuan Dong , Mingqi Cai , Xin Fang , Chin-Hui Lee

Polyphonic Sound Event Detection (SED) in real-world recordings is a challenging task because of the dynamic polyphony level, intensity, and duration of sound events. Current polyphonic SED systems fail to model the temporal structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-02 Arjun Pankajakshan , Helen L. Bear , Emmanouil Benetos

Sound event localization and detection with distance estimation (3D SELD) in video involves identifying active sound events at each time frame while estimating their spatial coordinates. This multimodal task requires joint reasoning across…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Davide Berghi , Philip J. B. Jackson

Sound event localization and detection (SELD) consists of two subtasks, which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Ngoc Khanh Nguyen , Douglas L. Jones , Woon-Seng Gan

This paper describes sound event localization and detection (SELD) for spatial audio recordings captured by firstorder ambisonics (FOA) microphones. In this task, one may train a deep neural network (DNN) using FOA data annotated with the…

Sound · Computer Science 2024-10-31 Yoto Fujita , Yoshiaki Bando , Keisuke Imoto , Masaki Onishi , Kazuyoshi Yoshii

Joint sound event localization and detection (SELD) is an integral part of developing context awareness into communication interfaces of mobile robots, smartphones, and home assistants. For example, an automatic audio focus for video…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-29 Pasi Pertilä , Emre Cakir , Aapo Hakala , Eemi Fagerlund , Tuomas Virtanen , Archontis Politis , Antti Eronen