English
Related papers

Related papers: Spatial and Semantic Embedding Integration for Ste…

200 papers

In this study, we address the multimodal task of stereo sound event localization and detection with source distance estimation (3D SELD) in regular video content. 3D SELD is a complex task that combines temporal event classification with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-09 Davide Berghi , Philip J. B. Jackson

This technical report presents our submission to Task 3 of the DCASE 2025 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. We address the audio-only task in this report and introduce several key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Jun-Wei Yeow , Ee-Leng Tan , Santi Peksi , Woon-Seng Gan

Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only problem, but visual information has been recently included.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Davide Berghi , Peipei Wu , Jinzheng Zhao , Wenwu Wang , Philip J. B. Jackson

This paper presents the objective, dataset, baseline, and metrics of Task 3 of the DCASE2025 Challenge on sound event localization and detection (SELD). In previous editions, the challenge used four-channel audio formats of first-order…

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

Sound · Computer Science 2025-07-31 Hogeon Yu

This study presents an audio-visual information fusion approach to sound event localization and detection (SELD) in low-resource scenarios. We aim at utilizing audio and video modality information through cross-modal learning and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Ya Jiang , Qing Wang , Jun Du , Maocheng Hu , Pengfei Hu , Zeyan Liu , Shi Cheng , Zhaoxu Nian , Yuxuan Dong , Mingqi Cai , Xin Fang , Chin-Hui Lee

Sound Event Detection and Localization (SELD) is a combined task of identifying sound events and their corresponding direction-of-arrival (DOA). While this task has numerous applications and has been extensively researched in recent years,…

Sound · Computer Science 2024-06-13 Daniel Aleksander Krause , Archontis Politis , Annamaria Mesaros

Sound Event Detection and Localization (SELD) constitutes a complex task that depends on extensive multichannel audio recordings with annotated sound events and their respective locations. In this paper, we introduce a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Orlem Lima dos Santos , Karen Rosero , Roberto de Alencar Lotufo

Sound event localization and detection (SELD) is a joint task of sound event detection and direction-of-arrival estimation. In DCASE 2022 Task 3, types of data transform from computationally generated spatial recordings to recordings of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-12 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments…

Sound · Computer Science 2026-02-02 Xueping Zhang , Yaxiong Chen , Ruilin Yao , Yunfei Zi , Shengwu Xiong

This paper presents the sound event localization and detection (SELD) task setup for the DCASE 2019 challenge. The goal of the SELD task is to detect the temporal activities of a known set of sound event classes, and further localize them…

Sound · Computer Science 2019-05-27 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

Environment shifts and conflicts present significant challenges for learning-based sound event localization and detection (SELD) methods. SELD systems, when trained in particular acoustic settings, often show restricted generalization…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

Sound event localization and detection (SELD) is an emerging research topic that aims to unify the tasks of sound event detection and direction-of-arrival estimation. As a result, SELD inherits the challenges of both tasks, such as noise,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Zhen Jian Lee , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

This technical report details our systems submitted for Task 3 of the DCASE 2024 Challenge: Audio and Audiovisual Sound Event Localization and Detection (SELD) with Source Distance Estimation (SDE). We address only the audio-only SELD with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Jun Wei Yeow , Ee-Leng Tan , Jisheng Bai , Santi Peksi , Woon-Seng Gan

This report presents the dataset and the evaluation setup of the Sound Event Localization & Detection (SELD) task for the DCASE 2020 Challenge. The SELD task refers to the problem of trying to simultaneously classify a known set of sound…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-30 Archontis Politis , Sharath Adavanne , Tuomas Virtanen

In traditional sound event localization and detection (SELD) tasks, the focus is typically on sound event detection (SED) and direction-of-arrival (DOA) estimation, but they fall short of providing full spatial information about the sound…

Sound · Computer Science 2025-01-22 Yuxuan Dong , Qing Wang , Hengyi Hong , Ya Jiang , Shi Cheng

For learning-based sound event localization and detection (SELD) methods, different acoustic environments in the training and test sets may result in large performance differences in the validation and evaluation stages. Different…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Jinbo Hu , Yin Cao , Ming Wu , Feiran Yang , Ziying Yu , Wenwu Wang , Mark D. Plumbley , Jun Yang

This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by merging both audio…

Sound · Computer Science 2024-01-31 Adrian S. Roman , Baladithya Balamurugan , Rithik Pothuganti

Sound event localization and detection with distance estimation (3D SELD) in video involves identifying active sound events at each time frame while estimating their spatial coordinates. This multimodal task requires joint reasoning across…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Davide Berghi , Philip J. B. Jackson

Pre-training methods have achieved significant performance improvements in sound event localization and detection (SELD) tasks, but existing Transformer-based models suffer from high computational complexity. In this work, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Wenmiao Gao , Yang Xiao
‹ Prev 1 2 3 10 Next ›