English
Related papers

Related papers: PSELDNets: Pre-trained Neural Networks on a Large-…

200 papers

Sound Event Detection and Localization (SELD) constitutes a complex task that depends on extensive multichannel audio recordings with annotated sound events and their respective locations. In this paper, we introduce a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Orlem Lima dos Santos , Karen Rosero , Roberto de Alencar Lotufo

Sound event localization and detection (SELD) is a combined task of identifying the sound event and its direction. Deep neural networks (DNNs) are utilized to associate them with the sound signals observed by a microphone array. Although…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Kento Nagatomo , Masahiro Yasuda , Kohei Yatabe , Shoichiro Saito , Yasuhiro Oikawa

For learning-based sound event localization and detection (SELD) methods, different acoustic environments in the training and test sets may result in large performance differences in the validation and evaluation stages. Different…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Jinbo Hu , Yin Cao , Ming Wu , Feiran Yang , Ziying Yu , Wenwu Wang , Mark D. Plumbley , Jun Yang

DNN-based methods have shown high performance in sound event localization and detection(SELD). While in real spatial sound scenes, reverberation and the imbalanced presence of various sound events increase the complexity of the SELD task.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-18 Siwei Huang , Jianfeng Chen , Jisheng Bai , Yafei Jia , Dongzhe Zhang

Sound Event Localization and Detection (SELD) is a problem related to the field of machine listening whose objective is to recognize individual sound events, detect their temporal activity, and estimate their spatial location. Thanks to the…

Environment shifts and conflicts present significant challenges for learning-based sound event localization and detection (SELD) methods. SELD systems, when trained in particular acoustic settings, often show restricted generalization…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

This report presents our systems submitted to the audio-only and audio-visual tracks of the DCASE2025 Task 3 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. SELD is a complex task that combines…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Davide Berghi , Philip J. B. Jackson

Sound event detection (SED) is the task of identifying sound events along with their onset and offset times. A recent, convolutional neural networks based SED method, proposed the usage of depthwise separable (DWS) and time-dilated…

Sound · Computer Science 2020-07-13 Konstantinos Drossos , Stylianos I. Mimilakis , Tuomas Virtanen

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

Sound · Computer Science 2025-07-31 Hogeon Yu

Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments…

Sound · Computer Science 2026-02-02 Xueping Zhang , Yaxiong Chen , Ruilin Yao , Yunfei Zi , Shengwu Xiong

This paper presents the sound event localization and detection (SELD) task setup for the DCASE 2019 challenge. The goal of the SELD task is to detect the temporal activities of a known set of sound event classes, and further localize them…

Sound · Computer Science 2019-05-27 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

Pre-training methods have achieved significant performance improvements in sound event localization and detection (SELD) tasks, but existing Transformer-based models suffer from high computational complexity. In this work, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Wenmiao Gao , Yang Xiao

This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by merging both audio…

Sound · Computer Science 2024-01-31 Adrian S. Roman , Baladithya Balamurugan , Rithik Pothuganti

Polyphonic sound event detection and localization (SELD) task is challenging because it is difficult to jointly optimize sound event detection (SED) and direction-of-arrival (DOA) estimation in the same network. We propose a general network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Thi Ngoc Tho Nguyen , Ngoc Khanh Nguyen , Huy Phan , Lam Pham , Kenneth Ooi , Douglas L. Jones , Woon-Seng Gan

Performance of sound event localization and detection (SELD) in real scenes is limited by small size of SELD dataset, due to difficulty in obtaining sufficient amount of realistic multi-channel audio data recordings with accurate label. We…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Byeong-Yun Ko , Hyeonuk Nam , Seong-Hu Kim , Deokki Min , Seung-Deok Choi , Yong-Hwa Park

Pre-training methods have greatly improved the performance of sound event localization and detection (SELD). However, existing Transformer-based models still face high computational cost. To solve this problem, we present a stereo SELD…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-15 Wenmiao Gao , Han Yin

The understanding of the surrounding environment plays a critical role in autonomous robotic systems, such as self-driving cars. Extensive research has been carried out concerning visual perception. Yet, to obtain a more complete perception…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-13 Karim Guirguis , Christoph Schorn , Andre Guntoro , Sherif Abdulatif , Bin Yang

We present SELDVisualSynth, a tool for generating synthetic videos for audio-visual sound event localization and detection (SELD). Our approach incorporates real-world background images to improve realism in synthetic audio-visual SELD data…

Sound · Computer Science 2025-04-07 Adrian S. Roman , Aiden Chang , Gerardo Meza , Iran R. Roman

This report presents the dataset and baseline of Task 3 of the DCASE2021 Challenge on Sound Event Localization and Detection (SELD). The dataset is based on emulation of real recordings of static or moving sound events under real conditions…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Archontis Politis , Sharath Adavanne , Daniel Krause , Antoine Deleforge , Prerak Srivastava , Tuomas Virtanen

In this paper, we propose a novel formula-driven supervised learning (FDSL) framework for pre-training an environmental sound analysis model by leveraging acoustic signals parametrically synthesized through formula-driven methods.…

‹ Prev 1 2 3 10 Next ›