English
Related papers

Related papers: Zero- and Few-shot Sound Event Localization and De…

200 papers

While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perceptible source objects, e.g., sounds of footsteps come from…

In traditional sound event localization and detection (SELD) tasks, the focus is typically on sound event detection (SED) and direction-of-arrival (DOA) estimation, but they fall short of providing full spatial information about the sound…

Sound · Computer Science 2025-01-22 Yuxuan Dong , Qing Wang , Hengyi Hong , Ya Jiang , Shi Cheng

This paper presents the objective, dataset, baseline, and metrics of Task 3 of the DCASE2025 Challenge on sound event localization and detection (SELD). In previous editions, the challenge used four-channel audio formats of first-order…

This paper presents the sound event localization and detection (SELD) task setup for the DCASE 2019 challenge. The goal of the SELD task is to detect the temporal activities of a known set of sound event classes, and further localize them…

Sound · Computer Science 2019-05-27 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

Sound Event Detection and Localization (SELD) constitutes a complex task that depends on extensive multichannel audio recordings with annotated sound events and their respective locations. In this paper, we introduce a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Orlem Lima dos Santos , Karen Rosero , Roberto de Alencar Lotufo

Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge.…

Sound · Computer Science 2022-05-27 Chendong Zhao , Jianzong Wang , Leilai Li , Xiaoyang Qu , Jing Xiao

In this paper, we describe our method for DCASE2019 task3: Sound Event Localization and Detection (SELD). We use four CRNN SELDnet-like single output models which run in a consecutive manner to recover all possible information of occurring…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Sławomir Kapka , Mateusz Lewandowski

Sound event detection (SED) and localization refer to recognizing sound events and estimating their spatial and temporal locations. Using neural networks has become the prevailing method for SED. In the area of sound localization, which is…

Sound · Computer Science 2019-11-06 Yin Cao , Qiuqiang Kong , Turab Iqbal , Fengyan An , Wenwu Wang , Mark D. Plumbley

We study few-shot acoustic event detection (AED) in this paper. Few-shot learning enables detection of new events with very limited labeled data. Compared to other research areas like computer vision, few-shot learning for audio recognition…

Machine Learning · Computer Science 2020-02-24 Bowen Shi , Ming Sun , Krishna C. Puvvada , Chieh-Chi Kao , Spyros Matsoukas , Chao Wang

Sound event localization and detection (SELD) is a task for the classification of sound events and the identification of direction of arrival (DoA) utilizing multichannel acoustic signals. For effective classification and localization, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-18 Yusun Shul , Dayun Choi , Jung-Woo Choi

Zero-shot learning models are capable of classifying new classes by transferring knowledge from the seen classes using auxiliary information. While most of the existing zero-shot learning methods focused on single-label classification…

Sound · Computer Science 2024-09-04 Duygu Dogan , Huang Xie , Toni Heittola , Tuomas Virtanen

Sound event localization and detection (SELD) is a joint task of sound event detection and direction-of-arrival estimation. In DCASE 2022 Task 3, types of data transform from computationally generated spatial recordings to recordings of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-12 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

Sound event localization and detection (SELD) involves predicting active sound event classes over time while estimating their positions. The localization subtask in SELD is usually treated as a direction of arrival estimation problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Davide Berghi , Philip J. B. Jackson

Sound event localization and detection (SELD) is an emerging research topic that aims to unify the tasks of sound event detection and direction-of-arrival estimation. As a result, SELD inherits the challenges of both tasks, such as noise,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Zhen Jian Lee , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

This paper proposes sound event localization and detection methods from multichannel recording. The proposed system is based on two Convolutional Recurrent Neural Networks (CRNNs) to perform sound event detection (SED) and time difference…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-23 Francois Grondin , James Glass , Iwona Sobieraj , Mark D. Plumbley

Pre-training methods have achieved significant performance improvements in sound event localization and detection (SELD) tasks, but existing Transformer-based models suffer from high computational complexity. In this work, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Wenmiao Gao , Yang Xiao

Audio event localization and detection (SELD) have been commonly tackled using multitask models. Such a model usually consists of a multi-label event classification branch with sigmoid cross-entropy loss for event activity detection and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-14 Huy Phan , Lam Pham , Philipp Koch , Ngoc Q. K. Duong , Ian McLoughlin , Alfred Mertins

This paper focuses on few-shot Sound Event Detection (SED), which aims to automatically recognize and classify sound events with limited samples. However, prevailing methods methods in few-shot SED predominantly rely on segment-level…

Sound · Computer Science 2024-03-20 Liang Zou , Genwei Yan , Ruoyu Wang , Jun Du , Meng Lei , Tian Gao , Xin Fang

State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated by neural networks…

Sound · Computer Science 2025-07-29 James Taylor , Wolfgang Mack

We propose a direction-of-arrival (DOA) estimation method for Sound Event Localization and Detection (SELD). Direct estimation of DOA using a deep neural network (DNN), i.e. completely-datadriven approach, achieves high accuracy. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Masahiro Yasuda , Yuma Koizumi , Shoichiro Saito , Hisashi Uematsu , Keisuke Imoto