English
Related papers

Related papers: CoLoC: Conditioned Localizer and Classifier for So…

200 papers

Sound event detection and sound event localization requires different features from audio input signals. While sound event detection mainly relies on time-frequency patterns to distinguish different event classes, sound event localization…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-27 T. N. T. Nguyen , D. L. Jones , R. Ranjan , S. Jayabalan , W. S. Gan

While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perceptible source objects, e.g., sounds of footsteps come from…

Sound event localization and detection is a novel area of research that emerged from the combined interest of analyzing the acoustic scene in terms of the spatial and temporal activity of sounds of interest. This paper presents an overview…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-12 Archontis Politis , Annamaria Mesaros , Sharath Adavanne , Toni Heittola , Tuomas Virtanen

Sound event detection (SED) is a task to detect sound events in an audio recording. One challenge of the SED task is that many datasets such as the Detection and Classification of Acoustic Scenes and Events (DCASE) datasets are weakly…

Sound · Computer Science 2020-08-25 Qiuqiang Kong , Yong Xu , Wenwu Wang , Mark D. Plumbley

Sound event localization and detection (SELD) is a combined task of identifying the sound event and its direction. Deep neural networks (DNNs) are utilized to associate them with the sound signals observed by a microphone array. Although…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Kento Nagatomo , Masahiro Yasuda , Kohei Yatabe , Shoichiro Saito , Yasuhiro Oikawa

This paper proposes sound event localization and detection methods from multichannel recording. The proposed system is based on two Convolutional Recurrent Neural Networks (CRNNs) to perform sound event detection (SED) and time difference…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-23 Francois Grondin , James Glass , Iwona Sobieraj , Mark D. Plumbley

This technical report outlines our approach to Task 3A of the Detection and Classification of Acoustic Scenes and Events (DCASE) 2024, focusing on Sound Event Localization and Detection (SELD). SELD provides valuable insights by estimating…

Sound · Computer Science 2025-07-25 Quoc Thinh Vo , David Han

Polyphonic sound event localization and detection (SELD) has many practical applications in acoustic sensing and monitoring. However, the development of real-time SELD has been limited by the demanding computational requirement of most…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Thi Ngoc Tho Nguyen , Douglas L. Jones , Karn N. Watcharasupat , Huy Phan , Woon-Seng Gan

This paper describes that semi-supervised learning called peer collaborative learning (PCL) can be applied to the polyphonic sound event detection (PSED) task, which is one of the tasks in the Detection and Classification of Acoustic Scenes…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Hayato Endo , Hiromitsu Nishizaki

This technical report details our systems submitted for Task 3 of the DCASE 2024 Challenge: Audio and Audiovisual Sound Event Localization and Detection (SELD) with Source Distance Estimation (SDE). We address only the audio-only SELD with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Jun Wei Yeow , Ee-Leng Tan , Jisheng Bai , Santi Peksi , Woon-Seng Gan

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Cagdas Bilen , Giacomo Ferroni , Francesco Tuveri , Juan Azcarreta , Sacha Krstulovic

Audio event localization and detection (SELD) have been commonly tackled using multitask models. Such a model usually consists of a multi-label event classification branch with sigmoid cross-entropy loss for event activity detection and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-14 Huy Phan , Lam Pham , Philipp Koch , Ngoc Q. K. Duong , Ian McLoughlin , Alfred Mertins

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Sound Event Localization and Detection refers to the problem of identifying the presence of independent or temporally-overlapped sound sources, correctly identifying to which sound class it belongs, estimating their spatial directions while…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Daniel Arteaga , Andrés Pérez-López

Polyphonic sound event localization and detection (SELD), which jointly performs sound event detection (SED) and direction-of-arrival (DoA) estimation, detects the type and occurrence time of sound events as well as their corresponding DoA…

Sound · Computer Science 2021-02-12 Yin Cao , Turab Iqbal , Qiuqiang Kong , Fengyan An , Wenwu Wang , Mark D. Plumbley

In recent years, Event Sound Source Localization has been widely applied in various fields. Recent works typically relying on the contrastive learning framework show impressive performance. However, all work is based on large relatively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yue Li , Baiqiao Yin , Jinfu Liu , Jiajun Wen , Jiaying Lin , Mengyuan Liu

This report proposes an improved method for the Temporal Sound Localisation (TSL) task, which localizes and classifies the sound events occurring in the video according to a predefined set of sound classes. The champion solution from last…

Sound · Computer Science 2024-10-01 Haowei Gu , Weihao Zhu , Yang Yang

Sound event detection (SED) is the task of identifying sound events along with their onset and offset times. A recent, convolutional neural networks based SED method, proposed the usage of depthwise separable (DWS) and time-dilated…

Sound · Computer Science 2020-07-13 Konstantinos Drossos , Stylianos I. Mimilakis , Tuomas Virtanen

In this paper, we propose a novel four-stage data augmentation approach to ResNet-Conformer based acoustic modeling for sound event localization and detection (SELD). First, we explore two spatial augmentation techniques, namely audio…

Sound · Computer Science 2023-03-08 Qing Wang , Jun Du , Hua-Xin Wu , Jia Pan , Feng Ma , Chin-Hui Lee

Speech separation is the process of separating multiple speakers from an audio recording. In this work we propose to separate the sources using a Speaker LOcalization Guided Deflation (SLOGD) approach wherein we estimate the sources…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-25 Sunit Sivasankaran , Emmanuel Vincent , Dominique Fohr