English
Related papers

Related papers: A Robust framework for sound event localization an…

200 papers

Deep learning systems have become increasingly energy- and computation-intensive, raising concerns about their environmental impact. As organizers of the Detection and Classification of Acoustic Scenes and Events (DCASE) challenge, we…

Sound · Computer Science 2024-09-16 Constance Douwes , Romain Serizel

Sound event localization and detection (SELD) has seen substantial advancements through learning-based methods. These systems, typically trained from scratch on specific datasets, have shown considerable generalization capabilities.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Jinbo Hu , Yin Cao , Ming Wu , Fang Kang , Feiran Yang , Wenwu Wang , Mark D. Plumbley , Jun Yang

Weakly Labelled learning has garnered lot of attention in recent years due to its potential to scale Sound Event Detection (SED) and is formulated as Multiple Instance Learning (MIL) problem. This paper proposes a Multi-Task Learning (MTL)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Soham Deshmukh , Bhiksha Raj , Rita Singh

Performing sound event detection on real-world recordings often implies dealing with overlapping target sound events and non-target sounds, also referred to as interference or noise. Until now these problems were mainly tackled at the…

Polyphonic sound event detection and direction-of-arrival estimation require different input features from audio signals. While sound event detection mainly relies on time-frequency patterns, direction-of-arrival estimation relies on…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Thi Ngoc Tho Nguyen , Douglas L. Jones , Woon-Seng Gan

Modern noise-cancelling headphones have significantly improved users' auditory experiences by removing unwanted background noise, but they can also block out sounds that matter to users. Machine learning (ML) models for sound event…

Machine Learning · Computer Science 2024-06-18 N Shashaank , Berker Banar , Mohammad Rasool Izadi , Jeremy Kemmerer , Shuo Zhang , Chuan-Che Huang

In this article, we describe Conditioned Localizer and Classifier (CoLoC) which is a novel solution for Sound Event Localization and Detection (SELD). The solution constitutes of two stages: the localization is done first and is followed by…

Sound · Computer Science 2022-10-26 Sławomir Kapka , Jakub Tkaczuk

Sound event detection (SED) methods typically rely on either strongly labelled data or weakly labelled data. As an alternative, sequentially labelled data (SLD) was proposed. In SLD, the events and the order of events in audio clips are…

Sound · Computer Science 2019-04-30 Yuanbo Hou , Qiuqiang Kong , Shengchen Li , Mark D. Plumbley

Sound source localization (SSL) is a critical technology for determining the position of sound sources in complex environments. However, existing methods face challenges such as high computational costs and precise calibration requirements,…

Sound · Computer Science 2025-05-28 Yiyuan Yang , Shitong Xu , Niki Trigoni , Andrew Markham

Polyphonic sound event localization and detection is not only detecting what sound events are happening but localizing corresponding sound sources. This series of tasks was first introduced in DCASE 2019 Task 3. In 2020, the sound event…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-02 Yin Cao , Turab Iqbal , Qiuqiang Kong , Yue Zhong , Wenwu Wang , Mark D. Plumbley

State-of-the-art sound event detection (SED) methods usually employ a series of convolutional neural networks (CNNs) to extract useful features from the input audio signal, and then recurrent neural networks (RNNs) to model longer temporal…

Event cameras offer a promising avenue for multi-view stereo depth estimation and Simultaneous Localization And Mapping (SLAM) due to their ability to detect blur-free 3D edges at high-speed and over broad illumination conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Diego Hitzges , Suman Ghosh , Guillermo Gallego

Sound event detection (SED) and acoustic scene classification (ASC) are important research topics in environmental sound analysis. Many research groups have addressed SED and ASC using neural-network-based methods, such as the convolutional…

Sound · Computer Science 2021-02-24 Noriyuki Tonami , Keisuke Imoto , Ryosuke Yamanishi , Yoichi Yamashita

Sound event localization and detection consists of two subtasks which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Thi Ngoc Tho Nguyen , Karn Watcharasupat , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

This report proposes a frequency dynamic convolution (FDY) with a large kernel attention (LKA)-convolutional recurrent neural network (CRNN) with a pre-trained bidirectional encoder representation from audio transformers (BEATs)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Ji Won Kim , Sang Won Son , Yoonah Song , Hong Kook Kim , Il Hoon Song , Jeong Eun Lim

We target the problem of developing new low-complexity networks for the sound event detection task. Our goal is to meticulously analyze the performance-complexity trade-off, aiming to be competitive with the large state-of-the-art models,…

Sound · Computer Science 2025-06-13 Tobias Morocutti , Florian Schmid , Jonathan Greif , Francesco Foscarin , Gerhard Widmer

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for…

Sound · Computer Science 2026-03-10 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

This report presents the Sony-TAu Realistic Spatial Soundscapes 2022 (STARS22) dataset for sound event localization and detection, comprised of spatial recordings of real scenes collected in various interiors of two different sites. The…

In this paper, we describe in detail our systems for DCASE 2020 Task 4. The systems are based on the 1st-place system of DCASE 2019 Task 4, which adopts weakly-supervised framework with an attention-based embedding-level pooling module and…

Sound · Computer Science 2020-11-03 Yuxin Huang , Liwei Lin , Shuo Ma , Xiangdong Wang , Hong Liu , Yueliang Qian , Min Liu , Kazushige Ouch

Learning meaningful frame-wise features on a partially labeled dataset is crucial to semi-supervised sound event detection. Prior works either maintain consistency on frame-level predictions or seek feature-level similarity among…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Yiming Li , Xiangdong Wang , Hong Liu , Rui Tao , Long Yan , Kazushige Ouchi