English
Related papers

Related papers: Towards Open World Sound Event Detection

200 papers

We propose a novel method for Acoustic Event Detection (AED). In contrast to speech, sounds coming from acoustic events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an extended time…

Sound · Computer Science 2016-12-09 Naoya Takahashi , Michael Gygli , Beat Pfister , Luc Van Gool

Deep learning models have a risk of utilizing spurious clues to make predictions, such as recognizing actions based on the background scene. This issue can severely degrade the open-set action recognition performance when the testing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuanhao Zhai , Ziyi Liu , Zhenyu Wu , Yi Wu , Chunluan Zhou , David Doermann , Junsong Yuan , Gang Hua

Existing weakly supervised sound event detection (WSSED) work has not explored both types of co-occurrences simultaneously, i.e., some sound events often co-occur, and their occurrences are usually accompanied by specific background sounds,…

Sound · Computer Science 2023-03-13 Yifei Xin , Dongchao Yang , Fan Cui , Yujun Wang , Yuexian Zou

Sound event detection (SED) often suffers from the data deficiency problem. The recent baseline system in the DCASE2023 challenge task 4 leverages the large pretrained self-supervised learning (SelfSL) models to mitigate such restriction,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-01 Nian Shao , Xian Li , Xiaofei Li

Open-world object detection (OWOD) requires incrementally detecting known categories while reliably identifying unknown objects. Existing methods primarily focus on improving unknown recall, yet overlook interpretability, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xueqiang Lv , Shizhou Zhang , Yinghui Xing , Di Xu , Peng Wang , Yanning Zhang

DNN-based methods have shown high performance in sound event localization and detection(SELD). While in real spatial sound scenes, reverberation and the imbalanced presence of various sound events increase the complexity of the SELD task.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-18 Siwei Huang , Jianfeng Chen , Jisheng Bai , Yafei Jia , Dongzhe Zhang

Object detection is critical in autonomous driving, and it is more practical yet challenging to localize objects of unknown categories: an endeavour known as Class-Agnostic Object Detection (CAOD). Existing studies on CAOD predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Haitian Zhang , Chang Xu , Xinya Wang , Bingde Liu , Guang Hua , Lei Yu , Wen Yang

In this study, we address the multimodal task of stereo sound event localization and detection with source distance estimation (3D SELD) in regular video content. 3D SELD is a complex task that combines temporal event classification with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-09 Davide Berghi , Philip J. B. Jackson

Out-of-distribution (OOD) object detection is a critical task focused on detecting objects that originate from a data distribution different from that of the training data. In this study, we investigate to what extent state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Sadia Ilyas , Ido Freeman , Matthias Rottmann

Sound event localization and detection (SELD) systems estimate both the direction-of-arrival (DOA) and class of sound sources over time. In the DCASE 2022 SELD Challenge (Task 3), models are designed to operate in a 4-channel setting. While…

Joint sound event localization and detection (SELD) is an integral part of developing context awareness into communication interfaces of mobile robots, smartphones, and home assistants. For example, an automatic audio focus for video…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-29 Pasi Pertilä , Emre Cakir , Aapo Hakala , Eemi Fagerlund , Tuomas Virtanen , Archontis Politis , Antti Eronen

This paper presents a methodology for early detection of audio events from audio streams. Early detection is the ability to infer an ongoing event during its initial stage. The proposed system consists of a novel inference step coupled with…

Sound · Computer Science 2019-04-09 Huy Phan , Philipp Koch , Ian McLoughlin , Alfred Mertins

This paper describes the BUT submission to the ESDD 2026 Challenge, specifically focusing on Track 1: Environmental Sound Deepfake Detection with Unseen Generators. To address the critical challenge of generalizing to audio generated by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-10 Junyi Peng , Lin Zhang , Jin Li , Oldrich Plchot , Jan Cernocky

Deep learning-based sound event localization and classification is an emerging research area within wireless acoustic sensor networks. However, current methods for sound event localization and classification typically rely on a single…

Sound event detection (SED) methods typically rely on either strongly labelled data or weakly labelled data. As an alternative, sequentially labelled data (SLD) was proposed. In SLD, the events and the order of events in audio clips are…

Sound · Computer Science 2019-04-30 Yuanbo Hou , Qiuqiang Kong , Shengchen Li , Mark D. Plumbley

Sound event localization and detection (SELD) is a task for the classification of sound events and the localization of direction of arrival (DoA) utilizing multichannel acoustic signals. Prior studies employ spectral and channel information…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Yusun Shul , Jung-Woo Choi

Sound event detection (SED) aims at identifying audio events (audio tagging task) in recordings and then locating them temporally (localization task). This last task ends with the segmentation of the frame-level class predictions, that…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-25 Leo Cances , Patrice Guyot , Thomas Pellegrini

Recently, a few open-vocabulary methods have been proposed by employing a unified architecture to tackle generic segmentation and detection tasks. However, their performance still lags behind the task-specific models due to the conflict…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Shuai Li , Minghan Li , Pengfei Wang , Lei Zhang

Out-of-distribution (OOD) object detection is an important yet underexplored task. A reliable object detector should be able to handle OOD objects by localizing and correctly classifying them as OOD. However, a critical issue arises when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Sadia Ilyas , Annika Mütze , Klaus Friedrichs , Thomas Kurbiel , Matthias Rottmann

Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments…

Sound · Computer Science 2026-02-02 Xueping Zhang , Yaxiong Chen , Ruilin Yao , Yunfei Zi , Shengwu Xiong