English
Related papers

Related papers: Pushing the Limit of Sound Event Detection with Mu…

200 papers

In recent years, neural network approaches have shown superior performance to conventional hand-made features in numerous application areas. In particular, convolutional neural networks (ConvNets) exploit spatially local correlations across…

Sound · Computer Science 2016-07-11 Yoonchang Han , Kyogu Lee

Sound event detection (SED) is essential for recognizing specific sounds and their temporal locations within acoustic signals. This becomes challenging particularly for on-device applications, where computational resources are limited. To…

Sound · Computer Science 2024-02-07 Yang Xiao , Rohan Kumar Das

We propose a novel method for Acoustic Event Detection (AED). In contrast to speech, sounds coming from acoustic events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an extended time…

Sound · Computer Science 2016-12-09 Naoya Takahashi , Michael Gygli , Beat Pfister , Luc Van Gool

Dilated convolution, which expands the receptive field by inserting gaps between its consecutive elements, is widely employed in computer vision. In this study, we propose three strategies to improve individual phases of dilated convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Linwei Chen , Lin Gu , Ying Fu

DNN-based methods have shown high performance in sound event localization and detection(SELD). While in real spatial sound scenes, reverberation and the imbalanced presence of various sound events increase the complexity of the SELD task.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-18 Siwei Huang , Jianfeng Chen , Jisheng Bai , Yafei Jia , Dongzhe Zhang

In this paper, a combinative approach using Nonnegative Matrix Factorization (NMF) and Convolutional Neural Network (CNN) is proposed for audio clip Sound Event Detection (SED). The main idea begins with the use of NMF to approximate strong…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Chan Teck Kai , Chin Cheng Siong , Li Ye

Task 4 of the DCASE2018 challenge demonstrated that substantially more research is needed for a real-world application of sound event detection. Analyzing the challenge results it can be seen that most successful models are biased towards…

Sound · Computer Science 2020-04-13 Heinrich Dinkel , Kai Yu

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Cagdas Bilen , Giacomo Ferroni , Francesco Tuveri , Juan Azcarreta , Sacha Krstulovic

Despite receiving significant attention from the research community, the task of segmenting and tracking objects in monocular videos still has much room for improvement. Existing works have simultaneously justified the efficacy of dilated…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Christian Schmidt , Ali Athar , Sabarinath Mahadevan , Bastian Leibe

In this paper, we propose an effective sound event detection (SED) method based on the audio spectrogram transformer (AST) model, pretrained on the large-scale AudioSet for audio tagging (AT) task, termed AST-SED. Pretrained AST models have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Kang Li , Yan Song , Li-Rong Dai , Ian McLoughlin , Xin Fang , Lin Liu

Time Delay Neural Networks (TDNN)-based methods are widely used in dialect identification. However, in previous work with TDNN application, subtle variant is being neglected in different feature scales. To address this issue, we propose a…

Computation and Language · Computer Science 2021-08-18 Tianlong Kong , Shouyi Yin , Dawei Zhang , Wang Geng , Xin Wang , Dandan Song , Jinwen Huang , Huiyu Shi , Xiaorui Wang

This paper proposes to use low-level spatial features extracted from multichannel audio for sound event detection. We extend the convolutional recurrent neural network to handle more than one type of these multichannel features by learning…

Sound · Computer Science 2017-06-09 Sharath Adavanne , Pasi Pertilä , Tuomas Virtanen

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

Sound · Computer Science 2025-07-31 Hogeon Yu

Many methods of sound event detection (SED) based on machine learning regard a segmented time frame as one data sample to model training. However, the sound durations of sound events vary greatly depending on the sound event class, e.g.,…

In this paper, we propose a convolutional recurrent neural network for joint sound event localization and detection (SELD) of multiple overlapping sound events in three-dimensional (3D) space. The proposed network takes a sequence of…

Sound · Computer Science 2018-12-18 Sharath Adavanne , Archontis Politis , Joonas Nikunen , Tuomas Virtanen

Domestic activities classification (DAC) from audio recordings aims at classifying audio recordings into pre-defined categories of domestic activities, which is an effective way for estimation of daily activities performed in home…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Yufei Zeng , Yanxiong Li , Zhenfeng Zhou , Ruiqi Wang , Difeng Lu

Crowd counting is critical for numerous video surveillance scenarios. One of the main issues in this task is how to handle the dramatic scale variations of pedestrians caused by the perspective effect. To address this issue, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Zhaoyi Yan , Ruimao Zhang , Hongzhi Zhang , Qingfu Zhang , Wangmeng Zuo

Sound event detection (SED) is the task of tagging the absence or presence of audio events and their corresponding interval within a given audio clip. While SED can be done using supervised machine learning, where training data is fully…

Sound · Computer Science 2021-02-08 Heinrich Dinkel , Mengyue Wu , Kai Yu

In this report, we propose three novel methods for developing a sound event detection (SED) model for the DCASE 2024 Challenge Task 4. First, we propose an auxiliary decoder attached to the final convolutional block to improve feature…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-25 Sang Won Son , Jongyeon Park , Hong Kook Kim , Sulaiman Vesal , Jeong Eun Lim

This paper proposes a Region-based Convolutional Recurrent Neural Network (R-CRNN) for audio event detection (AED). The proposed network is inspired by Faster-RCNN, a well known region-based convolutional network framework for visual object…

Sound · Computer Science 2018-08-22 Chieh-Chi Kao , Weiran Wang , Ming Sun , Chao Wang