English
Related papers

Related papers: Joint Analysis of Sound Events and Acoustic Scenes…

200 papers

In the analysis of acoustic scenes, often the occurring sounds have to be detected in time, recognized, and localized in space. Usually, each of these tasks is done separately. In this paper, a model-based approach to jointly carry them out…

Sound · Computer Science 2017-12-20 Rupayan Chakraborty , Climent Nadeu

Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environments with acoustic noise. A practical solution is to…

Computation and Language · Computer Science 2023-05-15 Fei Tao , Carlos Busso

Audio event localization and detection (SELD) have been commonly tackled using multitask models. Such a model usually consists of a multi-label event classification branch with sigmoid cross-entropy loss for event activity detection and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-14 Huy Phan , Lam Pham , Philipp Koch , Ngoc Q. K. Duong , Ian McLoughlin , Alfred Mertins

Sound event detection is a core module for acoustic environmental analysis. Semi-supervised learning technique allows to largely scale up the dataset without increasing the annotation budget, and recently attracts lots of research…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Xiaofei Li

The Detection and Classification of Acoustic Scenes and Events (DCASE) 2019 challenge focuses on audio tagging, sound event detection and spatial localisation. DCASE 2019 consists of five tasks: 1) acoustic scene classification, 2) audio…

Sound · Computer Science 2019-04-16 Qiuqiang Kong , Yin Cao , Turab Iqbal , Yong Xu , Wenwu Wang , Mark D. Plumbley

The Detection and Classification of Acoustic Scenes and Events (DCASE) 2019 challenge focuses on audio tagging, sound event detection and spatial localisation. DCASE 2019 consists of five tasks: 1) acoustic scene classification, 2) audio…

Sound · Computer Science 2019-06-11 Qiuqiang Kong , Yin Cao , Turab Iqbal , Yong Xu , Wenwu Wang , Mark D. Plumbley

In traditional sound event localization and detection (SELD) tasks, the focus is typically on sound event detection (SED) and direction-of-arrival (DOA) estimation, but they fall short of providing full spatial information about the sound…

Sound · Computer Science 2025-01-22 Yuxuan Dong , Qing Wang , Hengyi Hong , Ya Jiang , Shi Cheng

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen

This report proposes a polyphonic sound event detection (SED) method for the DCASE 2021 Challenge Task 4. The proposed SED model consists of two stages: a mean-teacher model for providing target labels regarding weakly labeled or unlabeled…

Sound · Computer Science 2021-07-07 Nam Kyun Kim , Hong Kook Kim

In this technique report, we present a bunch of methods for the task 4 of Detection and Classification of Acoustic Scenes and Events 2017 (DCASE2017) challenge. This task evaluates systems for the large-scale detection of sound events using…

Sound · Computer Science 2017-11-28 Yong Xu , Qiuqiang Kong , Wenwu Wang , Mark D. Plumbley

This study presents an audio-visual information fusion approach to sound event localization and detection (SELD) in low-resource scenarios. We aim at utilizing audio and video modality information through cross-modal learning and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Ya Jiang , Qing Wang , Jun Du , Maocheng Hu , Pengfei Hu , Zeyan Liu , Shi Cheng , Zhaoxu Nian , Yuxuan Dong , Mingqi Cai , Xin Fang , Chin-Hui Lee

Sound Event Early Detection (SEED) is an essential task in recognizing the acoustic environments and soundscapes. However, most of the existing methods focus on the offline sound event detection, which suffers from the over-confidence issue…

Sound · Computer Science 2022-02-15 Xujiang Zhao , Xuchao Zhang , Wei Cheng , Wenchao Yu , Yuncong Chen , Haifeng Chen , Feng Chen

Speech activity detection (SAD), which often rests on the fact that the noise is "more" stationary than speech, is particularly challenging in non-stationary environments, because the time variance of the acoustic scene makes it difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Jens Heitkaemper , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper…

Sound · Computer Science 2020-12-09 Jivitesh Sharma , Ole-Christoffer Granmo , Morten Goodwin

The performance of an Acoustic Scene Classification (ASC) system is highly depending on the latent temporal dynamics of the audio signal. In this paper, we proposed a multiple layers temporal pooling method using CNN feature sequence as…

Sound · Computer Science 2019-04-04 Liwen Zhang , Jiqing Han

In recent years, anomaly events detection in crowd scenes attracts many researchers' attention, because of its importance to public safety. Existing methods usually exploit visual information to analyze whether any abnormal events have…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Junyu Gao , Maoguo Gong , Xuelong Li

Sound event detection (SED) is an interesting but challenging task due to the scarcity of data and diverse sound events in real life. This paper presents a multi-grained based attention network (MGA-Net) for semi-supervised sound event…

Sound · Computer Science 2022-11-01 Ying Hu , Xiujuan Zhu , Yunlong Li , Hao Huang , Liang He

Environmental sound recognition (ESR) is an emerging research topic in audio pattern recognition. Many tasks are presented to resort to computational models for ESR in real-life applications. However, current models are usually designed for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-22 Jisheng Bai , Jianfeng Chen , Mou Wang , Muhammad Saad Ayub

Sound event detection (SED) aims at identifying audio events (audio tagging task) in recordings and then locating them temporally (localization task). This last task ends with the segmentation of the frame-level class predictions, that…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-25 Leo Cances , Patrice Guyot , Thomas Pellegrini

In this paper, we compare the performance of using binaural audio features in place of single-channel features for sound event detection. Three different binaural features are studied and evaluated on the publicly available TUT Sound Events…

Sound · Computer Science 2017-10-10 Sharath Adavanne , Tuomas Virtanen