English
Related papers

Related papers: Exploring Performance-Complexity Trade-Offs in Sou…

200 papers

In this paper, we propose an effective sound event detection (SED) method based on the audio spectrogram transformer (AST) model, pretrained on the large-scale AudioSet for audio tagging (AT) task, termed AST-SED. Pretrained AST models have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Kang Li , Yan Song , Li-Rong Dai , Ian McLoughlin , Xin Fang , Lin Liu

Traditional event detection classifies a word or a phrase in a given sentence for a set of predefined event types. The limitation of such predefined set is that it prevents the adaptation of the event detection models to new event types. We…

Machine Learning · Computer Science 2019-10-28 Viet Dac Lai , Thien Huu Nguyen

This paper proposes an effective modelling of sound event spectra with a hidden data-size-imbalance, for improved Acoustic Event Detection (AED). The proposed method models each event as an aggregated representation of a few latent factors,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-08 Chaitanya Narisetty , Tatsuya Komatsu , Reishi Kondo

Many methods of sound event detection (SED) based on machine learning regard a segmented time frame as one data sample to model training. However, the sound durations of sound events vary greatly depending on the sound event class, e.g.,…

The performances of Sound Event Detection (SED) systems are greatly limited by the difficulty in generating large strongly labeled dataset. In this work, we used two main approaches to overcome the lack of strongly labeled data. First, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Hyeonuk Nam , Byeong-Yun Ko , Gyeong-Tae Lee , Seong-Hu Kim , Won-Ho Jung , Sang-Min Choi , Yong-Hwa Park

Sound event detection (SED) methods typically rely on either strongly labelled data or weakly labelled data. As an alternative, sequentially labelled data (SLD) was proposed. In SLD, the events and the order of events in audio clips are…

Sound · Computer Science 2019-04-30 Yuanbo Hou , Qiuqiang Kong , Shengchen Li , Mark D. Plumbley

Sound event detection (SED) methods that leverage a large pre-trained Transformer encoder network have shown promising performance in recent DCASE challenges. However, they still rely on an RNN-based context network to model temporal…

Sound · Computer Science 2024-08-20 Pengfei Cai , Yan Song , Kang Li , Haoyu Song , Ian McLoughlin

Traditional methods to tackle many music information retrieval tasks typically follow a two-step architecture: feature engineering followed by a simple learning algorithm. In these "shallow" architectures, feature engineering and learning…

Sound · Computer Science 2015-11-18 Peter Li , Jiyuan Qian , Tian Wang

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Cagdas Bilen , Giacomo Ferroni , Francesco Tuveri , Juan Azcarreta , Sacha Krstulovic

We study few-shot acoustic event detection (AED) in this paper. Few-shot learning enables detection of new events with very limited labeled data. Compared to other research areas like computer vision, few-shot learning for audio recognition…

Machine Learning · Computer Science 2020-02-24 Bowen Shi , Ming Sun , Krishna C. Puvvada , Chieh-Chi Kao , Spyros Matsoukas , Chao Wang

Event detection (ED) aims at detecting event trigger words in sentences and classifying them into specific event types. In real-world applications, ED typically does not have sufficient labelled data, thus can be formulated as a few-shot…

Computation and Language · Computer Science 2021-06-01 Shirong Shen , Tongtong Wu , Guilin Qi , Yuan-Fang Li , Gholamreza Haffari , Sheng Bi

High-speed vision sensing is essential for real-time perception in applications such as robotics, autonomous vehicles, and industrial automation. Traditional frame-based vision systems suffer from motion blur, high latency, and redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Riadul Islam , Joey Mulé , Dhandeep Challagundla , Shahmir Rizvi , Sean Carson

There is a common observation that audio event classification is easier to deal with than detection. So far, this observation has been accepted as a fact and we lack of a careful analysis. In this paper, we reason the rationale behind this…

This paper presents a methodology for early detection of audio events from audio streams. Early detection is the ability to infer an ongoing event during its initial stage. The proposed system consists of a novel inference step coupled with…

Sound · Computer Science 2019-04-09 Huy Phan , Philipp Koch , Ian McLoughlin , Alfred Mertins

Outdoor acoustic events detection is an exciting research field but challenged by the need for complex algorithms and deep learning techniques, typically requiring many computational, memory, and energy resources. This challenge discourages…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Gianmarco Cerutti , Rahul Prasad , Alessio Brutti , Elisabetta Farella

Sound event detection (SED) is the task of tagging the absence or presence of audio events and their corresponding interval within a given audio clip. While SED can be done using supervised machine learning, where training data is fully…

Sound · Computer Science 2021-02-08 Heinrich Dinkel , Mengyue Wu , Kai Yu

This research mainly emphasizes on traffic detection thus essentially involving object detection and classification. The particular work discussed here is motivated from unsatisfactory attempts of re-using well known pre-trained object…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Baljit Kaur , Jhilik Bhattacharya

Sound event detection (SED) is an interesting but challenging task due to the scarcity of data and diverse sound events in real life. This paper presents a multi-grained based attention network (MGA-Net) for semi-supervised sound event…

Sound · Computer Science 2022-11-01 Ying Hu , Xiujuan Zhu , Yunlong Li , Hao Huang , Liang He

Sound Event Localization and Detection refers to the problem of identifying the presence of independent or temporally-overlapped sound sources, correctly identifying to which sound class it belongs, estimating their spatial directions while…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Daniel Arteaga , Andrés Pérez-López

In this paper, we show that a simple self-supervised pre-trained audio model can achieve comparable inference efficiency to more complicated pre-trained models with speech transformer encoders. These speech transformers rely on mixing…

Sound · Computer Science 2024-02-09 Sungho Jeon , Ching-Feng Yeh , Hakan Inan , Wei-Ning Hsu , Rashi Rungta , Yashar Mehdad , Daniel Bikel