English
Related papers

Related papers: Multi-label Sound Event Retrieval Using a Deep Lea…

200 papers

A significant challenge in sound event detection (SED) is the effective utilization of unlabeled data, given the limited availability of labeled data due to high annotation costs. Semi-supervised algorithms rely on labeled data to learn…

Sound · Computer Science 2024-09-27 Pengfei Cai , Yan Song , Nan Jiang , Qing Gu , Ian McLoughlin

Audio-text retrieval based on natural language descriptions is a challenging task. It involves learning cross-modality alignments between long sequences under inadequate data conditions. In this work, we investigate several audio features…

Sound · Computer Science 2022-03-30 Siyu Lou , Xuenan Xu , Mengyue Wu , Kai Yu

A central problem in building effective sound event detection systems is the lack of high-quality, strongly annotated sound event datasets. For this reason, Task 4 of the DCASE 2024 challenge proposes learning from two heterogeneous…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-19 Florian Schmid , Paul Primus , Tobias Morocutti , Jonathan Greif , Gerhard Widmer

Either human annotation or rule based automatic labeling is an effective method to augment data for relation extraction. However, the inevitable wrong labeling problem for example by distant supervision may deteriorate the performance of…

Computation and Language · Computer Science 2020-04-30 Shanchan Wu , Kai Fan

In this work, we present a method for landmark retrieval that utilizes global and local features. A Siamese network is used for global feature extraction and metric learning, which gives an initial ranking of the landmark search. We utilize…

Information Retrieval · Computer Science 2022-08-09 Tianyi Hu , Monika Kwiatkowski , Simon Matern , Olaf Hellwich

This paper presents a task of audio-visual scene classification (SC) where input videos are classified into one of five real-life crowded scenes: 'Riot', 'Noise-Street', 'Firework-Event', 'Music-Event', and 'Sport-Atmosphere'. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Lam Pham , Dat Ngo , Phu X. Nguyen , Truong Hoang , Alexander Schindler

Most sound event detection (SED) systems perform well on clean datasets but degrade significantly in noisy environments. Language-queried audio source separation (LASS) models show promise for robust SED by separating target events;…

Sound · Computer Science 2025-08-12 Yuanjian Chen , Yang Xiao , Han Yin , Yadong Guan , Xubo Liu

Audio perception is a key to solving a variety of problems ranging from acoustic scene analysis, music meta-data extraction, recommendation, synthesis and analysis. It can potentially also augment computers in doing tasks that humans do…

Sound · Computer Science 2020-02-12 Prateek Verma , Kenneth Salisbury

The weakly supervised sound event detection problem is the task of predicting the presence of sound events and their corresponding starting and ending points in a weakly labeled dataset. A weak dataset associates each training sample (a…

Sound · Computer Science 2021-06-22 Mohammad Rasool Izadi , Robert Stevenson , Laura N. Kloepper

A fundamental problem of every intermittently-powered sensing system is that signals acquired by these systems over a longer period in time are also intermittent. As a consequence, these systems fail to capture parts of a longer-duration…

Sound · Computer Science 2023-05-29 Mahathir Monjur , Yubo Luo , Zhenyu Wang , Shahriar Nirjon

In this paper, we propose a multi-level attention model to solve the weakly labelled audio classification problem. The objective of audio classification is to predict the presence or absence of audio events in an audio clip. Recently,…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-08 Changsong Yu , Karim Said Barsim , Qiuqiang Kong , Bin Yang

We propose a benchmark of state-of-the-art sound event detection systems (SED). We designed synthetic evaluation sets to focus on specific sound event detection challenges. We analyze the performance of the submissions to DCASE 2021 task 4…

Machine listening systems often rely on fixed taxonomies to organize and label audio data, key for training and evaluating deep neural networks (DNNs) and other supervised algorithms. However, such taxonomies face significant constraints:…

Sound · Computer Science 2024-09-19 Paraskevas Stamatiadis , Michel Olvera , Slim Essid

Acoustic Scene Classification (ASC) is a challenging task, as a single scene may involve multiple events that contain complex sound patterns. For example, a cooking scene may contain several sound sources including silverware clinking,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-20 Weimin Wang , Weiran Wang , Ming Sun , Chao Wang

Audio tagging aims to perform multi-label classification on audio chunks and it is a newly proposed task in the Detection and Classification of Acoustic Scenes and Events 2016 (DCASE 2016) challenge. This task encourages research efforts to…

Sound · Computer Science 2017-03-20 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

We propose an end-to-end deep model for speaker verification in the wild. Our model uses thin-ResNet for extracting speaker embeddings from utterances and a Siamese capsule network and dynamic routing as the Back-end to calculate a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Amirhossein Hajavi , Ali Etemad

Ambient sound scenes typically comprise multiple short events occurring on top of a somewhat stationary background. We consider the task of separating these events from the background, which we call foreground-background ambient sound scene…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Michel Olvera , Emmanuel Vincent , Romain Serizel , Gilles Gasso

Outdoor acoustic events detection is an exciting research field but challenged by the need for complex algorithms and deep learning techniques, typically requiring many computational, memory, and energy resources. This challenge discourages…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Gianmarco Cerutti , Rahul Prasad , Alessio Brutti , Elisabetta Farella

This paper is about alerting acoustic event detection and sound source localisation in an urban scenario. Specifically, we are interested in spotting the presence of horns, and sirens of emergency vehicles. In order to obtain a reliable…

Sound · Computer Science 2022-03-29 Letizia Marchegiani , Paul Newman

Sound event detection is the task of recognizing sounds and determining their extent (onset/offset times) within an audio clip. Existing systems commonly predict sound presence confidence in short time frames. Then, thresholding produces…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Janek Ebbers , Francois G. Germain , Gordon Wichern , Jonathan Le Roux