English
Related papers

Related papers: Multi-label Sound Event Retrieval Using a Deep Lea…

200 papers

In this paper we present an approach to polyphonic sound event detection in real life recordings based on bi-directional long short term memory (BLSTM) recurrent neural networks (RNNs). A single multilabel BLSTM RNN is trained to map…

Sound · Computer Science 2016-11-17 Giambattista Parascandolo , Heikki Huttunen , Tuomas Virtanen

In this paper we propose a novel learning framework called Supervised and Weakly Supervised Learning where the goal is to learn simultaneously from weakly and strongly labeled data. Strongly labeled data can be simply understood as fully…

Machine Learning · Computer Science 2017-02-21 Anurag Kumar , Bhiksha Raj

Artificial sound event detection (SED) has the aim to mimic the human ability to perceive and understand what is happening in the surroundings. Nowadays, Deep Learning offers valuable techniques for this goal such as Convolutional Neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-26 Fabio Vesperini , Leonardo Gabrielli , Emanuele Principi , Stefano Squartini

This paper proposes a neural network architecture and training scheme to learn the start and end time of sound events (strong labels) in an audio recording given just the list of sound events existing in the audio without time information…

Sound · Computer Science 2017-10-10 Sharath Adavanne , Tuomas Virtanen

Acoustic scene classification (ASC) and sound event detection (SED) are fundamental tasks in environmental sound analysis, and many methods based on deep learning have been proposed. Considering that information on acoustic scenes and sound…

Sound · Computer Science 2022-04-06 Keisuke Imoto , Yuka Komatsu , Shunsuke Tsubaki , Tatsuya Komatsu

In the last couple of years, weakly labeled learning has turned out to be an exciting approach for audio event detection. In this work, we introduce webly labeled learning for sound events which aims to remove human supervision altogether…

Sound · Computer Science 2019-07-16 Anurag Kumar , Ankit Shah , Bhiksha Raj , Alex Hauptmann

Sound event localization aims at estimating the positions of sound sources in the environment with respect to an acoustic receiver (e.g. a microphone array). Recent advances in this domain most prominently focused on utilizing deep…

Training a sound event detection algorithm on a heterogeneous dataset including both recorded and synthetic soundscapes that can have various labeling granularity is a non-trivial task that can lead to systems requiring several technical…

Sound · Computer Science 2020-07-09 Nicolas Turpault , Romain Serizel

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Cagdas Bilen , Giacomo Ferroni , Francesco Tuveri , Juan Azcarreta , Sacha Krstulovic

Audio Event Detection is an important task for content analysis of multimedia data. Most of the current works on detection of audio events is driven through supervised learning approaches. We propose a weakly supervised learning framework…

Sound · Computer Science 2016-06-14 Anurag Kumar , Bhiksha Raj

Sleep-disordered breathing (SDB) is a serious and prevalent condition, and acoustic analysis via consumer devices (e.g. smartphones) offers a low-cost solution to screening for it. We present a novel approach for the acoustic identification…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-08 Hector E. Romero , Ning Ma , Guy J. Brown , Amy V. Beeston , Madina Hasan

We address the problem of cross-modal information retrieval in the domain of remote sensing. In particular, we are interested in two application scenarios: i) cross-modal retrieval between panchromatic (PAN) and multi-spectral imagery, and…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Ushasi Chaudhuri , Biplab Banerjee , Avik Bhattacharya , Mihai Datcu

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

Sound · Computer Science 2025-07-31 Hogeon Yu

Polyphonic Sound Event Detection (SED) in real-world recordings is a challenging task because of the dynamic polyphony level, intensity, and duration of sound events. Current polyphonic SED systems fail to model the temporal structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-02 Arjun Pankajakshan , Helen L. Bear , Emmanouil Benetos

In this paper, we focus on the problem of content-based retrieval for audio, which aims to retrieve all semantically similar audio recordings for a given audio clip query. This problem is similar to the problem of query by example of audio,…

Sound · Computer Science 2018-02-16 Pranay Manocha , Rohan Badlani , Anurag Kumar , Ankit Shah , Benjamin Elizalde , Bhiksha Raj

Acoustic event detection and scene classification are major research tasks in environmental sound analysis, and many methods based on neural networks have been proposed. Conventional methods have addressed these tasks separately; however,…

Sound Event Localization and Detection refers to the problem of identifying the presence of independent or temporally-overlapped sound sources, correctly identifying to which sound class it belongs, estimating their spatial directions while…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Daniel Arteaga , Andrés Pérez-López

One of the most important problems in audio event detection research is absence of benchmark results for comparison with any proposed method. Different works consider different sets of events and datasets which makes it difficult to…

Sound · Computer Science 2016-07-21 Anurag Kumar , Bhiksha Raj

The development of audio event recognition systems require labeled training data, which are generally hard to obtain. One promising source of recordings of audio events is the large amount of multimedia data on the web. In particular, if…

Sound · Computer Science 2022-10-04 Anurag Kumar , Bhiksha Raj

Current audio classification models have small class vocabularies relative to the large number of sound event classes of interest in the real world. Thus, they provide a limited view of the world that may miss important yet unexpected or…

Sound · Computer Science 2023-10-24 Sripathi Sridhar , Mark Cartwright