English
Related papers

Related papers: Capsule Routing for Sound Event Detection

200 papers

Realistic recordings of soundscapes often have multiple sound events co-occurring, such as car horns, engine and human voices. Sound event retrieval is a type of content-based search aiming at finding audio samples, similar to an audio…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-24 Jianyu Fan , Eric Nichols , Daniel Tompkins , Ana Elisa Mendez Mendez , Benjamin Elizalde , Philippe Pasquier

We consider a centralized detection problem where sensors experience noisy measurements and intermittent connectivity to a centralized fusion center. The sensors collaborate locally within predefined sensor clusters and fuse their noisy…

Signal Processing · Electrical Eng. & Systems 2022-08-23 Michal Yemini , Stephanie Gil , Andrea J. Goldsmith

Past few years have witnessed exponential growth of interest in deep learning methodologies with rapidly improving accuracies and reduced computational complexity. In particular, architectures using Convolutional Neural Networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Sai Samarth R Phaye , Apoorva Sikka , Abhinav Dhall , Deepti Bathula

The majority of sound scene analysis work focuses on one of two clearly defined tasks: acoustic scene classification or sound event detection. Whilst this separation of tasks is useful for problem definition, they inherently ignore some…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-30 Helen L. Bear , Toni Heittola , Annamaria Mesaros , Emmanouil Benetos , Tuomas Virtanen

In this paper, we propose a new strategy for acoustic scene classification (ASC) , namely recognizing acoustic scenes through identifying distinct sound events. This differs from existing strategies, which focus on characterizing global…

Sound · Computer Science 2019-10-23 Hongwei Song , Jiqing Han , Shiwen Deng , Zhihao Du

If our noise-canceling headphones can understand our audio environments, they can then inform us of important sound events, tune equalization based on the types of content we listen to, and dynamically adjust noise cancellation parameters…

Sound · Computer Science 2024-04-09 Yushu Wu , Xiao Quan , Mohammad Rasool Izadi , Chuan-Che Huang

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Cagdas Bilen , Giacomo Ferroni , Francesco Tuveri , Juan Azcarreta , Sacha Krstulovic

In this paper we present our work on Task 1 Acoustic Scene Classi- fication and Task 3 Sound Event Detection in Real Life Recordings. Among our experiments we have low-level and high-level features, classifier optimization and other…

Capsule networks are designed to present the objects by a set of parts and their relationships, which provide an insight into the procedure of visual perception. Although recent works have shown the success of capsule networks on simple…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chang Yu , Xiangyu Zhu , Xiaomei Zhang , Zidu Wang , Zhaoxiang Zhang , Zhen Lei

The Detection and Classification of Acoustic Scenes and Events (DCASE) 2019 challenge focuses on audio tagging, sound event detection and spatial localisation. DCASE 2019 consists of five tasks: 1) acoustic scene classification, 2) audio…

Sound · Computer Science 2019-06-11 Qiuqiang Kong , Yin Cao , Turab Iqbal , Yong Xu , Wenwu Wang , Mark D. Plumbley

From the moment Neural Networks dominated the scene for image processing, the computational complexity needed to solve the targeted tasks skyrocketed: against such an unsustainable trend, many strategies have been developed, ambitiously…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Riccardo Renzulli , Marco Grangetto

The Detection and Classification of Acoustic Scenes and Events Challenge Task 4 aims to advance sound event detection (SED) systems in domestic environments by leveraging training data with different supervision uncertainty. Participants…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Samuele Cornell , Janek Ebbers , Constance Douwes , Irene Martín-Morató , Manu Harju , Annamaria Mesaros , Romain Serizel

The unique properties of radar sensors, such as their robustness to adverse weather conditions, make them an important part of the environment perception system of autonomous vehicles. One of the first steps during the processing of radar…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Johannes Kopp , Dominik Kellner , Aldi Piroli , Vinzenz Dallabetta , Klaus Dietmayer

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

Sound event detection with weakly labeled data is considered as a problem of multi-instance learning. And the choice of pooling function is the key to solving this problem. In this paper, we proposed a hierarchical pooling structure to…

Sound · Computer Science 2025-05-06 Ke-Xin He , Yu-Han Shen , Wei-Qiang Zhang

We present in this paper an efficient approach for acoustic scene classification by exploring the structure of class labels. Given a set of class labels, a category taxonomy is automatically learned by collectively optimizing a clustering…

Multimedia · Computer Science 2016-07-27 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

Sound event detection (SED) entails identifying the type of sound and estimating its temporal boundaries from acoustic signals. These events are uniquely characterized by their spatio-temporal features, which are determined by the way they…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Tanmay Khandelwal , Rohan Kumar Das

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Recent progress in auditory intelligence has yielded high-performing systems for sound event detection (SED), acoustic scene classification (ASC), automated audio captioning (AAC), and audio question answering (AQA). Yet these tasks remain…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Hyeonuk Nam

We address the important problem of generalizing robotic rearrangement to clutter without any explicit object models. We first generate over 650K cluttered scenes - orders of magnitude more than prior work - in diverse everyday…

Robotics · Computer Science 2023-04-20 Adithyavairavan Murali , Arsalan Mousavian , Clemens Eppner , Adam Fishman , Dieter Fox