English
Related papers

Related papers: CoLoC: Conditioned Localizer and Classifier for So…

200 papers

In this paper, we describe in detail the system we submitted to DCASE2019 task 4: sound event detection (SED) in domestic environments. We employ a convolutional neural network (CNN) with an embedding-level attention pooling module to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-16 Liwei Lin , Xiangdong Wang , Hong Liu , Yueliang Qian

We propose a benchmark of state-of-the-art sound event detection systems (SED). We designed synthetic evaluation sets to focus on specific sound event detection challenges. We analyze the performance of the submissions to DCASE 2021 task 4…

In this paper, we present a method called HODGEPODGE\footnotemark[1] for large-scale detection of sound events using weakly labeled, synthetic, and unlabeled data proposed in the Detection and Classification of Acoustic Scenes and Events…

Sound · Computer Science 2019-07-18 Ziqiang Shi , Liu Liu , Huibin Lin , Rujie Liu , Anyan Shi

Humans can easily perceive the direction of sound sources in a visual scene, termed sound source localization. Recent studies on learning-based sound source localization have mainly explored the problem from a localization perspective.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Arda Senocak , Hyeonggon Ryu , Junsik Kim , Tae-Hyun Oh , Hanspeter Pfister , Joon Son Chung

Source separation (SS) aims to separate individual sources from an audio recording. Sound event detection (SED) aims to detect sound events from an audio recording. We propose a joint separation-classification (JSC) model trained only on…

Sound · Computer Science 2019-12-10 Qiuqiang Kong , Yong Xu , Wenwu Wang , Mark D. Plumbley

The design of new methods and models when only weakly-labeled data are available is of paramount importance in order to reduce the costs of manual annotation and the considerable human effort associated with it. In this work, we address…

Sound · Computer Science 2019-04-02 Thomas Pellegrini , Léo Cances

An important problem in machine auditory perception is to recognize and detect sound events. In this paper, we propose a sequential self-teaching approach to learning sounds. Our main proposition is that it is harder to learn sounds in…

Sound · Computer Science 2020-07-02 Anurag Kumar , Vamsi Krishna Ithapu

Humans excel at multisensory perception and can often recognise object properties from the sound of their interactions. Inspired by this, we propose the novel task of Collision Sound Source Segmentation (CS3), where we aim to segment the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kranti Kumar Parida , Omar Emara , Hazel Doughty , Dima Damen

Immersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services. Aiming at its further realization, the DCASE 2025 Challenge has recently introduced a task for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Binh Thien Nguyen , Masahiro Yasuda , Daiki Takeuchi , Daisuke Niizumi , Yasunori Ohishi , Noboru Harada

The conventional MUltiple SIgnal Classification (MUSIC) algorithm is effective for angle-of-arrival estimation in the far-field and can be extended for full source localization in the near-field. However, it suffers from high computational…

Signal Processing · Electrical Eng. & Systems 2025-06-24 Parisa Ramezani , Seyed Jalaleddin Mousavirad , Mattias O'Nils , Emil Björnson

While multitask and transfer learning has shown to improve the performance of neural networks in limited data settings, they require pretraining of the model on large datasets beforehand. In this paper, we focus on improving the performance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Soham Deshmukh , Bhiksha Raj , Rita Singh

Recent advances in semi-supervised object detection (SSOD) are largely driven by consistency-based pseudo-labeling methods for image classification tasks, producing pseudo labels as supervisory signals. However, when using pseudo labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Hengduo Li , Zuxuan Wu , Abhinav Shrivastava , Larry S. Davis

Large-scale pre-trained image-text models exhibit robust multimodal representations, yet applying the Contrastive Language-Image Pre-training (CLIP) model to audio-visual localization remains challenging. Replacing the classification token…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Khanh Binh Nguyen , Chae Jung Park

Data-based and learning-based sound source localization (SSL) has shown promising results in challenging conditions, and is commonly set as a classification or a regression problem. Regression-based approaches have certain advantages over…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-02 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

Weakly supervised learning algorithms are critical for scaling audio event detection to several hundreds of sound categories. Such learning models should not only disambiguate sound events efficiently with minimal class-specific annotation…

Sound · Computer Science 2020-05-05 Anurag Kumar , Vamsi Krishna Ithapu

We present SoundLoCD, a novel text-to-sound generation framework, which incorporates a LoRA-based conditional discrete contrastive latent diffusion model. Unlike recent large-scale sound generation models, our model can be efficiently…

Sound · Computer Science 2024-05-27 Xinlei Niu , Jing Zhang , Christian Walder , Charles Patrick Martin

Sound event detection is a challenging task, especially for scenes with multiple simultaneous events. While event classification methods tend to be fairly accurate, event localization presents additional challenges, especially when large…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-12 Sandeep Kothinti , Keisuke Imoto , Debmalya Chakrabarty , Gregory Sell , Shinji Watanabe , Mounya Elhilali

LiDAR relocalization aims to estimate the global 6-DoF pose of a sensor in the environment. However, existing regression-based approaches are prone to dynamic or ambiguous scenarios, as they either solely rely on single-frame inference or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Minghang Zhu , Zhijing Wang , Yuxin Guo , Wen Li , Sheng Ao , Cheng Wang

Acoustic scene classification (ASC) and sound event detection (SED) are fundamental tasks in environmental sound analysis, and many methods based on deep learning have been proposed. Considering that information on acoustic scenes and sound…

Sound · Computer Science 2022-04-06 Keisuke Imoto , Yuka Komatsu , Shunsuke Tsubaki , Tatsuya Komatsu

The Detection and Classification of Acoustic Scenes and Events Challenge Task 4 aims to advance sound event detection (SED) systems in domestic environments by leveraging training data with different supervision uncertainty. Participants…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Samuele Cornell , Janek Ebbers , Constance Douwes , Irene Martín-Morató , Manu Harju , Annamaria Mesaros , Romain Serizel