English
Related papers

Related papers: ACCDOA: Activity-Coupled Cartesian Direction of Ar…

200 papers

The understanding of the surrounding environment plays a critical role in autonomous robotic systems, such as self-driving cars. Extensive research has been carried out concerning visual perception. Yet, to obtain a more complete perception…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-13 Karim Guirguis , Christoph Schorn , Andre Guntoro , Sherif Abdulatif , Bin Yang

Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only problem, but visual information has been recently included.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Davide Berghi , Peipei Wu , Jinzheng Zhao , Wenwu Wang , Philip J. B. Jackson

This report presents our systems submitted to the audio-only and audio-visual tracks of the DCASE2025 Task 3 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. SELD is a complex task that combines…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Davide Berghi , Philip J. B. Jackson

Sound event detection (SED) and acoustic scene classification (ASC) are important research topics in environmental sound analysis. Many research groups have addressed SED and ASC using neural-network-based methods, such as the convolutional…

Sound · Computer Science 2021-02-24 Noriyuki Tonami , Keisuke Imoto , Ryosuke Yamanishi , Yoichi Yamashita

Sound event detection (SED) is one of tasks to automate function by human auditory system which listens and understands auditory scenes. Therefore, we were inspired to make SED recognize sound events in the way human auditory system does.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Deokki Min , Hyeonuk Nam , Yong-Hwa Park

Joint sound event localization and detection (SELD) is an integral part of developing context awareness into communication interfaces of mobile robots, smartphones, and home assistants. For example, an automatic audio focus for video…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-29 Pasi Pertilä , Emre Cakir , Aapo Hakala , Eemi Fagerlund , Tuomas Virtanen , Archontis Politis , Antti Eronen

Polyphonic Sound Event Detection (SED) in real-world recordings is a challenging task because of the dynamic polyphony level, intensity, and duration of sound events. Current polyphonic SED systems fail to model the temporal structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-02 Arjun Pankajakshan , Helen L. Bear , Emmanouil Benetos

This work presents HDA-SELD, a unified framework that combines hierarchical cross-modal distillation (HCMD) and multi-level data augmentation to address low-resource audio-visual (AV) sound event localization and detection (SELD). An…

Sound · Computer Science 2025-09-30 Qing Wang , Ya Jiang , Hang Chen , Sabato Marco Siniscalchi , Jun Du , Jianqing Gao

Supervised learning based methods for source localization, being data driven, can be adapted to different acoustic conditions via training and have been shown to be robust to adverse acoustic environments. In this paper, a convolutional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-22 Soumitro Chakrabarty , Emanuël A. P. Habets

Sound event localization and detection with source distance estimation (3D SELD) involves not only identifying the sound category and its direction-of-arrival (DOA) but also predicting the source's distance, aiming to provide full…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-22 Hengyi Hong , Qing Wang , Jun Du , Ruoyu Wei , Mingqi Cai , Xin Fang

We aim to perform sound event localization and detection (SELD) using wearable equipment for a moving human, such as a pedestrian. Conventional SELD tasks have dealt only with microphone arrays located in static positions. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Masahiro Yasuda , Shoichiro Saito , Akira Nakayama , Noboru Harada

Sound event localization and detection (SELD) is an emerging research topic that aims to unify the tasks of sound event detection and direction-of-arrival estimation. As a result, SELD inherits the challenges of both tasks, such as noise,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Zhen Jian Lee , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

Sound event localization and detection (SELD) consists of two subtasks, which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Ngoc Khanh Nguyen , Douglas L. Jones , Woon-Seng Gan

Sound event localization and detection (SELD) is a combined task of identifying the sound event and its direction. Deep neural networks (DNNs) are utilized to associate them with the sound signals observed by a microphone array. Although…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Kento Nagatomo , Masahiro Yasuda , Kohei Yatabe , Shoichiro Saito , Yasuhiro Oikawa

Artificial sound event detection (SED) has the aim to mimic the human ability to perceive and understand what is happening in the surroundings. Nowadays, Deep Learning offers valuable techniques for this goal such as Convolutional Neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-26 Fabio Vesperini , Leonardo Gabrielli , Emanuele Principi , Stefano Squartini

Sound event localization and detection consists of two subtasks which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Thi Ngoc Tho Nguyen , Karn Watcharasupat , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

This paper presents a new learning strategy for the Sound Event Detection (SED) system to tackle the issues of i) knowledge migration from a pre-trained model to a new target model and ii) learning new sound events without forgetting the…

Machine Learning · Computer Science 2020-03-30 Eunjeong Koh , Fatemeh Saki , Yinyi Guo , Cheng-Yu Hung , Erik Visser

This technical report describes the systems submitted to the DCASE2022 challenge task 3: sound event localization and detection (SELD). The task aims to detect occurrences of sound events and specify their class, furthermore estimate their…

Sound · Computer Science 2025-12-30 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Sung Won Han

Sound source localization is crucial in acoustic sensing and monitoring-related applications. In this paper, we do a comprehensive analysis of improvement in sound source localization by combining the direction of arrivals (DOAs) with their…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-13 Ruchi Pandey , Shreyas Jaiswal , Huy Phan , Santosh Nannuru

This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by merging both audio…

Sound · Computer Science 2024-01-31 Adrian S. Roman , Baladithya Balamurugan , Rithik Pothuganti