中文
相关论文

相关论文: Exploring Audio-Visual Information Fusion for Soun…

200 篇论文

Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only problem, but visual information has been recently included.…

音频与语音处理 · 电气工程与系统科学 2023-12-15 Davide Berghi , Peipei Wu , Jinzheng Zhao , Wenwu Wang , Philip J. B. Jackson

This work presents HDA-SELD, a unified framework that combines hierarchical cross-modal distillation (HCMD) and multi-level data augmentation to address low-resource audio-visual (AV) sound event localization and detection (SELD). An…

声音 · 计算机科学 2025-09-30 Qing Wang , Ya Jiang , Hang Chen , Sabato Marco Siniscalchi , Jun Du , Jianqing Gao

This report presents our systems submitted to the audio-only and audio-visual tracks of the DCASE2025 Task 3 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. SELD is a complex task that combines…

音频与语音处理 · 电气工程与系统科学 2025-07-08 Davide Berghi , Philip J. B. Jackson

Sound Event Localization and Detection (SELD) is crucial in spatial audio processing, enabling systems to detect sound events and estimate their 3D directions. Existing SELD methods use single- or dual-branch architectures: single-branch…

声音 · 计算机科学 2025-07-31 Hogeon Yu

Environment shifts and conflicts present significant challenges for learning-based sound event localization and detection (SELD) methods. SELD systems, when trained in particular acoustic settings, often show restricted generalization…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

In this study, we address the multimodal task of stereo sound event localization and detection with source distance estimation (3D SELD) in regular video content. 3D SELD is a complex task that combines temporal event classification with…

音频与语音处理 · 电气工程与系统科学 2025-09-09 Davide Berghi , Philip J. B. Jackson

In this paper, we propose a novel four-stage data augmentation approach to ResNet-Conformer based acoustic modeling for sound event localization and detection (SELD). First, we explore two spatial augmentation techniques, namely audio…

声音 · 计算机科学 2023-03-08 Qing Wang , Jun Du , Hua-Xin Wu , Jia Pan , Feng Ma , Chin-Hui Lee

This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23 model and adapt it to be audio-visual by merging both audio…

声音 · 计算机科学 2024-01-31 Adrian S. Roman , Baladithya Balamurugan , Rithik Pothuganti

This paper presents the objective, dataset, baseline, and metrics of Task 3 of the DCASE2025 Challenge on sound event localization and detection (SELD). In previous editions, the challenge used four-channel audio formats of first-order…

Sound event localization and detection (SELD) is a joint task of sound event detection and direction-of-arrival estimation. In DCASE 2022 Task 3, types of data transform from computationally generated spatial recordings to recordings of…

音频与语音处理 · 电气工程与系统科学 2022-09-12 Jinbo Hu , Yin Cao , Ming Wu , Qiuqiang Kong , Feiran Yang , Mark D. Plumbley , Jun Yang

Sound Event Detection and Localization (SELD) is a combined task of identifying sound events and their corresponding direction-of-arrival (DOA). While this task has numerous applications and has been extensively researched in recent years,…

声音 · 计算机科学 2024-06-13 Daniel Aleksander Krause , Archontis Politis , Annamaria Mesaros

Sound Event Detection and Localization (SELD) constitutes a complex task that depends on extensive multichannel audio recordings with annotated sound events and their respective locations. In this paper, we introduce a self-supervised…

音频与语音处理 · 电气工程与系统科学 2024-01-02 Orlem Lima dos Santos , Karen Rosero , Roberto de Alencar Lotufo

This technical report presents our submission to Task 3 of the DCASE 2025 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. We address the audio-only task in this report and introduce several key…

音频与语音处理 · 电气工程与系统科学 2025-07-02 Jun-Wei Yeow , Ee-Leng Tan , Santi Peksi , Woon-Seng Gan

This technical report describes the systems submitted to the DCASE2022 challenge task 3: sound event localization and detection (SELD). The task aims to detect occurrences of sound events and specify their class, furthermore estimate their…

声音 · 计算机科学 2025-12-30 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Sung Won Han

In traditional sound event localization and detection (SELD) tasks, the focus is typically on sound event detection (SED) and direction-of-arrival (DOA) estimation, but they fall short of providing full spatial information about the sound…

声音 · 计算机科学 2025-01-22 Yuxuan Dong , Qing Wang , Hengyi Hong , Ya Jiang , Shi Cheng

Concurrent Speaker Detection (CSD), the task of identifying active speakers and their overlaps in an audio signal, is essential for various audio applications, including meeting transcription, speaker diarization, and speech separation.…

音频与语音处理 · 电气工程与系统科学 2025-01-16 Amit Eliav , Sharon Gannot

Sound Event Localization and Detection (SELD) combines the Sound Event Detection (SED) with the corresponding Direction Of Arrival (DOA). Recently, adopted event oriented multi-track methods affect the generality in polyphonic environments…

声音 · 计算机科学 2026-02-02 Xueping Zhang , Yaxiong Chen , Ruilin Yao , Yunfei Zi , Shengwu Xiong

Sound event localization and detection (SELD) systems estimate both the direction-of-arrival (DOA) and class of sound sources over time. In the DCASE 2022 SELD Challenge (Task 3), models are designed to operate in a 4-channel setting. While…

This report presents the dataset and the evaluation setup of the Sound Event Localization & Detection (SELD) task for the DCASE 2020 Challenge. The SELD task refers to the problem of trying to simultaneously classify a known set of sound…

音频与语音处理 · 电气工程与系统科学 2020-06-30 Archontis Politis , Sharath Adavanne , Tuomas Virtanen

Sound event localization and detection (SELD) aims to determine the appearance of sound classes, together with their Direction of Arrival (DOA). However, current SELD systems can only predict the activities of specific classes, for example,…

音频与语音处理 · 电气工程与系统科学 2024-06-25 Jinzheng Zhao , Xinyuan Qian , Yong Xu , Haohe Liu , Yin Cao , Davide Berghi , Wenwu Wang
‹ 上一页 1 2 3 10 下一页 ›