中文
相关论文

相关论文: SELD-TCN: Sound Event Localization & Detection via…

200 篇论文

We target the problem of developing new low-complexity networks for the sound event detection task. Our goal is to meticulously analyze the performance-complexity trade-off, aiming to be competitive with the large state-of-the-art models,…

声音 · 计算机科学 2025-06-13 Tobias Morocutti , Florian Schmid , Jonathan Greif , Francesco Foscarin , Gerhard Widmer

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

计算机视觉与模式识别 · 计算机科学 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Sound event localization and detection with distance estimation (3D SELD) in video involves identifying active sound events at each time frame while estimating their spatial coordinates. This multimodal task requires joint reasoning across…

音频与语音处理 · 电气工程与系统科学 2026-01-27 Davide Berghi , Philip J. B. Jackson

Pre-training methods have achieved significant performance improvements in sound event localization and detection (SELD) tasks, but existing Transformer-based models suffer from high computational complexity. In this work, we propose a…

音频与语音处理 · 电气工程与系统科学 2025-06-17 Wenmiao Gao , Yang Xiao

Localizing sounds and detecting events in different room environments is a difficult task, mainly due to the wide range of reflections and reverberations. When training neural network models with sounds recorded in only a few room…

音频与语音处理 · 电气工程与系统科学 2023-06-06 Yusun Shul , Byeong-Yun Ko , Jung-Woo Choi

Our goal is to develop a sound event localization and detection (SELD) system that works robustly in unknown environments. A SELD system trained on known environment data is degraded in an unknown environment due to environmental effects…

音频与语音处理 · 电气工程与系统科学 2022-02-21 Masahiro Yasuda , Yasunori Ohishi , Shoichiro Saito

This technical report presents our submission to Task 3 of the DCASE 2025 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. We address the audio-only task in this report and introduce several key…

音频与语音处理 · 电气工程与系统科学 2025-07-02 Jun-Wei Yeow , Ee-Leng Tan , Santi Peksi , Woon-Seng Gan

Sound event localization aims at estimating the positions of sound sources in the environment with respect to an acoustic receiver (e.g. a microphone array). Recent advances in this domain most prominently focused on utilizing deep…

Analyzing spatio-temporal data like video is a challenging task that requires processing visual and temporal information effectively. Convolutional Neural Networks have shown promise as baseline fixed feature extractors through transfer…

计算机视觉与模式识别 · 计算机科学 2017-11-06 Dillon Graham , Seyed Hamed Fatemi Langroudi , Christopher Kanan , Dhireesha Kudithipudi

In this study, we introduce a convolutional time-frequency-channel "Squeeze and Excitation" (tfc-SE) module to explicitly model inter-dependencies between the time-frequency domain and multiple channels. The tfc-SE module consists of two…

音频与语音处理 · 电气工程与系统科学 2019-08-06 Wei Xia , Kazuhito Koishida

In this article, we describe Conditioned Localizer and Classifier (CoLoC) which is a novel solution for Sound Event Localization and Detection (SELD). The solution constitutes of two stages: the localization is done first and is followed by…

声音 · 计算机科学 2022-10-26 Sławomir Kapka , Jakub Tkaczuk

Humanoid robots require simultaneous sound event type and direction estimation for situational awareness, but conventional two-channel input struggles with elevation estimation and front-back confusion. This paper proposes a binaural sound…

音频与语音处理 · 电气工程与系统科学 2025-08-07 Gyeong-Tae Lee

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in audio tagging tasks. However, deploying these models on resource-constrained devices like the Raspberry Pi poses challenges related to computational…

Voice recognition and speaker identification are vital for applications in security and personal assistants. This paper presents a lightweight 1D-Convolutional Neural Network (1D-CNN) designed to perform speaker identification on minimal…

声音 · 计算机科学 2024-11-25 Irfan Nafiz Shahan , Pulok Ahmed Auvi

In conventional sound event detection (SED) models, two types of events, namely, those that are present and those that do not occur in an acoustic scene, are regarded as the same type of events. The conventional SED methods cannot…

声音 · 计算机科学 2021-02-11 Noriyuki Tonami , Keisuke Imoto , Yuki Okamoto , Takahiro Fukumori , Yoichi Yamashita

The goal of automatic sound event detection (SED) methods is to recognize what is happening in an audio signal and when it is happening. In practice, the goal is to recognize at what temporal instances different sounds are active within an…

音频与语音处理 · 电气工程与系统科学 2021-07-13 Annamaria Mesaros , Toni Heittola , Tuomas Virtanen , Mark D. Plumbley

Sound event detection (SED) is a hot topic in consumer and smart city applications. Existing approaches based on Deep Neural Networks are very effective, but highly demanding in terms of memory, power, and throughput when targeting…

机器学习 · 计算机科学 2021-01-13 Gianmarco Cerutti , Renzo Andri , Lukas Cavigelli , Michele Magno , Elisabetta Farella , Luca Benini

Sound Event Detection (SED) plays a vital role in audio understanding, with applications in surveillance, smart cities, healthcare, and multimedia indexing. However, conventional SED systems operate under a closed-world assumption, limiting…

声音 · 计算机科学 2026-05-22 P. H. Hai , L. T. Minh , L. H. Son

This paper investigates the feasibility of class-incremental learning (CIL) for Sound Event Localization and Detection (SELD) tasks. The method features an incremental learner that can learn new sound classes independently while preserving…

音频与语音处理 · 电气工程与系统科学 2024-11-21 Ruchi Pandey , Manjunath Mulimani , Archontis Politis , Annamaria Mesaros

In this paper, we optimize a faster region-based convolutional neural network (FRCNN) for 1-dimensional (1D) signal processing and electromagnetic spectrum sensing. We target a cluttered radio frequency (RF) environment, where multiple RF…

信号处理 · 电气工程与系统科学 2023-02-21 Todd Morehouse , Charles Montes , Ruolin Zhou