English
Related papers

Related papers: Sound Event Detection in Multichannel Audio using …

200 papers

We propose a new deep network for audio event recognition, called AENet. In contrast to speech, sounds coming from audio events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an…

Multimedia · Computer Science 2017-01-05 Naoya Takahashi , Michael Gygli , Luc Van Gool

Sequential audio event tagging can provide not only the type information of audio events, but also the order information between events and the number of events that occur in an audio clip. Most previous works on audio event sequence…

Sound · Computer Science 2022-03-23 Yuanbo Hou , Zhaoyi Liu , Bo Kang , Yun Wang , Dick Botteldooren

Anomalous audio in speech recordings is often caused by speaker voice distortion, external noise, or even electric interferences. These obstacles have become a serious problem in some fields, such as high-quality music mixing and speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Qiang Huang , Thomas Hain

We propose a novel method for Acoustic Event Detection (AED). In contrast to speech, sounds coming from acoustic events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an extended time…

Sound · Computer Science 2016-12-09 Naoya Takahashi , Michael Gygli , Beat Pfister , Luc Van Gool

The Convolutional Neural Networks (CNNs) generate the feature representation of complex objects by collecting hierarchical and different parts of semantic sub-features. These sub-features can usually be distributed in grouped form in the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Xiang Li , Xiaolin Hu , Jian Yang

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jinlin You , Muyu Li , Xudong Zhao

Polyphonic sound event detection and direction-of-arrival estimation require different input features from audio signals. While sound event detection mainly relies on time-frequency patterns, direction-of-arrival estimation relies on…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Thi Ngoc Tho Nguyen , Douglas L. Jones , Woon-Seng Gan

Achieving superior enhancement performance while maintaining a low parameter count and computational complexity remains a challenge in the field of speech enhancement. In this paper, we introduce LORT, a novel architecture that integrates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Junyu Wang , Zizhen Lin , Tianrui Wang , Meng Ge , Longbiao Wang , Jianwu Dang

Environmental sound classification (ESC) is a challenging problem due to the complexity of sounds. The ESC performance is heavily dependent on the effectiveness of representative features extracted from the environmental sounds. However,…

Sound · Computer Science 2019-07-05 Zhichao Zhang , Shugong Xu , Tianhao Qiao , Shunqing Zhang , Shan Cao

This paper proposes sound event localization and detection methods from multichannel recording. The proposed system is based on two Convolutional Recurrent Neural Networks (CRNNs) to perform sound event detection (SED) and time difference…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-23 Francois Grondin , James Glass , Iwona Sobieraj , Mark D. Plumbley

Time-domain single-channel speech enhancement (SE) still remains challenging to extract the target speaker without any prior information on multi-talker conditions. It has been shown via auditory attention decoding that the brain activity…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-18 Jie Zhang , Qing-Tian Xu , Qiu-Shi Zhu , Zhen-Hua Ling

Environmental audio tagging is a newly proposed task to predict the presence or absence of a specific audio event in a chunk. Deep neural network (DNN) based methods have been successfully adopted for predicting the audio tags in the…

Sound · Computer Science 2017-02-28 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

Temporal modeling is key for action recognition in videos. It normally considers both short-range motions and long-range aggregations. In this paper, we propose a Temporal Excitation and Aggregation (TEA) block, including a motion…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Yan Li , Bin Ji , Xintian Shi , Jianguo Zhang , Bin Kang , Limin Wang

In speaker verification, ECAPA-TDNN has shown remarkable improvement by utilizing one-dimensional(1D) Res2Net block and squeeze-and-excitation(SE) module, along with multi-layer feature aggregation (MFA). Meanwhile, in vision tasks, ConvNet…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-01 Hyun-Jun Heo , Ui-Hyeop Shin , Ran Lee , YoungJu Cheon , Hyung-Min Park

Multi-stage learning is an effective technique to invoke multiple deep-learning modules sequentially. This paper applies multi-stage learning to speech enhancement by using a multi-stage structure, where each stage comprises a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-25 Ju Lin , Adriaan J. van Wijngaarden , Kuang-Ching Wang , Melissa C. Smith

Data synthesis and augmentation are essential for Sound Event Detection (SED) due to the scarcity of temporally labeled data. While augmentation methods like SpecAugment and Mix-up can enhance model performance, they remain constrained by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Jiarui Hai , Mounya Elhilali

In this paper, we introduce a novel attentional similarity module for the problem of few-shot sound recognition. Given a few examples of an unseen sound event, a classifier must be quickly adapted to recognize the new sound event without…

Sound · Computer Science 2019-02-19 Szu-Yu Chou , Kai-Hsiang Cheng , Jyh-Shing Roger Jang , Yi-Hsuan Yang

The exponential growth of multivariate time series data from sensor networks in domains like industrial monitoring and smart cities requires efficient and accurate forecasting models. Current deep learning methods often fail to adequately…

Machine Learning · Computer Science 2024-11-08 Xinxing Zhou , Jiaqi Ye , Shubao Zhao , Ming Jin , Chengyi Yang , Yanlong Wen , Xiaojie Yuan

Time-domain speech enhancement (SE) has recently been intensively investigated. Among recent works, DEMUCS introduces multi-resolution STFT loss to enhance performance. However, some resolutions used for STFT contain non-stationary signals,…

Sound · Computer Science 2023-03-28 Hao Shi , Masato Mimura , Longbiao Wang , Jianwu Dang , Tatsuya Kawahara

Sound event detection (SED) aims at identifying audio events (audio tagging task) in recordings and then locating them temporally (localization task). This last task ends with the segmentation of the frame-level class predictions, that…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-25 Leo Cances , Patrice Guyot , Thomas Pellegrini