English
Related papers

Related papers: Polyphonic Sound Event Detection Using Capsule Neu…

200 papers

This paper aims to improve the widely used deep speaker embedding x-vector model. We propose the following improvements: (1) a hybrid neural network structure using both time delay neural network (TDNN) and long short-term memory neural…

Computation and Language · Computer Science 2019-02-22 Yun Tang , Guohong Ding , Jing Huang , Xiaodong He , Bowen Zhou

Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-02 Hendrik Schröter , Alberto N. Escalante-B. , Tobias Rosenkranz , Andreas Maier

Deep learning has dramatically improved the performance of sounds recognition. However, learning acoustic models directly from the raw waveform is still challenging. Current waveform-based models generally use time-domain convolutional…

Sound · Computer Science 2018-03-29 Boqing Zhu , Changjian Wang , Feng Liu , Jin Lei , Zengquan Lu , Yuxing Peng

We target the problem of developing new low-complexity networks for the sound event detection task. Our goal is to meticulously analyze the performance-complexity trade-off, aiming to be competitive with the large state-of-the-art models,…

Sound · Computer Science 2025-06-13 Tobias Morocutti , Florian Schmid , Jonathan Greif , Francesco Foscarin , Gerhard Widmer

Stereo matching plays an indispensable part in autonomous driving, robotics and 3D scene reconstruction. We propose a novel deep learning architecture, which called CFP-Net, a Cross-Form Pyramid stereo matching network for regressing…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Zhidong Zhu , Mingyi He , Yuchao Dai , Zhibo Rao , Bo Li

Edge detection remains a fundamental yet challenging task in computer vision, especially under varying illumination, noise, and complex scene conditions. This paper introduces a Hybrid Multi-Stage Learning Framework that integrates…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Mark Phil Pacot , Jayno Juventud , Gleen Dalaorao

Automatic speech recognition (ASR) of single channel far-field recordings with an unknown number of speakers is traditionally tackled by cascaded modules. Recent research shows that end-to-end (E2E) multi-speaker ASR models can achieve…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Ilya Sklyar , Anna Piunova , Xianrui Zheng , Yulan Liu

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 K. A. Shahriar

In this paper we investigate the importance of the extent of memory in sequential self attention for sound recognition. We propose to use a memory controlled sequential self attention mechanism on top of a convolutional recurrent neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Arjun Pankajakshan , Helen L. Bear , Vinod Subramanian , Emmanouil Benetos

Perceptual sound matching (PSM) aims to find the input parameters to a synthesizer so as to best imitate an audio target. Deep learning for PSM optimizes a neural network to analyze and reconstruct prerecorded samples. In this context, our…

Sound · Computer Science 2024-05-07 Han Han , Vincent Lostanlen , Mathieu Lagrange

Sound event detection (SED) is an interesting but challenging task due to the scarcity of data and diverse sound events in real life. This paper presents a multi-grained based attention network (MGA-Net) for semi-supervised sound event…

Sound · Computer Science 2022-11-01 Ying Hu , Xiujuan Zhu , Yunlong Li , Hao Huang , Liang He

Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information…

Sound · Computer Science 2020-05-22 Helin Wang , Yuexian Zou , Dading Chong , Wenwu Wang

Fault diagnosis in multimode processes plays a critical role in ensuring the safe operation of industrial systems across multiple modes. It faces a great challenge yet to be addressed - that is, the significant distributional differences…

Machine Learning · Computer Science 2025-07-24 Guangqiang Li , M. Amine Atoui , Xiangshun Li

Although deep learning has advanced remote sensing change detection (RSCD), most methods rely solely on image modality, limiting feature representation, change pattern modeling, and generalization especially under illumination and noise…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yijun Zhou , Yikui Zhai , Zilu Ying , Tingfeng Xian , Wenlve Zhou , Zhiheng Zhou , Xiaolin Tian , Xudong Jia , Hongsheng Zhang , C. L. Philip Chen

Target sound detection (TSD) aims to detect the target sound from a mixture audio given the reference information. Previous methods use a conditional network to extract a sound-discriminative embedding from the reference audio, and then use…

Sound · Computer Science 2022-04-06 Dongchao Yang , Helin Wang , Zhongjie Ye , Yuexian Zou , Wenwu Wang

The rise of deepfake technologies has posed significant challenges to privacy, security, and information integrity, particularly in audio and multimedia content. This paper introduces a Quantum-Trained Convolutional Neural Network (QT-CNN)…

Sound · Computer Science 2024-10-15 Chu-Hsuan Abraham Lin , Chen-Yu Liu , Samuel Yen-Chi Chen , Kuan-Cheng Chen

Recently, a novel form of audio partial forgery has posed challenges to its forensics, requiring advanced countermeasures to detect subtle forgery manipulations within long-duration audio. However, existing countermeasures still serve a…

Multimedia · Computer Science 2024-07-24 Junyan Wu , Wei Lu , Xiangyang Luo , Rui Yang , Qian Wang , Xiaochun Cao

Polysomnographic sleep analysis is the standard clinical method to accurately diagnose and treat sleep disorders. It is an intricate process which involves the manual identification, classification, and location of multiple sleep event…

Signal Processing · Electrical Eng. & Systems 2025-05-29 Adriana Anido-Alonso , Diego Alvarez-Estevez

This study addresses unsupervised subword modeling, i.e., learning acoustic feature representations that can distinguish between subword units of a language. We propose a two-stage learning framework that combines self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Siyuan Feng , Odette Scharenborg

This paper introduces Binaural Sound Event Localization and Detection (BiSELD), a task that aims to jointly detect and localize multiple sound events using binaural audio, inspired by the spatial hearing mechanism of humans. To support this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-29 Gyeong-Tae Lee , Hyeonuk Nam , Yong-Hwa Park