English
Related papers

Related papers: SICRN: Advancing Speech Enhancement through State …

200 papers

Attention mechanisms, such as local and non-local attention, play a fundamental role in recent deep learning based speech enhancement (SE) systems. However, natural speech contains many fast-changing and relatively brief acoustic events,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-16 Xinmeng Xu , Weiping Tu , Yuhong Yang

In recent years, waveform-mapping-based speech enhancement (SE) methods have garnered significant attention. These methods generally use a deep learning model to directly process and reconstruct speech waveforms. Because both the input and…

Sound · Computer Science 2020-02-25 Chang-Le Liu , Sze-Wei Fu , You-Jin Li , Jen-Wei Huang , Hsin-Min Wang , Yu Tsao

Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition that stills remains an important challenge. Data-driven supervised approaches, including ones based on…

A deep learning approach has been widely applied in sequence modeling problems. In terms of automatic speech recognition (ASR), its performance has significantly been improved by increasing large speech corpus and deeper neural network.…

Computation and Language · Computer Science 2016-12-28 Zewang Zhang , Zheng Sun , Jiaqi Liu , Jingwen Chen , Zhao Huo , Xiao Zhang

Recent speech enhancement methods based on convolutional neural networks (CNNs) and transformer have been demonstrated to efficaciously capture time-frequency (T-F) information on spectrogram. However, the correlation of each channels of…

Sound · Computer Science 2024-07-16 Jizhen Li , Xinmeng Xu , Weiping Tu , Yuhong Yang , Rong Zhu

Humans interpret and perceive the world by integrating sensory information from multiple modalities, such as vision and hearing. Spiking Neural Networks (SNNs), as brain-inspired computational models, exhibit unique advantages in emulating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Xiang He , Dongcheng Zhao , Yiting Dong , Guobin Shen , Xin Yang , Yi Zeng

In this paper, in order to further deal with the performance degradation caused by ignoring the phase information in conventional speech enhancement systems, we proposed a temporal dilated convolutional generative adversarial network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-01 Shuaishuai Ye , Xinhui Hu , Xinkang Xu

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

Despite the rapid progress in speech enhancement (SE) research, enhancing the quality of desired speech in environments with strong noise and interfering speakers remains challenging. In this paper, we extend the application of the recently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Jianwei Yu , Yi Luo , Hangting Chen , Rongzhi Gu , Chao Weng

Recurrent models are a popular choice for video enhancement tasks such as video denoising or super-resolution. In this work, we focus on their stability as dynamical systems and show that they tend to fail catastrophically at inference time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Thomas Tanay , Aivar Sootla , Matteo Maggioni , Puneet K. Dokania , Philip Torr , Ales Leonardis , Gregory Slabaugh

This study introduces a reformed Sinc-convolution (Sincconv) framework tailored for the encoder component of deep networks for speech enhancement (SE). The reformed Sincconv, based on parametrized sinc functions as band-pass filters, offers…

Sound · Computer Science 2024-03-05 Kuan-Hsun Ho , Jeih-weih Hung , Berlin Chen

Thanks to the latest deep learning algorithms, silent speech interfaces (SSI) are now able to synthesize intelligible speech from articulatory movement data under certain conditions. However, the resulting models are rather…

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin

This study presents a systematic evaluation of time-frequency feature design for binaural sound source localization (SSL), focusing on how feature selection influences model performance across diverse conditions. We investigate the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-19 Davoud Shariat Panah , Alessandro Ragano , Dan Barry , Jan Skoglund , Andrew Hines

Speech dereverberation is often an important requirement in robust speech processing tasks. Supervised deep learning (DL) models give state-of-the-art performance for single-channel speech dereverberation. Temporal convolutional networks…

Sound · Computer Science 2022-07-04 William Ravenscroft , Stefan Goetze , Thomas Hain

This article surveys convolution-based models including convolutional neural networks (CNNs), Conformers, ResNets, and CRNNs-as speech signal processing models and provide their statistical backgrounds and speech recognition, speaker…

Sound · Computer Science 2024-12-02 Nirmal Joshua Kapu , Raghav Karan

Speech foundation models have recently demonstrated the ability to perform Speech In-Context Learning (SICL). Selecting effective in-context examples is crucial for SICL performance, yet selection methodologies remain underexplored. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Haolong Zheng , Yekaterina Yegorova , Mark Hasegawa-Johnson

Given the incomplete sampling of spatial frequencies by radio interferometers, achieving precise restoration of astrophysical information remains challenging. To address this ill-posed problem, compressive sensing(CS) provides a robust…

Instrumentation and Methods for Astrophysics · Physics 2025-05-09 Lei Yu , Bin Liu , Cheng-Jin Jin , Ru-Rong Chen , Hong-Wei Xi , Bo Peng

High resolution magnetic resonance (MR) imaging is desirable in many clinical applications due to its contribution to more accurate subsequent analyses and early clinical diagnoses. Single image super resolution (SISR) is an effective and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Xiaole Zhao , Yulun Zhang , Tao Zhang , Xueming Zou

The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges…

Sound · Computer Science 2021-08-31 Yanfeng Wu , Chenkai Guo , Junan Zhao , Xiao Jin , Jing Xu