English
Related papers

Related papers: Speech Enhancement Based on Cyclegan with Noise-in…

200 papers

Recently, deep learning approaches have been extensively studied for low-dose CT denoising thanks to its superior performance despite the fast computational time. In particular, cycleGAN has been demonstrated as a powerful unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2020-08-14 Jawook Gu , Jong Chul Ye

Speech enhancement deep learning systems usually require large amounts of training data to operate in broad conditions or real applications. This makes the adaptability of those systems into new, low resource environments an important…

Sound · Computer Science 2017-12-19 Santiago Pascual , Maruchan Park , Joan Serrà , Antonio Bonafonte , Kang-Hun Ahn

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Deep learning based visual to sound generation systems essentially need to be developed particularly considering the synchronicity aspects of visual and audio features with time. In this research we introduce a novel task of guiding a class…

Machine Learning · Computer Science 2021-07-21 Sanchita Ghose , John J. Prevost

In this paper, a new semi-supervised deep multiple-input multiple-output (MIMO) detection approach using a cycle-consistent generative adversarial network (CycleGAN) is proposed for communication systems without any prior knowledge of…

Signal Processing · Electrical Eng. & Systems 2023-04-24 Hongzhi Zhu , Yongliang Guo , Wei Xu , Xiaohu You

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

The intelligibility of speech severely degrades in the presence of environmental noise and reverberation. In this paper, we propose a novel deep learning based system for modifying the speech signal to increase its intelligibility under the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Haoyu Li , Junichi Yamagishi

Recently, Generative Adversarial Networks (GAN)-based methods have shown remarkable performance for the Voice Conversion and WHiSPer-to-normal SPeeCH (WHSP2SPCH) conversion. One of the key challenges in WHSP2SPCH conversion is the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Maitreya Patel , Mirali Purohit , Jui Shah , Hemant A. Patil

We propose to implement speech enhancement by the regeneration of clean speech from a salient representation extracted from the noisy signal. The network that extracts salient features is trained using a set of weight-sharing clones of the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-12 Michael Chinen , W. Bastiaan Kleijn , Felicia S. C. Lim , Jan Skoglund

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

Sound · Computer Science 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Speech-related applications deliver inferior performance in complex noise environments. Therefore, this study primarily addresses this problem by introducing speech-enhancement (SE) systems based on deep neural networks (DNNs) applied to a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Syu-Siang Wang , Yu-You Liang , Jeih-weih Hung , Yu Tsao , Hsin-Min Wang , Shih-Hau Fang

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Joint training of speech enhancement model (SE) and speech recognition model (ASR) is a common solution for robust ASR in noisy environments. SE focuses on improving the auditory quality of speech, but the enhanced feature distribution is…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-04 Tianrui Wang , Weibin Zhu , Yingying Gao , Junlan Feng , Shilei Zhang

Intent classification is a fundamental task in the spoken language understanding field that has recently gained the attention of the scientific community, mainly because of the feasibility of approaching it with end-to-end neural models. In…

Computation and Language · Computer Science 2023-03-14 Mohamed Nabih Ali , Alessio Brutti , Daniele Falavigna

In the big data era, the impetus to digitize the vast reservoirs of data trapped in unstructured scanned documents such as invoices, bank documents and courier receipts has gained fresh momentum. The scanning process often results in the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Monika Sharma , Abhishek Verma , Lovekesh Vig

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-27 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Li-Rong Dai

I show that a one-dimensional (1D) conditional generative adversarial network (cGAN) with an adversarial training architecture is capable of unpaired signal-to-signal ("sig2sig") translation. Using a simplified CycleGAN model with 1D layers…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Eric Easthope

In this work, we further develop the conformer-based metric generative adversarial network (CMGAN) model for speech enhancement (SE) in the time-frequency (TF) domain. This paper builds on our previous work but takes a more in-depth look by…

Sound · Computer Science 2024-05-07 Sherif Abdulatif , Ruizhe Cao , Bin Yang