English
Related papers

Related papers: Single-channel Speech Dereverberation via Generati…

200 papers

In this paper, we present Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial network (GAN) that enhances audio measured with body-conduction microphones. This type of capture equipment suppresses ambient noise at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-18 Julien Hauret , Thomas Joubaud , Véronique Zimpfer , Éric Bavu

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Daniel Michelsanti , Zheng-Hua Tan

With the advent of deep learning, research on noise-robust automatic speech recognition (ASR) has progressed rapidly. However, ASR performance in noisy conditions of single-channel systems remains unsatisfactory. Indeed, most single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Keisuke Kinoshita , Tsubasa Ochiai , Marc Delcroix , Tomohiro Nakatani

Recent studies have highlighted adversarial examples as ubiquitous threats to the deep neural network (DNN) based speech recognition systems. In this work, we present a U-Net based attention model, U-Net$_{At}$, to enhance adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Chao-Han Huck Yang , Jun Qi , Pin-Yu Chen , Xiaoli Ma , Chin-Hui Lee

Single-Image Super-Resolution can support robotic tasks in environments where a reliable visual stream is required to monitor the mission, handle teleoperation or study relevant visual details. In this work, we propose an efficient…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Simone Angarano , Francesco Salvetti , Mauro Martini , Marcello Chiaberge

We propose an end-to-end joint optimization framework of a multi-channel neural speech extraction and deep acoustic model without mel-filterbank (FBANK) extraction for overlapped speech recognition. First, based on a multi-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Bo Wu , Meng Yu , Lianwu Chen , Chao Weng , Dan Su , Dong Yu

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

Speech applications in far-field real world settings often deal with signals that are corrupted by reverberation. The task of dereverberation constitutes an important step to improve the audible quality and to reduce the error rates in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-26 Anurenjan Purushothaman , Debottam Dutta , Rohit Kumar , Sriram Ganapathy

Target speech extraction, which extracts the speech of a target speaker in a mixture given auxiliary speaker clues, has recently received increased interest. Various clues have been investigated such as pre-recorded enrollment utterances,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Marc Delcroix , Katerina Zmolikova , Tsubasa Ochiai , Keisuke Kinoshita , Tomohiro Nakatani

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

The past few years have witnessed fast development in video quality enhancement via deep learning. Existing methods mainly focus on enhancing the objective quality of compressed video while ignoring its perceptual quality. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Jianyi Wang , Xin Deng , Mai Xu , Congyong Chen , Yuhang Song

Generative adversarial networks (GANs) have been indicated their superiority in usage of the real-time speech synthesis. Nevertheless, most of them make use of deep convolutional layers as their backbone, which may cause the absence of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-17 Zhenxing Lu , Mengnan He , Ruixiong Zhang , Caixia Gong

In real-world settings, speech signals are almost always affected by reverberation produced by the working environment; these corrupted signals need to be \emph{dereverberated} prior to performing, e.g., speech recognition, speech-to-text…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-06 Diego León , Felipe Tobar

Recently, cycle-consistent adversarial network (Cycle-GAN) has been successfully applied to voice conversion to a different speaker without parallel data, although in those approaches an individual model is needed for each target speaker.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-26 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee , Lin-shan Lee

We propose a new Generative Adversarial Network for Compressed Video quality Enhancement (CVEGAN). The CVEGAN generator benefits from the use of a novel Mul2Res block (with multiple levels of residual learning branches), an enhanced…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Di Ma , Fan Zhang , David R. Bull

Speech enhancement deep learning systems usually require large amounts of training data to operate in broad conditions or real applications. This makes the adaptability of those systems into new, low resource environments an important…

Sound · Computer Science 2017-12-19 Santiago Pascual , Maruchan Park , Joan Serrà , Antonio Bonafonte , Kang-Hun Ahn

To efficiently extract textual information from color degraded document images is a significant research area. The prolonged imperfect preservation of ancient documents has led to various types of degradation, such as page staining, paper…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Rui-Yang Ju , Yu-Shian Lin , Jen-Shiun Chiang , Chih-Chia Chen , Wei-Han Chen , Chun-Tse Chien

We present a simple yet effective Targeted Adversarial Training (TAT) algorithm to improve adversarial training for natural language understanding. The key idea is to introspect current mistakes and prioritize adversarial training steps to…

Computation and Language · Computer Science 2021-04-14 Lis Pereira , Xiaodong Liu , Hao Cheng , Hoifung Poon , Jianfeng Gao , Ichiro Kobayashi

Speech synthesis is an important practical generative modeling problem that has seen great progress over the last few years, with likelihood-based autoregressive neural models now outperforming traditional concatenative systems. A downside…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Alexey A. Gritsenko , Tim Salimans , Rianne van den Berg , Jasper Snoek , Nal Kalchbrenner

Deep learning has become a standard approach for the modeling of audio effects, yet strictly black-box modeling remains problematic for time-varying systems. Unlike time-invariant effects, training models on devices with internal modulation…

Sound · Computer Science 2025-12-18 Yann Bourdin , Pierrick Legrand , Fanny Roche