English
Related papers

Related papers: PostGAN: A GAN-Based Post-Processor to Enhance the…

200 papers

Enhancement algorithms for wireless acoustics sensor networks~(WASNs) are indispensable with the increasing availability and usage of connected devices with microphones. Conventional spatial filtering approaches for enhancement in WASNs…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Sneha Das , Tom Bäckström

We provide a speech coding scheme employing a generative model based on SampleRNN that, while operating at significantly lower bitrates, matches or surpasses the perceptual quality of state-of-the-art classic wide-band codecs. Moreover, it…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Janusz Klejsa , Per Hedelin , Cong Zhou , Roy Fejgin , Lars Villemoes

Logical Access (LA) attacks, also known as audio deepfake attacks, use Text-to-Speech (TTS) or Voice Conversion (VC) methods to generate spoofed speech data. This can represent a serious threat to Automatic Speaker Verification (ASV)…

Sound · Computer Science 2026-03-17 Anacin , Angela , Shruti Kshirsagar , Anderson R. Avila

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

We investigate the effectiveness of generative adversarial networks (GANs) for speech enhancement, in the context of improving noise robustness of automatic speech recognition (ASR) systems. Prior work demonstrates that GANs can effectively…

Sound · Computer Science 2018-11-01 Chris Donahue , Bo Li , Rohit Prabhavalkar

In this paper, we propose an enhanced triplet method that improves the encoding process of embeddings by jointly utilizing generative adversarial mechanism and multitasking optimization. We extend our triplet encoder with Generative…

Sound · Computer Science 2018-03-28 Wenhao Ding , Liang He

Classical speech coding uses low-complexity postfilters with zero lookahead to enhance the quality of coded speech, but their effectiveness is limited by their simplicity. Deep Neural Networks (DNNs) can be much more effective, but require…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-14 Jan Büthe , Jean-Marc Valin , Ahmed Mustafa

Existing deep learning based speech enhancement mainly employ a data-driven approach, which leverage large amounts of data with a variety of noise types to achieve noise removal from noisy signal. However, the high dependence on the data…

Sound · Computer Science 2024-01-24 Huaying Xue , Xiulian Peng , Yan Lu

Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level perceptual quality,…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Kailang Ye , Mingze Gong , Shuoyao Wang , Daquan Feng

Vocoders, encoding speech signals into acoustic features and allowing for speech signal reconstruction from them, have been studied for decades. Recently, the rise of deep learning has particularly driven the development of neural vocoders…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Shaowen Chen , Tomoki Toda

This paper proposes a framework for modeling sound change that combines deep learning and iterative learning. Acquisition and transmission of speech is modeled by training generations of Generative Adversarial Networks (GANs) on unannotated…

Computation and Language · Computer Science 2021-09-23 Gašper Beguš

Network coding enhances performance in network communications and distributed storage by increasing throughput and robustness while reducing latency. Batched Sparse (BATS) codes are a class of capacity-achieving network codes, but their…

Hardware Architecture · Computer Science 2025-01-10 Jiaxin Qing , Philip H. W. Leong , Kin Hong Lee , Raymond W. Yeung

This paper proposes a spectral-domain perceptual weighting technique for Parallel WaveGAN-based text-to-speech (TTS) systems. The recently proposed Parallel WaveGAN vocoder successfully generates waveform sequences using a fast…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-20 Eunwoo Song , Ryuichi Yamamoto , Min-Jae Hwang , Jin-Seob Kim , Ohsung Kwon , Jae-Min Kim

Discrete Audio codecs (or audio tokenizers) have recently regained interest due to the ability of Large Language Models (LLMs) to learn their compressed acoustic representations. Various publicly available trainable discrete tokenizers…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Slava Shechtman , Avihu Dekel

Speech derverberation using a single microphone is addressed in this paper. Motivated by the recent success of the fully convolutional networks (FCN) in many image processing applications, we investigate their applicability to enhance the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-05 Ori Ernst , Shlomo E. Chazan , Sharon Gannot , Jacob Goldberger

Generative adversarial network (GAN) models can synthesize highquality audio signals while ensuring fast sample generation. However, they are difficult to train and are prone to several issues including mode collapse and divergence. In this…

Sound · Computer Science 2024-02-06 Teysir Baoueb , Haocheng Liu , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

In this paper, we present Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial network (GAN) that enhances audio measured with body-conduction microphones. This type of capture equipment suppresses ambient noise at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-18 Julien Hauret , Thomas Joubaud , Véronique Zimpfer , Éric Bavu

We propose a new Generative Adversarial Network for Compressed Video quality Enhancement (CVEGAN). The CVEGAN generator benefits from the use of a novel Mul2Res block (with multiple levels of residual learning branches), an enhanced…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Di Ma , Fan Zhang , David R. Bull

This work focuses on low bitrate video streaming scenarios (e.g. 50 - 200Kbps) where the video quality is severely compromised. We present a family of novel deep generative models for enhancing perceptual video quality of such streams by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Tejas Khot , Nataliya Shapovalova , Silviu Andrei , Walterio Mayol-Cuevas

Recent developments in generative models have shown that deep learning combined with traditional digital signal processing (DSP) techniques could successfully generate convincing violin samples [1], that source-excitation combined with…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Ollie McCarthy , Zohaib Ahmed