English
Related papers

Related papers: High Fidelity Speech Synthesis with Adversarial Ne…

200 papers

The Visual Dialogue task requires an agent to engage in a conversation about an image with a human. It represents an extension of the Visual Question Answering task in that the agent needs to answer a question about an image, but it needs…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Qi Wu , Peng Wang , Chunhua Shen , Ian Reid , Anton van den Hengel

Training deep neural networks on well-understood dependencies in speech data can provide new insights into how they learn internal representations. This paper argues that acquisition of speech can be modeled as a dependency between random…

Computation and Language · Computer Science 2020-09-29 Gašper Beguš

Automatically generating coherent and semantically meaningful text has many applications in machine translation, dialogue systems, image captioning, etc. Recently, by combining with policy gradient, Generative Adversarial Nets (GAN) that…

Computation and Language · Computer Science 2017-12-11 Jiaxian Guo , Sidi Lu , Han Cai , Weinan Zhang , Yong Yu , Jun Wang

In this paper we propose a novel defense approach against end-to-end adversarial attacks developed to fool advanced speech-to-text systems such as DeepSpeech and Lingvo. Unlike conventional defense approaches, the proposed approach does not…

Sound · Computer Science 2021-02-23 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

In this work we demonstrate that generative adversarial networks (GANs) can be used to generate realistic pervasive changes in remote sensing imagery, even in an unpaired training setting. We investigate some transformation quality metrics…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Christopher X. Ren , Amanda Ziemann , James Theiler , Alice M. S. Durieux

Random noise arising from physical processes is an inherent characteristic of measurements and a limiting factor for most signal processing and data analysis tasks. Given the recent interest in generative adversarial networks (GANs) for…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Adam Wunderlich , Jack Sklar

This paper presents a simple method for speech videos generation based on audio: given a piece of audio, we can generate a video of the target face speaking this audio. We propose Generative Adversarial Networks (GAN) with cut speech audio…

Sound · Computer Science 2022-07-20 Hanhaodi Zhang

Speech synthesis is widely used in many practical applications. In recent years, speech synthesis technology has developed rapidly. However, one of the reasons why synthetic speech is unnatural is that it often has over-smoothness. In order…

Sound · Computer Science 2018-12-18 Leyuan Sheng , Evgeniy N. Pavlovskiy

Generative Adversarial Networks (GANs) for text generation have recently received many criticisms, as they perform worse than their MLE counterparts. We suspect previous text GANs' inferior performance is due to the lack of a reliable…

Computation and Language · Computer Science 2021-04-28 Qingyang Wu , Lei Li , Zhou Yu

Neural conversational models learn to generate responses by taking into account the dialog history. These models are typically optimized over the query-response pairs with a maximum likelihood estimation objective. However, the…

Computation and Language · Computer Science 2020-03-05 Shaoxiong Feng , Hongshen Chen , Kan Li , Dawei Yin

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

Machine Learning · Computer Science 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Generative Adversarial Networks (GAN) have attracted much research attention recently, leading to impressive results for natural image generation. However, to date little success was observed in using GAN generated images for improving…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Xinlong Wang , Zhipeng Man , Mingyu You , Chunhua Shen

In this paper, we present a Diffusion GAN based approach (Prosodic Diff-TTS) to generate the corresponding high-fidelity speech based on the style description and content text as an input to generate speech samples within only 4 denoising…

Sound · Computer Science 2023-10-30 Neeraj Kumar , Ankur Narang , Brejesh Lall

Adversarial loss in a conditional generative adversarial network (GAN) is not designed to directly optimize evaluation metrics of a target task, and thus, may not always guide the generator in a GAN to generate data with improved metric…

Sound · Computer Science 2019-05-14 Szu-Wei Fu , Chien-Feng Liao , Yu Tsao , Shou-De Lin

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

In recent years, Generative Adversarial Networks (GANs) have shown substantial progress in modeling complex distributions of data. These networks have received tremendous attention since they can generate implicit probabilistic models that…

Signal Processing · Electrical Eng. & Systems 2018-10-25 Mehdi Ahmadi , Timothy Nest , Mostafa Abdelnaim , Thanh-Dung Le

In this paper, we introduce Logic Tensor Network-Enhanced Generative Adversarial Network (LTN-GAN), a novel framework that enhances Generative Adversarial Networks (GANs) by incorporating Logic Tensor Networks (LTNs) to enforce…

Machine Learning · Computer Science 2026-01-08 Nijesh Upreti , Vaishak Belle

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

This study aims at designing an environment-aware text-to-speech (TTS) system that can generate speech to suit specific acoustic environments. It is also motivated by the desire to leverage massive data of speech audio from heterogeneous…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-09 Daxin Tan , Guangyan Zhang , Tan Lee