English
Related papers

Related papers: Unconditional Audio Generation with Generative Adv…

200 papers

Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across…

Sound · Computer Science 2023-02-17 Sang-gil Lee , Wei Ping , Boris Ginsburg , Bryan Catanzaro , Sungroh Yoon

Generative Adversarial Networks (GANs) have gathered a lot of attention from the computer vision community, yielding impressive results for image generation. Advances in the adversarial generation of natural language from noise however are…

Computation and Language · Computer Science 2017-06-01 Sai Rajeswar , Sandeep Subramanian , Francis Dutil , Christopher Pal , Aaron Courville

In this work, we address the task of unconditional head motion generation to animate still human faces in a low-dimensional semantic space from a single reference pose. Different from traditional audio-conditioned talking head generation…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Louis Airale , Xavier Alameda-Pineda , Stéphane Lathuilière , Dominique Vaufreydaz

Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-stage enhancement…

Machine Learning · Computer Science 2020-10-28 Huy Phan , Ian V. McLoughlin , Lam Pham , Oliver Y. Chén , Philipp Koch , Maarten De Vos , Alfred Mertins

This paper presents a simple method for speech videos generation based on audio: given a piece of audio, we can generate a video of the target face speaking this audio. We propose Generative Adversarial Networks (GAN) with cut speech audio…

Sound · Computer Science 2022-07-20 Hanhaodi Zhang

Generative Adversarial Networks (GANs) are shown to be successful at generating new and realistic samples including 3D object models. Conditional GAN, a variant of GANs, allows generating samples in given conditions. However, objects…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Cihan Öngün , Alptekin Temizel

This chapter reviews recent developments of generative adversarial networks (GAN)-based methods for medical and biomedical image synthesis tasks. These methods are classified into conditional GAN and Cycle-GAN according to the network…

Medical Physics · Physics 2021-01-01 Yang Lei , Richard L. J. Qiu , Tonghe Wang , Walter J. Curran , Tian Liu , Xiaofeng Yang

Adversarial examples are typically constructed by perturbing an existing data point within a small matrix norm, and current defense methods are focused on guarding against this type of attack. In this paper, we propose unrestricted…

Machine Learning · Computer Science 2018-12-04 Yang Song , Rui Shu , Nate Kushman , Stefano Ermon

We study the ability of Wasserstein Generative Adversarial Network (WGAN) to generate missing audio content which is, in context, (statistically similar) to the sound and the neighboring borders. We deal with the challenge of audio…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 P. P. Ebner , A. Eltelt

We introduce a new system for data-driven audio sound model design built around two different neural network architectures, a Generative Adversarial Network(GAN) and a Recurrent Neural Network (RNN), that takes advantage of the unique…

Sound · Computer Science 2022-06-28 Lonce Wyse , Purnima Kamath , Chitralekha Gupta

Generative Adversarial Networks (GANs) have shown immense potential in fields such as text and image generation. Only very recently attempts to exploit GANs to statistical-mechanics models have been reported. Here we quantitatively test…

Statistical Mechanics · Physics 2024-05-07 Daniele Lanzoni , Olivier Pierre-Louis , Francesco Montalenti

Diffusion-based audio and music generation models commonly perform generation by constructing an image representation of audio (e.g., a mel-spectrogram) and then convert it to audio using a phase reconstruction model or vocoder. Typical…

Sound · Computer Science 2024-10-08 Ge Zhu , Juan-Pablo Caceres , Zhiyao Duan , Nicholas J. Bryan

Despite the rapid development of adversarial machine learning, most adversarial attack and defense researches mainly focus on the perturbation-based adversarial examples, which is constrained by the input images. In comparison with existing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Xiaosen Wang , Kun He , Chuanbiao Song , Liwei Wang , John E. Hopcroft

In this paper, we propose a novel generative model named Stacked Generative Adversarial Networks (SGAN), which is trained to invert the hierarchical representations of a bottom-up discriminative network. Our model consists of a top-down…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Xun Huang , Yixuan Li , Omid Poursaeed , John Hopcroft , Serge Belongie

This paper introduces Structured Noise Space GAN (SNS-GAN), a novel approach in the field of generative modeling specifically tailored for class-conditional generation in both image and time series data. It addresses the challenge of…

Machine Learning · Computer Science 2023-12-21 Hamidreza Gholamrezaei , Alireza Koochali , Andreas Dengel , Sheraz Ahmed

Today text classification models have been widely used. However, these classifiers are found to be easily fooled by adversarial examples. Fortunately, standard attacking methods generate adversarial texts in a pair-wise way, that is, an…

Computation and Language · Computer Science 2020-03-24 Yankun Ren , Jianbin Lin , Siliang Tang , Jun Zhou , Shuang Yang , Yuan Qi , Xiang Ren

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Generative models are successfully used for image synthesis in the recent years. But when it comes to other modalities like audio, text etc little progress has been made. Recent works focus on generating audio from a generative model in an…

Computer Vision and Pattern Recognition · Computer Science 2018-09-30 Chae Young Lee , Anoop Toffy , Gue Jun Jung , Woo-Jin Han

Adversarial perturbations can pose a serious threat for deploying machine learning systems. Recent works have shown existence of image-agnostic perturbations that can fool classifiers over most natural images. Existing methods present…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Konda Reddy Mopuri , Utkarsh Ojha , Utsav Garg , R. Venkatesh Babu

Time-frequency (TF) representations provide powerful and intuitive features for the analysis of time series such as audio. But still, generative modeling of audio in the TF domain is a subtle matter. Consequently, neural audio synthesis…

Sound · Computer Science 2019-05-17 Andrés Marafioti , Nicki Holighaus , Nathanaël Perraudin , Piotr Majdak