English
Related papers

Related papers: Reducing Training Sample Memorization in GANs by T…

200 papers

GAIL is a recent successful imitation learning architecture that exploits the adversarial training procedure introduced in GANs. Albeit successful at generating behaviours similar to those demonstrated to the agent, GAIL suffers from a high…

Machine Learning · Computer Science 2019-03-11 Lionel Blondé , Alexandros Kalousis

We propose a higher-level associative memory for learning adversarial networks. Generative adversarial network (GAN) framework has a discriminator and a generator network. The generator (G) maps white noise (z) to data samples while the…

Machine Learning · Computer Science 2016-11-23 Tarik Arici , Asli Celikyilmaz

This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer,…

Machine Learning · Computer Science 2020-07-21 Chenyou Fan , Ping Liu

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Training regimes based on Maximum Likelihood Estimation (MLE) suffer from known limitations, often leading to poorly generated text sequences. At the root of these limitations is the mismatch between training and inference, i.e. the…

Computation and Language · Computer Science 2020-06-09 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Generative adversarial networks (GANs) have achieved remarkable progress in the natural image field. However, when applying GANs in the remote sensing (RS) image generation task, an extraordinary phenomenon is observed: the GAN model is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Xingzhe Su , Wenwen Qiang , Jie Hu , Fengge Wu , Changwen Zheng , Fuchun Sun

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

Generative Adversarial Networks are used for generating the data using a generator and a discriminator, GANs usually produce high-quality images, but training GANs in an adversarial setting is a difficult task. GANs require high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Md Nurul Muttakin , Malik Shahid Sultan , Robert Hoehndorf , Hernando Ombao

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

We are interested in the design of generative networks. The training of these mathematical structures is mostly performed with the help of adversarial (min-max) optimization problems. We propose a simple methodology for constructing such…

Machine Learning · Computer Science 2021-07-16 Kalliopi Basioti , George V. Moustakides

Deep generative models, such as Generative Adversarial Networks (GANs), synthesize diverse high-fidelity data samples by estimating the underlying distribution of high dimensional data. Despite their success, GANs may disclose private…

Machine Learning · Computer Science 2022-06-02 Parisa Hassanzadeh , Robert E. Tillman

The standard practice in Generative Adversarial Networks (GANs) discards the discriminator during sampling. However, this sampling method loses valuable information learned by the discriminator regarding the data distribution. In this work,…

Machine Learning · Computer Science 2019-11-25 Yuejiang Liu , Parth Kothari , Alexandre Alahi

Generative adversarial networks (GANs) are one of the most widely used generative models. GANs can learn complex multi-modal distributions, and generate real-like samples. Despite the major success of GANs in generating synthetic data, they…

Machine Learning · Computer Science 2021-09-07 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

In this work, we propose a composition/decomposition framework for adversarially training generative models on composed data - data where each sample can be thought of as being constructed from a fixed number of components. In our…

Machine Learning · Computer Science 2019-01-24 Yeu-Chern Harn , Zhenghao Chen , Vladimir Jojic

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Recently, sampling methods have been successfully applied to enhance the sample quality of Generative Adversarial Networks (GANs). However, in practice, they typically have poor sample efficiency because of the independent proposal sampling…

Machine Learning · Statistics 2021-07-02 Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial…

Machine Learning · Computer Science 2019-04-17 Xuanqing Liu , Cho-Jui Hsieh

We investigate training Generative Adversarial Networks, GANs, with less data. Subsets of the training dataset can express empirical sample diversity while reducing training resource requirements, e.g. time and memory. We ask how much data…

Machine Learning · Computer Science 2020-04-10 Jamal Toutouh , Una-May O'Reilly , Erik Hemberg

Deep learning models have a propensity for fitting the entire training set even with random labels, which requires memorization of every training sample. In this paper, we explore the memorization effect in adversarial training (AT) for…

Machine Learning · Computer Science 2022-03-15 Yinpeng Dong , Ke Xu , Xiao Yang , Tianyu Pang , Zhijie Deng , Hang Su , Jun Zhu

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom