English
Related papers

Related papers: Realizing GANs via a Tunable Loss Function

200 papers

We propose an approach to address two issues that commonly occur during training of unsupervised GANs. First, since GANs use only a continuous latent distribution to embed multiple classes or clusters of data, they often do not correctly…

Machine Learning · Computer Science 2018-03-13 Youngjin Kim , Minjung Kim , Gunhee Kim

We investigate the use of parametrized families of information-theoretic measures to generalize the loss functions of generative adversarial networks (GANs) with the objective of improving performance. A new generator loss function, called…

Machine Learning · Computer Science 2021-08-12 Himesh Bhatia , William Paul , Fady Alajaji , Bahman Gharesifard , Philippe Burlina

Reversibility in artificial neural networks allows us to retrieve the input given an output. We present feature alignment, a method for approximating reversibility in arbitrary neural networks. We train a network by minimizing the distance…

Machine Learning · Computer Science 2023-01-31 Tiago de Souza Farias , Jonas Maziero

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen

We introduce effective training algorithms for Generative Adversarial Networks (GAN) to alleviate mode collapse and gradient vanishing. In our system, we constrain the generator by an Autoencoder (AE). We propose a formulation to consider…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

Machine Learning · Computer Science 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Allowing effective inference of latent vectors while training GANs can greatly increase their applicability in various downstream tasks. Recent approaches, such as ALI and BiGAN frameworks, develop methods of inference of latent variables…

Machine Learning · Computer Science 2020-12-22 Yatin Dandi , Homanga Bharadhwaj , Abhishek Kumar , Piyush Rai

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

Machine Learning · Computer Science 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

In this paper, we present the Lipschitz regularization theory and algorithms for a novel Loss-Sensitive Generative Adversarial Network (LS-GAN). Specifically, it trains a loss function to distinguish between real and fake samples by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Guo-Jun Qi

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Antonia Creswell , Anil A Bharath

In this paper, we propose Orthogonal Generative Adversarial Networks (O-GANs). We decompose the network of discriminator orthogonally and add an extra loss into the objective of common GANs, which can enforce discriminator become an…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Jianlin Su

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

Unsupervised domain mapping has attracted substantial attention in recent years due to the success of models based on the cycle-consistency assumption. These models map between two domains by fooling a probabilistic discriminator, thereby…

Machine Learning · Computer Science 2019-01-25 Matthew Amodio , Smita Krishnaswamy

Generative adversarial network (GAN) is among the most popular deep learning models for learning complex data distributions. However, training a GAN is known to be a challenging task. This is often attributed to the lack of correlation…

Machine Learning · Computer Science 2020-12-15 Sahil Sidheekh , Aroof Aimen , Vineet Madan , Narayanan C. Krishnan

Generative Adversarial Networks (GANs) have brought about rapid progress towards generating photorealistic images. Yet the equitable allocation of their modeling capacity among subgroups has received less attention, which could lead to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ning Yu , Ke Li , Peng Zhou , Jitendra Malik , Larry Davis , Mario Fritz

Generative Adversarial Networks (GANs) are a class of generative models used for various applications, but they have been known to suffer from the mode collapse problem, in which some modes of the target distribution are ignored by the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Karttikeya Mangalam , Rohin Garg

Solving the convergence issues of Generative Adversarial Networks (GANs) is one of the most outstanding problems in generative models. In this work, we propose a novel activation function to be used as output of the generator agent. This…

Machine Learning · Computer Science 2023-03-01 Ángel González-Prieto , Alberto Mozo , Sandra Gómez-Canaval , Edgar Talavera

We develop a novel method for training of GANs for unsupervised and class conditional generation of images, called Linear Discriminant GAN (LD-GAN). The discriminator of an LD-GAN is trained to maximize the linear separability between…

Machine Learning · Statistics 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou