English
Related papers

Related papers: GraN-GAN: Piecewise Gradient Normalization for Gen…

200 papers

This paper studies the rates of convergence for learning distributions implicitly with the adversarial framework and Generative Adversarial Networks (GANs), which subsume Wasserstein, Sobolev, MMD GAN, and Generalized/Simulated Method of…

Statistics Theory · Mathematics 2021-10-12 Tengyuan Liang

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

Machine Learning · Computer Science 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Generative Adversarial Networks (GAN) is currently widely used as an unsupervised image generation method. Current state-of-the-art GANs can generate photorealistic images with high resolution. However, a large amount of data is required,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Pengwei Wang

Unsupervised learning with generative adversarial networks (GANs) has proven hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Xudong Mao , Qing Li , Haoran Xie , Raymond Y. K. Lau , Zhen Wang , Stephen Paul Smolley

While Generative Adversarial Networks (GANs) have seen huge successes in image synthesis tasks, they are notoriously difficult to adapt to different datasets, in part due to instability during training and sensitivity to hyperparameters.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Animesh Karnewar , Oliver Wang

Conditional Generative Adversarial Networks are known to be difficult to train, especially when the conditions are continuous and high-dimensional. To partially alleviate this difficulty, we propose a simple generator regularization term on…

Machine Learning · Computer Science 2021-03-30 Yufeng Zheng , Yunkai Zhang , Zeyu Zheng

Point clouds acquired from range scans are often sparse, noisy, and non-uniform. This paper presents a new point cloud upsampling network called PU-GAN, which is formulated based on a generative adversarial network (GAN), to learn a rich…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Ruihui Li , Xianzhi Li , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng

Despite the growing interest in generative adversarial networks (GANs), training GANs remains a challenging problem, both from a theoretical and a practical standpoint. To address this challenge, in this paper, we propose a novel way to…

Machine Learning · Computer Science 2018-11-27 Qunwei Li , Bhavya Kailkhura , Rushil Anirudh , Yi Zhou , Yingbin Liang , Pramod Varshney

In this paper, we propose a novel loss function for training Generative Adversarial Networks (GANs) aiming towards deeper theoretical understanding as well as improved stability and performance for the underlying optimization problem. The…

Machine Learning · Computer Science 2021-08-25 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou , Markos Katsoulakis

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

Generative adversarial networks (GANs) transform latent vectors into visually plausible images. It is generally thought that the original GAN formulation gives no out-of-the-box method to reverse the mapping, projecting images back into…

Machine Learning · Computer Science 2017-02-20 Zachary C. Lipton , Subarna Tripathi

One of the major breakthroughs in deep learning over the past five years has been the Generative Adversarial Network (GAN), a neural network-based generative model which aims to mimic some underlying distribution given a dataset of samples.…

Machine Learning · Computer Science 2020-06-23 Yeojoon Youn , Neil Thistlethwaite , Sang Keun Choe , Jacob Abernethy

We investigate the use of parametrized families of information-theoretic measures to generalize the loss functions of generative adversarial networks (GANs) with the objective of improving performance. A new generator loss function, called…

Machine Learning · Computer Science 2021-08-12 Himesh Bhatia , William Paul , Fady Alajaji , Bahman Gharesifard , Philippe Burlina

We relate the minimax game of generative adversarial networks (GANs) to finding the saddle points of the Lagrangian function for a convex optimization problem, where the discriminator outputs and the distribution of generator outputs play…

Machine Learning · Computer Science 2018-02-07 Xu Chen , Jiang Wang , Hao Ge

Spectral Normalization is one of the best methods for stabilizing the training of Generative Adversarial Network. Spectral Normalization limits the gradient of discriminator between the distribution between real data and fake data. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Shota Hirose , Shiori Maki , Naoki Wada , Heming Sun , Jiro Katto

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

Generative adversarial nets (GANs) have been remarkably successful at learning to sample from distributions specified by a given dataset, particularly if the given dataset is reasonably large compared to its dimensionality. However, given…

Machine Learning · Computer Science 2022-11-29 Tiantian Fang , Ruoyu Sun , Alex Schwing

Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of…

Machine Learning · Computer Science 2022-03-16 Uiwon Hwang , Heeseung Kim , Dahuin Jung , Hyemi Jang , Hyungyu Lee , Sungroh Yoon

In recent years, neural network approaches have been widely adopted for machine learning tasks, with applications in computer vision. More recently, unsupervised generative models based on neural networks have been successfully applied to…

Machine Learning · Computer Science 2018-02-06 Maya Kabkab , Pouya Samangouei , Rama Chellappa

Stochastic optimization plays a crucial role in the advancement of deep learning technologies. Over the decades, significant effort has been dedicated to improving the training efficiency and robustness of deep neural networks, via various…

Machine Learning · Computer Science 2024-08-21 Huixiu Jiang , Ling Yang , Yu Bao , Rutong Si , Sikun Yang