中文
相关论文

相关论文: Sample weighting as an explanation for mode collap…

200 篇论文

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

机器学习 · 统计学 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Generative Adversarial Networks (GANs) have become a powerful approach for generative image modeling. However, GANs are notorious for their training instability, especially on large-scale, complex datasets. While the recent work of BigGAN…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Ting-Yun Chang , Chi-Jen Lu

Standard formulations of GANs, where a continuous function deforms a connected latent space, have been shown to be misspecified when fitting different classes of images. In particular, the generator will necessarily sample some low-quality…

机器学习 · 计算机科学 2021-10-20 Thibaut Issenhuth , Ugo Tanielian , David Picard , Jeremie Mary

Generative adversarial networks (GANs) nowadays are capable of producing images of incredible realism. One concern raised is whether the state-of-the-art GAN's learned distribution still suffers from mode collapse, and what to do if so.…

机器学习 · 计算机科学 2021-07-27 Zhenyu Wu , Zhaowen Wang , Ye Yuan , Jianming Zhang , Zhangyang Wang , Hailin Jin

Generative adversarial networks (GANs) learn the distribution of observed samples through a zero-sum game between two machine players, a generator and a discriminator. While GANs achieve great success in learning the complex distribution of…

机器学习 · 计算机科学 2020-06-19 Farzan Farnia , William Wang , Subhro Das , Ali Jadbabaie

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

机器学习 · 统计学 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

One of the issues faced in training Generative Adversarial Nets (GANs) and their variants is the problem of mode collapse, wherein the training stability in terms of the generative loss increases as more training data is used. In this…

机器学习 · 计算机科学 2020-11-23 Himanshu Pant , Jayadeva , Sumit Soman

Generative adversarial nets (GANs) are a promising technique for modeling a distribution from samples. It is however well known that GAN training suffers from instability due to the nature of its maximin formulation. In this paper, we…

机器学习 · 计算机科学 2017-06-21 Yujia Li , Alexander Schwing , Kuan-Chieh Wang , Richard Zemel

We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a…

计算机视觉与模式识别 · 计算机科学 2019-08-26 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim

Domain adaptation tackles the problem of transferring knowledge from a label-rich source domain to a label-scarce or even unlabeled target domain. Recently domain-adversarial training (DAT) has shown promising capacity to learn a…

机器学习 · 计算机科学 2020-03-31 Jianfei Yang , Han Zou , Yuxun Zhou , Lihua Xie

Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Sangeek Hyun , MinKyu Lee , Jae-Pil Heo

Generative adversarial nets (GANs) are widely used to learn the data sampling process and their performance may heavily depend on the loss functions, given a limited computational budget. This study revisits MMD-GAN that uses the maximum…

机器学习 · 计算机科学 2019-02-11 Wei Wang , Yuan Sun , Saman Halgamuge

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

机器学习 · 计算机科学 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

Sampling the phase space of molecular systems -- and, more generally, of complex systems effectively modeled by stochastic differential equations -- is a crucial modeling step in many fields, from protein folding to materials discovery.…

机器学习 · 计算机科学 2023-12-12 Ellis R. Crabtree , Juan M. Bello-Rivas , Andrew L. Ferguson , Ioannis G. Kevrekidis

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

机器学习 · 计算机科学 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

A generative adversarial network (GAN) has been a representative backbone model in generative artificial intelligence (AI) because of its powerful performance in capturing intricate data-generating processes. However, the GAN training is…

机器学习 · 统计学 2025-08-21 Jinwon Sohn , Qifan Song

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Few-shot and continual learning face two well-known challenges in GANs: overfitting and catastrophic forgetting. Learning new tasks results in catastrophic forgetting in deep learning models. In the case of a few-shot setting, the model…

机器学习 · 计算机科学 2024-10-22 Munsif Ali , Leonardo Rossi , Massimo Bertozzi

Generating high-quality text with sufficient diversity is essential for a wide range of Natural Language Generation (NLG) tasks. Maximum-Likelihood (MLE) models trained with teacher forcing have consistently been reported as weak baselines,…

计算与语言 · 计算机科学 2020-02-21 Massimo Caccia , Lucas Caccia , William Fedus , Hugo Larochelle , Joelle Pineau , Laurent Charlin

The training of Generative Adversarial Networks is a difficult task mainly due to the nature of the networks. One such issue is when the generator and discriminator start oscillating, rather than converging to a fixed point. Another case…

机器学习 · 统计学 2018-02-08 Alexey Chaplygin , Joshua Chacksfield