中文
相关论文

相关论文: Taming GANs with Lookahead-Minmax

200 篇论文

Generative Adversarial Networks (GANs) have become one of the dominant methods for deep generative modeling. Despite their demonstrated success on multiple vision tasks, GANs are difficult to train and much research has been dedicated…

神经与进化计算 · 计算机科学 2018-09-05 Abdullah Al-Dujaili , Tom Schmiedlechner , and Erik Hemberg , Una-May O'Reilly

One of the training strategies of generative models is to minimize the Jensen--Shannon divergence between the model distribution and the data distribution. Since data distribution is unknown, generative adversarial networks (GANs) formulate…

机器学习 · 计算机科学 2023-02-22 Hiroki Naganuma , Hideaki Iiduka

Minimax optimization plays a key role in adversarial training of machine learning algorithms, such as learning generative models, domain adaptation, privacy preservation, and robust learning. In this paper, we demonstrate the failure of…

机器学习 · 计算机科学 2018-06-08 Jihun Hamm , Yung-Kyun Noh

We are interested in the design of generative networks. The training of these mathematical structures is mostly performed with the help of adversarial (min-max) optimization problems. We propose a simple methodology for constructing such…

机器学习 · 计算机科学 2021-07-16 Kalliopi Basioti , George V. Moustakides

Despite success on a wide range of problems related to vision, generative adversarial networks (GANs) often suffer from inferior performance due to unstable training, especially for text generation. To solve this issue, we propose a new…

机器学习 · 计算机科学 2020-11-02 Yue Wu , Pan Zhou , Andrew Gordon Wilson , Eric P. Xing , Zhiting Hu

Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Sangeek Hyun , MinKyu Lee , Jae-Pil Heo

This paper considers minimax optimization $\min_x \max_y f(x, y)$ in the challenging setting where $f$ can be both nonconvex in $x$ and nonconcave in $y$. Though such optimization problems arise in many machine learning paradigms including…

机器学习 · 计算机科学 2021-06-04 Tanner Fiez , Chi Jin , Praneeth Netrapalli , Lillian J. Ratliff

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

机器学习 · 统计学 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

Adversarial training, a special case of multi-objective optimization, is an increasingly prevalent machine learning technique: some of its most notable applications include GAN-based generative modeling and self-play techniques in…

The wide applications of Generative adversarial networks benefit from the successful training methods, guaranteeing that an object function converges to the local minima. Nevertheless, designing an efficient and competitive training method…

机器学习 · 计算机科学 2021-11-11 Huiqing Qi , Fang Li , Shengli Tan , Xiangyun Zhang

Self-supervised (SS) learning is a powerful approach for representation learning using unlabeled data. Recently, it has been applied to Generative Adversarial Networks (GAN) training. Specifically, SS tasks were proposed to address the…

计算机视觉与模式识别 · 计算机科学 2020-01-09 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Linxiao Yang , Ngai-Man Cheung

Generative Adversarial Network(GAN) provides a good generative framework to produce realistic samples, but suffers from two recognized issues as mode collapse and unstable training. In this work, we propose to employ explicit manifold…

机器学习 · 计算机科学 2020-06-20 Guanhua Zheng , Jitao Sang , Changsheng Xu

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

We consider the problem of training generative models with a Generative Adversarial Network (GAN). Although GANs can accurately model complex distributions, they are known to be difficult to train due to instabilities caused by a difficult…

机器学习 · 计算机科学 2017-06-13 Paulina Grnarova , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann , Andreas Krause

We propose a novel training procedure for improving the performance of generative adversarial networks (GANs), especially to bidirectional GANs. First, we enforce that the empirical distribution of the inverse inference network matches the…

机器学习 · 统计学 2020-05-26 Pablo Sánchez-Martín , Pablo M. Olmos , Fernando Perez-Cruz

Recently, more and more works have proposed to drive evolutionary algorithms using machine learning models.Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

神经与进化计算 · 计算机科学 2020-04-08 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

机器学习 · 计算机科学 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

Generative Adversarial Networks (GANs) have demonstrated unprecedented success in various image generation tasks. The encouraging results, however, come at the price of a cumbersome training process, during which the generator and…

计算机视觉与模式识别 · 计算机科学 2021-06-17 Chengchao Shen , Youtan Yin , Xinchao Wang , Xubin Li , Jie Song , Mingli Song

Machine learning algorithms aim to find patterns from observations, which may include some noise, especially in robotics domain. To perform well even with such noise, we expect them to be able to detect outliers and discard them when…

机器学习 · 计算机科学 2020-03-04 Wendyam Eric Lionel Ilboudo , Taisuke Kobayashi , Kenji Sugimoto

Recently, increasing works have proposed to drive evolutionary algorithms using machine learning models. Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

神经与进化计算 · 计算机科学 2020-05-12 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin