中文
相关论文

相关论文: On the Limitations of First-Order Approximation in…

200 篇论文

Generative Adversarial Networks (GANs) have achieved remarkable achievements in image synthesis. These successes of GANs rely on large scale datasets, requiring too much cost. With limited training data, how to stable the training process…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Ziqiang Li , Beihao Xia , Jing Zhang , Chaoyue Wang , Bin Li

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

计算机视觉与模式识别 · 计算机科学 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

Generative adversarial networks (GANs) are pairs of artificial neural networks that are trained one against each other. The outputs from a generator are mixed with the real-world inputs to the discriminator and both networks are trained…

神经与进化计算 · 计算机科学 2020-06-11 Andrei Kucharavy , El Mahdi El Mhamdi , Rachid Guerraoui

Generative Adversarial Networks (GANs) are popular and successful generative models. Despite their success, optimization is notoriously challenging. In this work, we explain the success and limitations of GANs by casting them as Bayesian…

机器学习 · 计算机科学 2026-02-03 Maurizio Filippone , Marius P. Linhard

Generative adversarial networks (GANs) are a framework for producing a generative model by way of a two-player minimax game. In this paper, we propose the \emph{Generative Multi-Adversarial Network} (GMAN), a framework that extends GANs to…

机器学习 · 计算机科学 2017-03-06 Ishan Durugkar , Ian Gemp , Sridhar Mahadevan

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

机器学习 · 计算机科学 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

机器学习 · 计算机科学 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

Generative Adversarial Networks are a new family of generative models, frequently used for generating photorealistic images. The theory promises for the GAN to eventually reach an equilibrium where generator produces pictures…

机器学习 · 计算机科学 2018-11-16 Ilya Kamenshchikov , Matthias Krauledat

Generative Adversarial Networks (GANs) can successfully approximate a probability distribution and produce realistic samples. However, open questions such as sufficient convergence conditions and mode collapse still persist. In this paper,…

We propose Unbalanced GANs, which pre-trains the generator of the generative adversarial network (GAN) using variational autoencoder (VAE). We guarantee the stable training of the generator by preventing the faster convergence of the…

机器学习 · 计算机科学 2020-02-07 Hyungrok Ham , Tae Joon Jun , Daeyoung Kim

Recently, increasing works have proposed to drive evolutionary algorithms using machine learning models. Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

神经与进化计算 · 计算机科学 2020-05-12 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

Gradient-based first-order adaptive optimization methods such as the Adam optimizer are prevalent in training artificial networks, achieving the state-of-the-art results. This work attempts to answer the question whether it is viable for…

神经与进化计算 · 计算机科学 2022-12-20 Yukun Yang , Peng Li

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

机器学习 · 计算机科学 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly…

最优化与控制 · 数学 2021-07-08 Mingrui Liu , Hassan Rafique , Qihang Lin , Tianbao Yang

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs' training scheme, are subject to ill-defined…

Adam-type methods, the extension of adaptive gradient methods, have shown great performance in the training of both supervised and unsupervised machine learning models. In particular, Adam-type optimizers have been widely used empirically…

机器学习 · 计算机科学 2021-09-30 Zehao Dou , Yuanzhi Li

Generative adversarial networks (GANs) are among the most successful models for learning high-complexity, real-world distributions. However, in theory, due to the highly non-convex, non-concave landscape of the minmax training objective,…

机器学习 · 计算机科学 2023-04-04 Zeyuan Allen-Zhu , Yuanzhi Li

Generative adversarial networks (GANs) are notoriously difficult to train and the reasons underlying their (non-)convergence behaviors are still not completely understood. By first considering a simple yet representative GAN example, we…

机器学习 · 统计学 2019-07-02 Weili Nie , Ankit Patel

Generative adversarial network (GAN) is among the most popular deep learning models for learning complex data distributions. However, training a GAN is known to be a challenging task. This is often attributed to the lack of correlation…

机器学习 · 计算机科学 2020-12-15 Sahil Sidheekh , Aroof Aimen , Vineet Madan , Narayanan C. Krishnan

As the application of generative adversarial networks (GANs) expands, it becomes increasingly critical to develop a unified approach that improves performance across various generative tasks. One effective strategy that applies to any…

机器学习 · 计算机科学 2025-04-02 Naoyuki Terashita , Hiroki Ohashi , Satoshi Hara