English
Related papers

Related papers: Which Training Methods for GANs do actually Conver…

200 papers

Generative Adversarial Networks (GANs) is a powerful family of models that learn an underlying distribution to generate synthetic data. Many existing studies of GANs focus on improving the realness of the generated image data for visual…

Machine Learning · Computer Science 2021-11-04 Si-An Chen , Chun-Liang Li , Hsuan-Tien Lin

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

Generative Adversarial Networks (GANs) enjoy great success at image generation, but have proven difficult to train in the domain of natural language. Challenges with gradient estimation, optimization instability, and mode collapse have lead…

Computation and Language · Computer Science 2020-02-28 Cyprien de Masson d'Autume , Mihaela Rosca , Jack Rae , Shakir Mohamed

The training of Generative Adversarial Networks is a difficult task mainly due to the nature of the networks. One such issue is when the generator and discriminator start oscillating, rather than converging to a fixed point. Another case…

Machine Learning · Statistics 2018-02-08 Alexey Chaplygin , Joshua Chacksfield

The mathematical forces at work behind Generative Adversarial Networks raise challenging theoretical issues. Motivated by the important question of characterizing the geometrical properties of the generated distributions, we provide a…

Machine Learning · Statistics 2023-10-06 Arthur Stéphanovitch , Ugo Tanielian , Benoît Cadre , Nicolas Klutchnikoff , Gérard Biau

Generative adversarial networks (GANs) are a machine learning framework comprising a generative model for sampling from a target distribution and a discriminative model for evaluating the proximity of a sample to the target distribution.…

Quantum Physics · Physics 2021-07-22 Daniel Herr , Benjamin Obert , Matthias Rosenkranz

Suffering from the extreme training data imbalance between seen and unseen classes, most of existing state-of-the-art approaches fail to achieve satisfactory results for the challenging generalized zero-shot learning task. To circumvent the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yongqin Xian , Tobias Lorenz , Bernt Schiele , Zeynep Akata

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

Machine Learning · Computer Science 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

Although Generative Adversarial Networks achieve state-of-the-art results on a variety of generative tasks, they are regarded as highly unstable and prone to miss modes. We argue that these bad behaviors of GANs are due to the very…

Machine Learning · Computer Science 2017-03-03 Tong Che , Yanran Li , Athul Paul Jacob , Yoshua Bengio , Wenjie Li

Generative adversarial nets (GANs) are a promising technique for modeling a distribution from samples. It is however well known that GAN training suffers from instability due to the nature of its maximin formulation. In this paper, we…

Machine Learning · Computer Science 2017-06-21 Yujia Li , Alexander Schwing , Kuan-Chieh Wang , Richard Zemel

Generative adversarial networks (GANs) are unsupervised learning methods for training a generator distribution to produce samples that approximate those drawn from a target distribution. Many such methods can be formulated as minimization…

Machine Learning · Statistics 2025-05-13 Jeremiah Birrell

This paper introduces a promising alternative method for training Generative Adversarial Networks (GANs) on large-scale datasets with clear theoretical guarantees. GANs are typically learned through a minimax game between a generator and a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Chang Wan , Ke Fan , Xinwei Sun , Yanwei Fu , Minglu Li , Yunliang Jiang , Zhonglong Zheng

We show that the canonical approach for training differentially private GANs -- updating the discriminator with differentially private stochastic gradient descent (DPSGD) -- can yield significantly improved results after modifications to…

Machine Learning · Computer Science 2023-10-06 Alex Bie , Gautam Kamath , Guojun Zhang

Training generative adversarial networks (GANs) on high quality (HQ) images involves important computing resources. This requirement represents a bottleneck for the development of applications of GANs. We propose a transfer learning…

Machine Learning · Computer Science 2021-08-17 Yaël Frégier , Jean-Baptiste Gouray

With the rapidly growing model complexity and data volume, training deep generative models (DGMs) for better performance has becoming an increasingly more important challenge. Previous research on this problem has mainly focused on…

Machine Learning · Computer Science 2021-12-08 Yufan Zhou , Chunyuan Li , Changyou Chen , Jinhui Xu

Training of Generative Adversarial Network (GAN) on a video dataset is a challenge because of the sheer size of the dataset and the complexity of each observation. In general, the computational cost of training GAN scales exponentially with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Masaki Saito , Shunta Saito , Masanori Koyama , Sosuke Kobayashi

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Statistics 2019-11-05 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf

Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit…

Machine Learning · Computer Science 2019-11-07 Arash Mehrjou , Wittawat Jitkrittum , Krikamol Muandet , Bernhard Schölkopf