English
Related papers

Related papers: Generative Minimization Networks: Training GANs Wi…

200 papers

In this study, we rediscovered the framework of generative adversarial networks (GANs) as a solver for calibration problems without data correspondence. When data correspondence is not present or loosely established, the calibration problem…

Robotics · Computer Science 2024-08-13 Ilkwon Hong , Junhyoung Ha

In this paper, we propose a new framework for mitigating biases in machine learning systems. The problem of the existing mitigation approaches is that they are model-oriented in the sense that they focus on tuning the training algorithms to…

Machine Learning · Computer Science 2019-05-27 Adel Abusitta , Esma Aïmeur , Omar Abdel Wahab

Adversarial formulations such as generative adversarial networks (GANs) have rekindled interest in two-player min-max games. A central obstacle in the optimization of such games is the rotational dynamics that hinder their convergence. In…

Machine Learning · Computer Science 2023-06-22 Reyhane Askari Hemmat , Amartya Mitra , Guillaume Lajoie , Ioannis Mitliagkas

Generative adversarial networks (GANs) can be interpreted as an adversarial game between two players, a discriminator D and a generator G, in which D learns to classify real from fake data and G learns to generate realistic data by…

Machine Learning · Computer Science 2018-09-10 Alexia Jolicoeur-Martineau

We present an alternative perspective on the training of generative adversarial networks (GANs), showing that the training step for a GAN generator decomposes into two implicit subproblems. In the first, the discriminator provides new…

Machine Learning · Computer Science 2021-05-13 Romann M. Weber

The worst-case training principle that minimizes the maximal adversarial loss, also known as adversarial training (AT), has shown to be a state-of-the-art approach for enhancing adversarial robustness. Nevertheless, min-max optimization…

Machine Learning · Computer Science 2021-11-02 Jingkang Wang , Tianyun Zhang , Sijia Liu , Pin-Yu Chen , Jiacen Xu , Makan Fardad , Bo Li

Generative adversarial networks are generative models that are capable of replicating the implicit probability distribution of the input data with high accuracy. Traditionally, GANs consist of a Generator and a Discriminator which interact…

Machine Learning · Computer Science 2022-11-15 Xin Wang

Min-max optimization problems involving nonconvex-nonconcave objectives have found important applications in adversarial training and other multi-agent learning settings. Yet, no known gradient descent-based method is guaranteed to converge…

Machine Learning · Computer Science 2022-10-19 Constantinos Daskalakis , Noah Golowich , Stratis Skoulakis , Manolis Zampetakis

Generative adversarial networks have been very successful in generative modeling, however they remain relatively challenging to train compared to standard deep neural networks. In this paper, we propose new visualization techniques for the…

Machine Learning · Computer Science 2020-04-28 Hugo Berard , Gauthier Gidel , Amjad Almahairi , Pascal Vincent , Simon Lacoste-Julien

Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of…

Machine Learning · Computer Science 2025-02-18 Tanujit Chakraborty , Ujjwal Reddy K S , Shraddha M. Naik , Madhurima Panja , Bayapureddy Manvitha

Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous…

Machine Learning · Statistics 2019-06-11 Kiran Koshy Thekumparampil , Sewoong Oh , Ashish Khetan

Recently, more and more works have proposed to drive evolutionary algorithms using machine learning models.Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

Neural and Evolutionary Computing · Computer Science 2020-04-08 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

Many emerging applications - such as adversarial training, AI alignment, and robust optimization - can be framed as zero-sum games between neural nets, with von Neumann-Nash equilibria (NE) capturing the desirable system behavior. While…

Machine Learning · Computer Science 2025-12-02 Deep Patel , Emmanouil-Vasileios Vlatakis-Gkaragkounis

We introduce a method to stabilize Generative Adversarial Networks (GANs) by defining the generator objective with respect to an unrolled optimization of the discriminator. This allows training to be adjusted between using the optimal…

Machine Learning · Computer Science 2017-05-16 Luke Metz , Ben Poole , David Pfau , Jascha Sohl-Dickstein

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

Generative adversarial networks (GAN) are a powerful subclass of generative models. Despite a very rich research activity leading to numerous interesting GAN algorithms, it is still very hard to assess which algorithm(s) perform better than…

Machine Learning · Statistics 2018-10-30 Mario Lucic , Karol Kurach , Marcin Michalski , Sylvain Gelly , Olivier Bousquet

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theoretical justification, in contrast to alternatives such as…

Machine Learning · Computer Science 2020-10-19 Matt Shannon , Ben Poole , Soroosh Mariooryad , Tom Bagby , Eric Battenberg , David Kao , Daisy Stanton , RJ Skerry-Ryan