English
Related papers

Related papers: A method for escaping limit cycles in training GAN…

200 papers

In this paper, we focus on analyzing the excess risk of the unpaired data generation model, called CycleGAN. Unlike classical GANs, CycleGAN not only transforms data between two unpaired distributions but also ensures the mappings are…

Machine Learning · Computer Science 2025-09-23 Luwei Sun , Dongrui Shen , Han Feng

Generative adversarial nets (GANs) are a promising technique for modeling a distribution from samples. It is however well known that GAN training suffers from instability due to the nature of its maximin formulation. In this paper, we…

Machine Learning · Computer Science 2017-06-21 Yujia Li , Alexander Schwing , Kuan-Chieh Wang , Richard Zemel

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

In recent years, multi-scale generative adversarial networks (GANs) have been proposed to build generalized image processing models based on single sample. Constraining on the sample size, multi-scale GANs have much difficulty converging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jing Tang , Bo Tao , Zeyu Gong , Zhouping Yin

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details…

Neural and Evolutionary Computing · Computer Science 2018-02-28 Tero Karras , Timo Aila , Samuli Laine , Jaakko Lehtinen

The impressive success of Generative Adversarial Networks (GANs) is often overshadowed by the difficulties in their training. Despite the continuous efforts and improvements, there are still open issues regarding their convergence…

Machine Learning · Computer Science 2018-11-08 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou

Generative Adversarial Networks (GANs) are a popular formulation to train generative models for complex high dimensional data. The standard method for training GANs involves a gradient descent-ascent (GDA) procedure on a minimax…

Machine Learning · Computer Science 2023-05-30 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das

Stochastic gradient descent is the most prevalent algorithm to train neural networks. However, other approaches such as evolutionary algorithms are also applicable to this task. Evolutionary algorithms bring unique trade-offs that are worth…

Neural and Evolutionary Computing · Computer Science 2018-06-27 Jonas Prellberg , Oliver Kramer

One of the training strategies of generative models is to minimize the Jensen--Shannon divergence between the model distribution and the data distribution. Since data distribution is unknown, generative adversarial networks (GANs) formulate…

Machine Learning · Computer Science 2023-02-22 Hiroki Naganuma , Hideaki Iiduka

Min-max saddle point games have recently been intensely studied, due to their wide range of applications, including training Generative Adversarial Networks (GANs). However, most of the recent efforts for solving them are limited to special…

Optimization and Control · Mathematics 2021-08-10 Babak Barazandeh , Tianjian Huang , George Michailidis

Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class-wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem…

Machine Learning · Computer Science 2024-09-20 Kyeongbo Kong , Kyunghun Kim , Suk-Ju Kang

Generative adversarial networks (GANs) can implicitly learn rich distributions over images, audio, and data which are hard to model with an explicit likelihood. We present a practical Bayesian formulation for unsupervised and…

Machine Learning · Statistics 2017-11-09 Yunus Saatchi , Andrew Gordon Wilson

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

Generative adversarial networks (GANs) typically require ample data for training in order to synthesize high-fidelity images. Recent studies have shown that training GANs with limited data remains formidable due to discriminator…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Liming Jiang , Bo Dai , Wayne Wu , Chen Change Loy

Generative Adversarial Networks (GANs) is a powerful family of models that learn an underlying distribution to generate synthetic data. Many existing studies of GANs focus on improving the realness of the generated image data for visual…

Machine Learning · Computer Science 2021-11-04 Si-An Chen , Chun-Liang Li , Hsuan-Tien Lin

Systematic trading strategies are algorithmic procedures that allocate assets aiming to optimize a certain performance criterion. To obtain an edge in a highly competitive environment, the analyst needs to proper fine-tune its strategy, or…

Machine Learning · Computer Science 2019-04-02 Adriano Koshiyama , Nick Firoozye , Philip Treleaven

When robots work in a cluttered environment, the constraints for motions change frequently and the required action can change even for the same task. However, planning complex motions from direct calculation has the risk of resulting in…

Robotics · Computer Science 2019-10-09 Kyo Kutsuzawa , Hitoshi Kusano , Ayaka Kume , Shoichiro Yamaguchi

In this article a tool for the analysis of population-based EAs is used to derive asymptotic upper bounds on the optimization time of the algorithm solving Royal Roads problem, a test function with plateaus of fitness. In addition to this,…

Neural and Evolutionary Computing · Computer Science 2013-09-03 Aram Ter-Sarkisov , Stephen Marsland