English
Related papers

Related papers: Improving GANs Using Optimal Transport

200 papers

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a…

Machine Learning · Computer Science 2024-03-08 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Generative adversarial networks (GANs) are an expressive class of neural generative models with tremendous success in modeling high-dimensional continuous measures. In this paper, we present a scalable method for unbalanced optimal…

Machine Learning · Computer Science 2019-08-06 Karren D. Yang , Caroline Uhler

Optimal transport distances have become a classic tool to compare probability distributions and have found many applications in machine learning. Yet, despite recent algorithmic developments, their complexity prevents their direct use on…

Machine Learning · Statistics 2021-01-07 Kilian Fatras , Younes Zine , Szymon Majewski , Rémi Flamary , Rémi Gribonval , Nicolas Courty

Computing optimal transport maps between high-dimensional and continuous distributions is a challenging problem in optimal transport (OT). Generative adversarial networks (GANs) are powerful generative models which have been successfully…

Machine Learning · Computer Science 2019-06-25 Jacob Leygonie , Jennifer She , Amjad Almahairi , Sai Rajeswar , Aaron Courville

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

Though generative adversarial networks (GANs) areprominent models to generate realistic and crisp images,they often encounter the mode collapse problems and arehard to train, which comes from approximating the intrinsicdiscontinuous…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Dongsheng An , Yang Guo , Min Zhang , Xin Qi , Na Lei , Shing-Tung Yau , Xianfeng Gu

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

Machine Learning · Computer Science 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

The field of deep generative modeling is dominated by generative adversarial networks (GANs). However, the training of GANs often lacks stability, fails to converge, and suffers from model collapse. It takes an assortment of tricks to solve…

Machine Learning · Computer Science 2019-10-18 Oliver Zhang , Ruei-Sung Lin , Yuchuan Gou

The Generative Adversarial Networks (GAN) framework is a well-established paradigm for probability matching and realistic sample generation. While recent attention has been devoted to studying the theoretical properties of such models, a…

Machine Learning · Statistics 2020-07-30 Giulia Luise , Massimiliano Pontil , Carlo Ciliberto

With the discovery of Wasserstein GANs, Optimal Transport (OT) has become a powerful tool for large-scale generative modeling tasks. In these tasks, OT cost is typically used as the loss for training GANs. In contrast to this approach, we…

Machine Learning · Computer Science 2022-03-08 Litu Rout , Alexander Korotin , Evgeny Burnaev

For a given image generation problem, the intrinsic image manifold is often low dimensional. We use the intuition that it is much better to train the GAN generator by minimizing the distributional distance between real and generated images…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Khoa D. Doan , Saurav Manchanda , Fengjiao Wang , Sathiya Keerthi , Avradeep Bhowmik , Chandan K. Reddy

Generative adversarial networks (GANs) have enjoyed tremendous success in image generation and processing, and have recently attracted growing interests in financial modelings. This paper analyzes GANs from the perspectives of mean-field…

Computer Science and Game Theory · Computer Science 2025-09-23 Haoyang Cao , Xin Guo , Mathieu Laurière

Variational Auto-Encoders enforce their learned intermediate latent-space data distribution to be a simple distribution, such as an isotropic Gaussian. However, this causes the posterior collapse problem and loses manifold structure which…

Machine Learning · Computer Science 2018-09-18 Huidong Liu , Yang Guo , Na Lei , Zhixin Shu , Shing-Tung Yau , Dimitris Samaras , Xianfeng Gu

To improve the performance of classical generative adversarial network (GAN), Wasserstein generative adversarial networks (W-GAN) was developed as a Kantorovich dual formulation of the optimal transport (OT) problem using Wasserstein-1…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Byeongsu Sim , Gyutaek Oh , Jeongsol Kim , Chanyong Jung , Jong Chul Ye

Generative adversarial networks (GANs) are the state of the art in generative modeling. Unfortunately, most GAN methods are susceptible to mode collapse, meaning that they tend to capture only a subset of the modes of the true distribution.…

Machine Learning · Statistics 2019-07-10 Luca Ambrogioni , Umut Güçlü , Marcel van Gerven

Traditional generative adversarial networks (GAN) and many of its variants are trained by minimizing the KL or JS-divergence loss that measures how close the generated data distribution is from the true data distribution. A recent advance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

In this paper, we present Super-OT, a novel approach to computational lineage tracing that combines a supervised learning framework with optimal transport based on Generative Adversarial Networks (GANs). Unlike previous approaches to…

Machine Learning · Computer Science 2022-01-06 Neha Prasad , Karren Yang , Caroline Uhler

Within a broad class of generative adversarial networks, we show that discriminator optimization process increases a lower bound of the dual cost function for the Wasserstein distance between the target distribution $p$ and the generator…

Machine Learning · Statistics 2023-08-09 Akinori Tanaka

We study unsupervised generative modeling in terms of the optimal transport (OT) problem between true (but unknown) data distribution $P_X$ and the latent variable model distribution $P_G$. We show that the OT problem can be equivalently…

‹ Prev 1 2 3 10 Next ›