中文
相关论文

相关论文: On the Existence of Optimal Transport Gradient for…

200 篇论文

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

机器学习 · 计算机科学 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

机器学习 · 统计学 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

We present Optimal Transport GAN (OT-GAN), a variant of generative adversarial nets minimizing a new metric measuring the distance between the generator distribution and the data distribution. This metric, which we call mini-batch energy…

机器学习 · 计算机科学 2018-03-16 Tim Salimans , Han Zhang , Alec Radford , Dimitris Metaxas

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkhorn approximation of the Wasserstein distance is replaced by…

机器学习 · 统计学 2019-06-04 Giulia Luise , Alessandro Rudi , Massimiliano Pontil , Carlo Ciliberto

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

机器学习 · 计算机科学 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

We introduce a new algorithm named WGAN, an alternative to traditional GAN training. In this new model, we show that we can improve the stability of learning, get rid of problems like mode collapse, and provide meaningful learning curves…

机器学习 · 统计学 2017-12-08 Martin Arjovsky , Soumith Chintala , Léon Bottou

The generative adversarial network (GAN) aims to approximate an unknown distribution via a parameterized neural network (NN). While GANs have been widely applied in reinforcement and semi-supervised learning as well as computer vision…

机器学习 · 计算机科学 2026-02-06 Yu-Jui Huang , Hsin-Hua Shen , Yu-Chih Huang , Wan-Yi Lin , Shih-Chun Lin

Generating samples given a specific label requires estimating conditional distributions. We derive a tractable upper bound of the Wasserstein distance between conditional distributions to lay the theoretical groundwork to learn conditional…

机器学习 · 统计学 2023-08-29 Young-geun Kim , Kyungbok Lee , Youngwon Choi , Joong-Ho Won , Myunghee Cho Paik

Generative Adversarial Networks (GANs) have been impactful on many problems and applications but suffer from unstable training. The Wasserstein GAN (WGAN) leverages the Wasserstein distance to avoid the caveats in the minmax two-player…

机器学习 · 统计学 2021-09-14 Yao Chen , Qingyi Gao , Xiao Wang

In many real-world applications of Machine Learning it is of paramount importance not only to provide accurate predictions, but also to ensure certain levels of robustness. Adversarial Training is a training procedure aiming at providing…

机器学习 · 计算机科学 2019-10-09 Matteo Terzi , Gian Antonio Susto , Pratik Chaudhari

We introduce COT-GAN, an adversarial algorithm to train implicit generative models optimized for producing sequential data. The loss function of this algorithm is formulated using ideas from Causal Optimal Transport (COT), which combines…

机器学习 · 统计学 2020-10-23 Tianlin Xu , Li K. Wenliang , Michael Munn , Beatrice Acciaio

Generative Adversarial Networks (GANs) have been successful in producing outstanding results in areas as diverse as image, video, and text generation. Building on these successes, a large number of empirical studies have validated the…

机器学习 · 计算机科学 2021-06-21 Gérard Biau , Maxime Sangnier , Ugo Tanielian

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

统计理论 · 数学 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

We study unsupervised generative modeling in terms of the optimal transport (OT) problem between true (but unknown) data distribution $P_X$ and the latent variable model distribution $P_G$. We show that the OT problem can be equivalently…

Generative Adversial Networks (GANs) have made a major impact in computer vision and machine learning as generative models. Wasserstein GANs (WGANs) brought Optimal Transport (OT) theory into GANs, by minimizing the $1$-Wasserstein distance…

机器学习 · 计算机科学 2019-02-12 Anton Mallasto , Jes Frellsen , Wouter Boomsma , Aasa Feragen

Local differential privacy is a powerful method for privacy-preserving data collection. In this paper, we develop a framework for training Generative Adversarial Networks (GANs) on differentially privatized data. We show that entropic…

机器学习 · 计算机科学 2024-03-04 Daria Reshetova , Wei-Ning Chen , Ayfer Özgür

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

机器学习 · 计算机科学 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

Within a broad class of generative adversarial networks, we show that discriminator optimization process increases a lower bound of the dual cost function for the Wasserstein distance between the target distribution $p$ and the generator…

机器学习 · 统计学 2023-08-09 Akinori Tanaka

A popular heuristic for improved performance in Generative adversarial networks (GANs) is to use some form of gradient penalty on the discriminator. This gradient penalty was originally motivated by a Wasserstein distance formulation.…

机器学习 · 计算机科学 2020-11-25 Alexia Jolicoeur-Martineau , Ioannis Mitliagkas