中文
相关论文

相关论文: On the Existence of Optimal Transport Gradient for…

200 篇论文

Learning generative models is challenging for a network edge node with limited data and computing power. Since tasks in similar environments share model similarity, it is plausible to leverage pre-trained generative models from the cloud or…

机器学习 · 计算机科学 2021-01-25 Mehmet Dedeoglu , Sen Lin , Zhaofeng Zhang , Junshan Zhang

Optimal transport distances are powerful tools to compare probability distributions and have found many applications in machine learning. Yet their algorithmic complexity prevents their direct use on large scale datasets. To overcome this…

机器学习 · 统计学 2021-10-14 Kilian Fatras , Younes Zine , Rémi Flamary , Rémi Gribonval , Nicolas Courty

We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to…

机器学习 · 计算机科学 2020-12-11 Alexander Korotin , Vage Egiazarian , Arip Asadulaev , Alexander Safin , Evgeny Burnaev

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

This paper presents a novel method for accelerating path planning tasks in unknown scenes with obstacles by utilizing Wasserstein Generative Adversarial Networks (WGANs) with Gradient Penalty (GP) to approximate the distribution of the free…

机器人学 · 计算机科学 2023-06-19 Jorge Ocampo Jimenez , Wael Suleiman

Generative models based on latent variables, such as generative adversarial networks (GANs) and variational auto-encoders (VAEs), have gained lots of interests due to their impressive performance in many fields. However, many data such as…

机器学习 · 统计学 2024-09-30 Yixuan Qiu , Qingyi Gao , Xiao Wang

The Generative Adversarial Networks (GAN) framework is a well-established paradigm for probability matching and realistic sample generation. While recent attention has been devoted to studying the theoretical properties of such models, a…

机器学习 · 统计学 2020-07-30 Giulia Luise , Massimiliano Pontil , Carlo Ciliberto

We derive upper bounds on the generalization error of learning algorithms based on their \emph{algorithmic transport cost}: the expected Wasserstein distance between the output hypothesis and the output hypothesis conditioned on an input…

机器学习 · 统计学 2018-11-09 Jingwei Zhang , Tongliang Liu , Dacheng Tao

Despite the growing prominence of generative adversarial networks (GANs), optimization in GANs is still a poorly understood topic. In this paper, we analyze the "gradient descent" form of GAN optimization i.e., the natural setting where we…

机器学习 · 计算机科学 2018-01-16 Vaishnavh Nagarajan , J. Zico Kolter

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

机器学习 · 计算机科学 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

This paper proposes a new theoretical lens to view Wasserstein generative adversarial networks (WGANs). To minimize the Wasserstein-1 distance between the true data distribution and our estimate of it, we derive a distribution-dependent…

机器学习 · 统计学 2025-02-05 Zachariah Malik , Yu-Jui Huang

Many tasks in machine learning and signal processing can be solved by minimizing a convex function of a measure. This includes sparse spikes deconvolution or training a neural network with a single hidden layer. For these problems, we study…

最优化与控制 · 数学 2018-10-30 Lenaic Chizat , Francis Bach

While progress has been made in understanding the robustness of machine learning classifiers to test-time adversaries (evasion attacks), fundamental questions remain unresolved. In this paper, we use optimal transport to characterize the…

机器学习 · 计算机科学 2019-11-01 Arjun Nitin Bhagoji , Daniel Cullina , Prateek Mittal

Generative models with both discrete and continuous latent variables are highly motivated by the structure of many real-world data sets. They present, however, subtleties in training often manifesting in the discrete latent being under…

机器学习 · 统计学 2018-06-13 Benoit Gaujac , Ilya Feige , David Barber

The study of quantum generative models is well-motivated, not only because of its importance in quantum machine learning and quantum chemistry but also because of the perspective of its implementation on near-term quantum machines. Inspired…

量子物理 · 物理学 2019-11-04 Shouvanik Chakrabarti , Yiming Huang , Tongyang Li , Soheil Feizi , Xiaodi Wu

In this paper, we study the convergence of generative adversarial networks (GANs) from the perspective of the informativeness of the gradient of the optimal discriminative function. We show that GANs without restriction on the…

机器学习 · 计算机科学 2019-06-25 Zhiming Zhou , Jiadong Liang , Yuxuan Song , Lantao Yu , Hongwei Wang , Weinan Zhang , Yong Yu , Zhihua Zhang

The generation of synthetic data with distributions that faithfully emulate the underlying data-generating mechanism holds paramount significance. Wasserstein Generative Adversarial Networks (WGANs) have emerged as a prominent tool for this…

机器学习 · 统计学 2025-01-08 Wenhui Sophia Lu , Chenyang Zhong , Wing Hung Wong

Generative adversarial networks (GANs) are the state of the art in generative modeling. Unfortunately, most GAN methods are susceptible to mode collapse, meaning that they tend to capture only a subset of the modes of the true distribution.…

机器学习 · 统计学 2019-07-10 Luca Ambrogioni , Umut Güçlü , Marcel van Gerven

We provide a framework to approximate the 2-Wasserstein distance and the optimal transport map, amenable to efficient training as well as statistical and geometric analysis. With the quadratic cost and considering the Kantorovich dual form…

最优化与控制 · 数学 2019-02-20 Amirhossein Taghvaei , Amin Jalali

Probabilistic models with hierarchical-latent-variable structures provide state-of-the-art results amongst non-autoregressive, unsupervised density-based models. However, the most common approach to training such models based on Variational…

机器学习 · 统计学 2020-10-09 Benoit Gaujac , Ilya Feige , David Barber