中文
相关论文

相关论文: Generative Modeling with Optimal Transport Maps

200 篇论文

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

机器学习 · 计算机科学 2023-11-27 Clément Bonet

Optimal Transport (OT) is a resource allocation problem with applications in biology, data science, economics and statistics, among others. In some of the applications, practitioners have access to samples which approximate the continuous…

Optimal transport (OT) theory focuses, among all maps $T:\mathbb{R}^d\rightarrow \mathbb{R}^d$ that can morph a probability measure onto another, on those that are the ``thriftiest'', i.e. such that the averaged cost $c(x, T(x))$ between…

机器学习 · 统计学 2023-02-09 Marco Cuturi , Michal Klein , Pierre Ablin

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

机器学习 · 统计学 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

The Wasserstein distance from optimal mass transport (OMT) is a powerful mathematical tool with numerous applications that provides a natural measure of the distance between two probability distributions. Several methods to incorporate OMT…

机器学习 · 计算机科学 2023-10-31 Jung Hun Oh , Rena Elkin , Anish Kumar Simhal , Jiening Zhu , Joseph O Deasy , Allen Tannenbaum

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

机器学习 · 计算机科学 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang

Optimal transport (OT) has recently been shown as a promising criterion for unsupervised restoration when no explicit prior model is available. Despite its theoretical appeal, OT still significantly falls short of supervised methods on…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Fei Wen , Wei Wang , Zeyu Yan , Wenbin Jiang

Solving large scale Optimal Transport (OT) in machine learning typically relies on sampling measures to obtain a tractable discrete problem. While the discrete solver's accuracy is controllable, the rate of convergence of the discretization…

机器学习 · 统计学 2026-02-05 Ferdinand Genans , Olivier Wintenberger

Optimal transport (OT) distances are increasingly used as loss functions for statistical inference, notably in the learning of generative models or supervised learning. Yet, the behavior of minimum Wasserstein estimators is poorly…

统计理论 · 数学 2021-07-20 Tianyi Lin , Zeyu Zheng , Elynn Y. Chen , Marco Cuturi , Michael I. Jordan

Diffusion Models (DMs) have achieved remarkable progress in generative modeling. However, the mismatch between the forward terminal distribution and reverse initial distribution introduces prior error, leading to deviations of sampling…

机器学习 · 计算机科学 2026-02-06 Zhanpeng Wang , Shenghao Li , Jiameng Che , Chen Wang , Shangling Jui , Na Lei , Zhongxuan Luo

The field of deep generative modeling is dominated by generative adversarial networks (GANs). However, the training of GANs often lacks stability, fails to converge, and suffers from model collapse. It takes an assortment of tricks to solve…

机器学习 · 计算机科学 2019-10-18 Oliver Zhang , Ruei-Sung Lin , Yuchuan Gou

Optimal Transport (OT) theory investigates the cost-minimizing transport map that moves a source distribution to a target distribution. Recently, several approaches have emerged for learning the optimal transport map for a given cost…

机器学习 · 计算机科学 2025-04-01 Jaemoo Choi , Yongxin Chen , Jaewoong Choi

Optimal transport (OT) is a powerful tool for measuring the distance between two defined probability distributions. In this paper, we develop a new manifold named the coupling matrix manifold (CMM), where each point on CMM can be regarded…

机器学习 · 计算机科学 2019-11-26 Dai Shi , Junbin Gao , Xia Hong , S. T. Boris Choy , Zhiyong Wang

Wasserstein GANs with Gradient Penalty (WGAN-GP) are a very popular method for training generative models to produce high quality synthetic data. While WGAN-GP were initially developed to calculate the Wasserstein 1 distance between…

机器学习 · 计算机科学 2022-07-01 Tristan Milne , Adrian Nachman

Motivated by the computational difficulties incurred by popular deep learning algorithms for the generative modeling of temporal densities, we propose a cheap alternative which requires minimal hyperparameter tuning and scales favorably to…

机器学习 · 统计学 2023-10-13 Jonah Botvinick-Greenhouse , Yunan Yang , Romit Maulik

We present a novel framework based on optimal transport for the challenging problem of comparing graphs. Specifically, we exploit the probabilistic distribution of smooth graph signals defined with respect to the graph topology. This allows…

机器学习 · 计算机科学 2019-12-09 Hermina Petric Maretic , Mireille EL Gheche , Giovanni Chierchia , Pascal Frossard

The mathematical forces at work behind Generative Adversarial Networks raise challenging theoretical issues. Motivated by the important question of characterizing the geometrical properties of the generated distributions, we provide a…

Deep learning-based image restoration methods generally struggle with faithfully preserving the structures of the original image. In this work, we propose a novel Residual-Conditioned Optimal Transport (RCOT) approach, which models image…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Xiaole Tang , Xin Hu , Xiang Gu , Jian Sun

Recent advances in deep learning, such as powerful generative models and joint text-image embeddings, have provided the computational creativity community with new tools, opening new perspectives for artistic pursuits. Text-to-image…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Yingtao Tian , Marco Cuturi , David Ha

Optimal transport (OT) is a powerful tool in mathematics and data science but faces severe computational and statistical challenges in high dimensions. We propose convex relaxation approaches based on marginal and cluster moment relaxations…

最优化与控制 · 数学 2025-11-25 Yuehaw Khoo , Tianyun Tang