中文
相关论文

相关论文: Interpolating between Optimal Transport and MMD us…

200 篇论文

Optimal transport distances (OT) have been widely used in recent work in Machine Learning as ways to compare probability distributions. These are costly to compute when the data lives in high dimension. Recent work by Paty et al., 2019,…

机器学习 · 计算机科学 2021-11-10 Patric M. Fulop , Vincent Danos

Sampling from diffusion probabilistic models (DPMs) can be viewed as a piecewise distribution transformation, which generally requires hundreds or thousands of steps of the inverse diffusion trajectory to get a high-quality image. Recent…

计算机视觉与模式识别 · 计算机科学 2023-07-24 Zezeng Li , ShengHao Li , Zhanpeng Wang , Na Lei , Zhongxuan Luo , Xianfeng Gu

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

数值分析 · 数学 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

机器学习 · 计算机科学 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann

Dataset distillation seeks to synthesize a compact distilled dataset, enabling models trained on it to achieve performance comparable to models trained on the full dataset. Recent methods for large-scale datasets focus on matching global…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Xiao Cui , Yulei Qin , Wengang Zhou , Hongsheng Li , Houqiang Li

Computing optimal transport (OT) distances such as the earth mover's distance is a fundamental problem in machine learning, statistics, and computer vision. In this paper, we study the problem of approximating the general OT distance…

数据结构与算法 · 计算机科学 2023-01-18 Zhao Song , Tianyi Zhou

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

机器学习 · 统计学 2018-03-06 Brahim Khalil Abid , Robert M. Gower

Optimal Transport is a theory that allows to define geometrical notions of distance between probability distributions and to find correspondences, relationships, between sets of points. Many machine learning applications are derived from…

机器学习 · 统计学 2020-11-10 Titouan Vayer

We study the optimal transport problem for $d>2$ discrete measures. This is a linear programming problem on $d$-tensors. It gives a way to compute a "distance" between two sets of discrete measures. We introduce an entropic regularization…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Shmuel Friedland

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

机器学习 · 计算机科学 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

We provide a computational complexity analysis for the Sinkhorn algorithm that solves the entropic regularized Unbalanced Optimal Transport (UOT) problem between two measures of possibly different masses with at most $n$ components. We show…

计算复杂性 · 计算机科学 2020-11-20 Khiem Pham , Khang Le , Nhat Ho , Tung Pham , Hung Bui

We study the unbalanced optimal transport (UOT) problem, where the marginal constraints are enforced using Maximum Mean Discrepancy (MMD) regularization. Our work is motivated by the observation that the literature on UOT is focused on…

机器学习 · 计算机科学 2024-02-01 Piyushi Manupriya , J. Saketha Nath , Pratik Jawanpuria

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

机器学习 · 统计学 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

We provide theoretical analyses for two algorithms that solve the regularized optimal transport (OT) problem between two discrete probability measures with at most $n$ atoms. We show that a greedy variant of the classical Sinkhorn…

数据结构与算法 · 计算机科学 2021-07-27 Tianyi Lin , Nhat Ho , Michael I. Jordan

Correctly estimating the discrepancy between two data distributions has always been an important task in Machine Learning. Recently, Cuturi proposed the Sinkhorn distance which makes use of an approximate Optimal Transport cost between two…

计算机视觉与模式识别 · 计算机科学 2018-01-18 Ying Lu , Liming Chen , Alexandre Saidi , Xianfeng Gu

We propose a new metric between probability measures on a compact metric space that mirrors the Riemannian manifold-like structure of quadratic optimal transport but includes entropic regularization. Its metric tensor is given by the…

最优化与控制 · 数学 2025-09-22 Hugo Lavenant , Jonas Luckhardt , Gilles Mordant , Bernhard Schmitzer , Luca Tamanini

Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning.…

统计方法学 · 统计学 2021-06-22 Debarghya Mukherjee , Aritra Guha , Justin Solomon , Yuekai Sun , Mikhail Yurochkin

In machine learning and computer graphics, a fundamental task is the approximation of a probability density function through a well-dispersed collection of samples. Providing a formal metric for measuring the distance between probability…

图形学 · 计算机科学 2024-02-28 Baptiste Genest , Nicolas Courty , David Coeurjolly

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

机器学习 · 统计学 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

This paper studies the Partial Optimal Transport (POT) problem between two unbalanced measures with at most $n$ supports and its applications in various AI tasks such as color transfer or domain adaptation. There is hence the need for fast…

机器学习 · 计算机科学 2023-12-25 Anh Duc Nguyen , Tuan Dung Nguyen , Quang Minh Nguyen , Hoang H. Nguyen , Lam M. Nguyen , Kim-Chuan Toh