English
Related papers

Related papers: Embedding Empirical Distributions for Computing Op…

200 papers

In many machine learning applications, it is necessary to meaningfully aggregate, through alignment, different but related datasets. Optimal transport (OT)-based approaches pose alignment as a divergence minimization problem: the aim is to…

Machine Learning · Statistics 2019-11-05 John Lee , Max Dabagia , Eva L. Dyer , Christopher J. Rozell

Network alignment, which aims to find node correspondence across different networks, is the cornerstone of various downstream multi-network and Web mining tasks. Most of the embedding-based methods indirectly model cross-network node…

Artificial Intelligence · Computer Science 2025-02-27 Qi Yu , Zhichen Zeng , Yuchen Yan , Lei Ying , R. Srikant , Hanghang Tong

With the widespread application of optimal transport (OT), its calculation becomes essential, and various algorithms have emerged. However, the existing methods either have low efficiency or cannot represent discontinuous maps. A novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zezeng Li , Shenghao Li , Lianbao Jin , Na Lei , Zhongxuan Luo

We investigate the use of entropy-regularized optimal transport (EOT) cost in developing generative models to learn implicit distributions. Two generative models are proposed. One uses EOT cost directly in an one-shot optimization problem…

Machine Learning · Computer Science 2019-08-01 Dong Liu , Minh Thành Vu , Saikat Chatterjee , Lars K. Rasmussen

Energy-based models (EBMs) are known in the Machine Learning community for decades. Since the seminal works devoted to EBMs dating back to the noughties, there have been a lot of efficient methods which solve the generative modelling…

Machine Learning · Computer Science 2024-03-19 Petr Mokrov , Alexander Korotin , Alexander Kolesov , Nikita Gushchin , Evgeny Burnaev

Optimal transport (OT) is a powerful tool for measuring the distance between two defined probability distributions. In this paper, we develop a new manifold named the coupling matrix manifold (CMM), where each point on CMM can be regarded…

Machine Learning · Computer Science 2019-11-26 Dai Shi , Junbin Gao , Xia Hong , S. T. Boris Choy , Zhiyong Wang

Optimal Transport (OT) has fueled machine learning (ML) across many domains. When paired data measurements $(\boldsymbol{\mu}, \boldsymbol{\nu})$ are coupled to covariates, a challenging conditional distribution learning setting arises.…

We study the fundamental computational problem of approximating optimal transport (OT) equations using neural differential equations (Neural ODEs). More specifically, we develop a novel framework for approximating unbalanced optimal…

Numerical Analysis · Mathematics 2026-05-21 Minh-Nhat Phung , Minh-Binh Tran

We propose novel fast algorithms for optimal transport (OT) utilizing a cyclic symmetry structure of input data. Such OT with cyclic symmetry appears universally in various real-world examples: image processing, urban planning, and graph…

Machine Learning · Computer Science 2023-11-23 Shoichiro Takeda , Yasunori Akagi , Naoki Marumo , Kenta Niwa

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

Modern communication networks are increasingly equipped with in-network computational capabilities and services. Routing in such networks is significantly more complicated than the traditional routing. A legitimate route for a flow not only…

Networking and Internet Architecture · Computer Science 2023-06-07 Lifan Mei , Jinrui Gou , Jingrui Yang , Yujin Cai , Yong Liu

The goal of this paper is to introduce a new theoretical framework for Optimal Transport (OT), using the terminology and techniques of Fully Probabilistic Design (FPD). Optimal Transport is the canonical method for comparing probability…

Artificial Intelligence · Computer Science 2022-12-29 Sarah Boufelja Y. , Anthony Quinn , Martin Corless , Robert Shorten

Optimal transport (OT) naturally arises in a wide range of machine learning applications but may often become the computational bottleneck. Recently, one line of works propose to solve OT approximately by searching the \emph{transport plan}…

Machine Learning · Computer Science 2021-11-15 Weijie Liu , Chao Zhang , Nenggan Zheng , Hui Qian

Learning from point sets is an essential component in many computer vision and machine learning applications. Native, unordered, and permutation invariant set structure space is challenging to model, particularly for point set…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Mohammad Shifat E Rabbi , Naqib Sad Pathan , Shiying Li , Yan Zhuang , Abu Hasnat Mohammad Rubaiyat , Gustavo K Rohde

Optimal transport (OT) is a widely used technique in machine learning, graphics, and vision that aligns two distributions or datasets using their relative geometry. In symmetry-rich settings, however, OT alignments based solely on pairwise…

Machine Learning · Computer Science 2025-09-26 Annabel Ma , Kaiying Hou , David Alvarez-Melis , Melanie Weber

Optimal transport (OT) distances between probability distributions are parameterized by the ground metric they use between observations. Their relevance for real-life applications strongly hinges on whether that ground metric parameter is…

Machine Learning · Statistics 2020-11-06 Matthieu Heitz , Nicolas Bonneel , David Coeurjolly , Marco Cuturi , Gabriel Peyré

Learning conditional distributions $\pi^*(\cdot|x)$ is a central problem in machine learning, which is typically approached via supervised methods with paired data $(x,y) \sim \pi^*$. However, acquiring paired data samples is often…

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

The current best practice for computing optimal transport (OT) is via entropy regularization and Sinkhorn iterations. This algorithm runs in quadratic time as it requires the full pairwise cost matrix, which is prohibitively expensive for…

Machine Learning · Computer Science 2022-04-06 Johannes Gasteiger , Marten Lienen , Stephan Günnemann