English
Related papers

Related papers: Score-based Generative Neural Networks for Large-S…

200 papers

In this paper, we propose an accelerated version for the Sinkhorn algorithm, which is the reference method for computing the solution to Entropic Optimal Transport. Its main draw-back is the exponential slow-down of convergence as the…

Numerical Analysis · Mathematics 2025-06-19 Reda Chhaibi , Serge Gratton , Samuel Vaiter

Vector-quantized networks (VQNs) have exhibited remarkable performance across various tasks, yet they are prone to training instability, which complicates the training process due to the necessity for techniques such as subtle…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Borui Zhang , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Computing optimal transport distances such as the earth mover's distance is a fundamental problem in machine learning, statistics, and computer vision. Despite the recent introduction of several algorithms with good empirical performance,…

Data Structures and Algorithms · Computer Science 2018-02-08 Jason Altschuler , Jonathan Weed , Philippe Rigollet

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum…

Machine Learning · Computer Science 2023-12-18 Ruijie Jiang , Prakash Ishwar , Shuchin Aeron

We consider the traffic control problem of dynamic routing over parallel servers, which arises in a variety of engineering systems such as transportation and data transmission. We propose a semi-gradient, on-policy algorithm that learns an…

Machine Learning · Computer Science 2025-03-20 Yidan Wu , Yu Yu , Jianan Zhang , Li Jin

Deep Neural Networks and Reinforcement Learning methods have empirically shown great promise in tackling challenging combinatorial problems. In those methods a deep neural network is used as a solution generator which is then trained by…

Machine Learning · Computer Science 2023-11-08 Constantine Caramanis , Dimitris Fotakis , Alkis Kalavasis , Vasilis Kontonis , Christos Tzamos

In many machine learning applications, it is necessary to meaningfully aggregate, through alignment, different but related datasets. Optimal transport (OT)-based approaches pose alignment as a divergence minimization problem: the aim is to…

Machine Learning · Statistics 2019-11-05 John Lee , Max Dabagia , Eva L. Dyer , Christopher J. Rozell

We introduce a simple, accurate, and extremely efficient method for numerically solving the multi-marginal optimal transport (MMOT) problems arising in density functional theory. The method relies on (i) the sparsity of optimal plans [for…

Machine Learning · Computer Science 2021-03-24 Gero Friesecke , Andreas S. Schulz , Daniela Vögler

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

Optimization and Control · Mathematics 2025-08-11 Ricardo Baptista , Panagiota Birmpa , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang

The use of optimal transport cost for learning generative models has become popular with Wasserstein Generative Adversarial Networks (WGAN). Training of WGAN relies on a theoretical background: the calculation of the gradient of the optimal…

Machine Learning · Statistics 2024-04-04 Antoine Houdard , Arthur Leclaire , Nicolas Papadakis , Julien Rabin

Entropically regularized optimal transport between probability measures supported on compact subsets of Euclidean space admits a representation as an information projection under moment inequality constraints. Exploiting this structure, I…

Statistics Theory · Mathematics 2026-01-15 Rami V. Tabri

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Suppose we are given two metric spaces and a family of continuous transformations from one to the other. Given a probability distribution on each of these two spaces - namely the source and the target measures - the Wasserstein alignment…

Probability · Mathematics 2025-03-11 Soumik Pal , Bodhisattva Sen , Ting-Kam Leonard Wong

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

Machine Learning · Statistics 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

The Traveling Salesman Problem (TSP) is a classic NP-hard combinatorial optimization task with numerous practical applications. Classic heuristic solvers can attain near-optimal performance for small problem instances, but become…

Machine Learning · Computer Science 2025-08-13 Michael Li , Eric Bae , Christopher Haberland , Natasha Jaques

In train routing, the headway is the minimum distance that must be maintained between successive trains for safety and robustness. We introduce a model for train routing that requires a fixed headway to be maintained between trains, and…

Data Structures and Algorithms · Computer Science 2025-07-08 Umang Bhaskar , Katharina Eickhoff , Lennart Kauther , Jannik Matuschke , Britta Peis , Laura Vargas Koch

Deep learning-based methods are growing prominence for planning purposes. In this paper, we present a hybrid planner that combines a graph machine learning model and an optimal solver based on branch and bound tree search for path-planning…

Artificial Intelligence · Computer Science 2022-04-05 Kevin Osanlou , Andrei Bursuc , Christophe Guettier , Tristan Cazenave , Eric Jacopin

The framework of optimal transport has been leveraged to extend the notion of rank to the multivariate setting while preserving desirable properties of the resulting goodness-of-fit (GoF) statistics. In particular, the rank energy (RE) and…

Machine Learning · Statistics 2022-11-29 Shoaib Bin Masud , Matthew Werenski , James M. Murphy , Shuchin Aeron

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai