English
Related papers

Related papers: Entropic Regularization of the Nested Distance

200 papers

The nested distance builds on the Wasserstein distance to quantify the difference of stochastic processes, including also the information modelled by filtrations. The Sinkhorn divergence is a relaxation of the Wasserstein distance, which…

Optimization and Control · Mathematics 2021-02-11 Alois Pichler , Michael Weinhardt

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and H\"older continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general…

Optimization and Control · Mathematics 2022-07-06 Stephan Eckstein , Marcel Nutz

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are…

Machine Learning · Computer Science 2022-05-02 Bahar Taskesen , Soroosh Shafieezadeh-Abadeh , Daniel Kuhn

The adapted Wasserstein distance is a metric for quantifying distributional uncertainty and assessing the sensitivity of stochastic optimization problems on time series data. A computationally efficient alternative to it, is provided by the…

Optimization and Control · Mathematics 2025-10-10 Beatrice Acciaio , Songyan Hou , Gudmund Pammer

We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to…

Optimization and Control · Mathematics 2024-07-24 Rui Gao , Rohit Arora , Yizhe Huang

Computing the optimal transport distance between statistical distributions is a fundamental task in machine learning. One remarkable recent advancement is entropic regularization and the Sinkhorn algorithm, which utilizes only matrix…

Optimization and Control · Mathematics 2024-01-24 Xun Tang , Michael Shavlovsky , Holakou Rahmanian , Elisa Tardini , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

Optimal transportation distances are a fundamental family of parameterized distances for histograms. Despite their appealing theoretical properties, excellent performance in retrieval tasks and intuitive formulation, their computation…

Machine Learning · Statistics 2014-03-25 Marco Cuturi

Distributionally robust optimization (DRO) is a powerful technique to train robust models against data distribution shift. This paper aims to solve regularized nonconvex DRO problems, where the uncertainty set is modeled by a so-called…

Optimization and Control · Mathematics 2025-06-30 Yufeng Yang , Yi Zhou , Zhaosong Lu

Optimal transport (OT) serves as a natural framework for comparing probability measures, with applications in statistics, machine learning, and applied mathematics. Alas, statistical estimation and exact computation of the OT distances…

Statistics Theory · Mathematics 2024-05-14 Tao Wang , Ziv Goldfeld

Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In this work, we focus…

Optimization and Control · Mathematics 2024-03-11 Xun Tang , Holakou Rahmanian , Michael Shavlovsky , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

We consider the optimal control problem of steering an agent population to a desired distribution over an infinite horizon. This is an optimal transport problem over dynamical systems, which is challenging due to its high computational…

Optimization and Control · Mathematics 2023-01-18 Kaito Ito , Kenji Kashima

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

Numerical Analysis · Mathematics 2020-05-01 Mohammad Motamed

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

Multimarginal optimal transport (MOT) is a powerful framework for modeling interactions between multiple distributions, yet its applicability is bottlenecked by a high computational overhead. Entropic regularization provides computational…

Machine Learning · Computer Science 2025-06-03 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald , Haim Permuter

Applications of optimal transport have recently gained remarkable attention thanks to the computational advantages of entropic regularization. However, in most situations the Sinkhorn approximation of the Wasserstein distance is replaced by…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Alessandro Rudi , Massimiliano Pontil , Carlo Ciliberto

The squared Wasserstein distance is a natural quantity to compare probability distributions in a non-parametric setting. This quantity is usually estimated with the plug-in estimator, defined via a discrete optimal transport problem which…

Optimization and Control · Mathematics 2020-10-30 Lenaic Chizat , Pierre Roussillon , Flavien Léger , François-Xavier Vialard , Gabriel Peyré

We propose a new framework for formulating optimal transport distances between Markov chains. Previously known formulations studied couplings between the entire joint distribution induced by the chains, and derived solutions via a reduction…

Machine Learning · Computer Science 2024-06-17 Sergio Calo , Anders Jonsson , Gergely Neu , Ludovic Schwartz , Javier Segovia-Aguas
‹ Prev 1 2 3 10 Next ›