English
Related papers

Related papers: Sharper Exponential Convergence Rates for Sinkhorn…

200 papers

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

We prove non asymptotic linear convergence rates for the constrained Anderson acceleration extrapolation scheme. These guarantees come from new upper bounds on the constrained Chebyshev problem, which consists in minimizing the maximum…

Numerical Analysis · Mathematics 2020-10-30 Mathieu Barré , Adrien Taylor , Alexandre d'Aspremont

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

Optimization algorithms can see their local convergence rates deteriorate when the Hessian at the optimum is singular. These singularities are inescapable when the optima are non-isolated. Yet, under the right circumstances, several…

Optimization and Control · Mathematics 2024-09-10 Quentin Rebjock , Nicolas Boumal

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

In two earlier papers, we designed a distributed deterministic asynchronous algorithm for minimizing the sum of subdifferentiable and proximable functions and a regularizing quadratic on time-varying graphs based on Dykstra's algorithm, or…

Optimization and Control · Mathematics 2018-08-23 C. H. Jeffrey Pang

We study the least-energy way to reshape a probability distribution when motion is constrained to a horizontal bundle, that is, optimal transport and distribution steering in sub-Riemannian geometry, motivated by density control over…

Optimization and Control · Mathematics 2026-05-18 Daniel Owusu Adu , Karthik Elamvazhuthi , Bahman Gharesifard

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

In this work we propose a batch version of the Greenkhorn algorithm for multimarginal regularized optimal transport problems. Our framework is general enough to cover, as particular cases, some existing algorithms like Sinkhorn and…

Machine Learning · Statistics 2021-12-07 Vladimir Kostic , Saverio Salzo , Massimilano Pontil

Optimal transport (OT) plays an essential role in various areas like machine learning and deep learning. However, computing discrete optimal transport plan for large scale problems with adequate accuracy and efficiency is still highly…

Machine Learning · Computer Science 2021-07-20 Dongsheng An , Na Lei , Xianfeng Gu

We propose a new metric between probability measures on a compact metric space that mirrors the Riemannian manifold-like structure of quadratic optimal transport but includes entropic regularization. Its metric tensor is given by the…

Optimization and Control · Mathematics 2025-09-22 Hugo Lavenant , Jonas Luckhardt , Gilles Mordant , Bernhard Schmitzer , Luca Tamanini

Entropic Optimal Transport (EOT), also referred to as the Schr\"odinger problem, seeks to find a random processes with prescribed initial/final marginals and with minimal relative entropy with respect to a reference measure. The relative…

Optimization and Control · Mathematics 2024-12-17 Jean-David Benamou , Guillaume Chazareix , Marc Hoffmann , Grégoire Loeper , François-Xavier Vialard

In 2012, Pflug and Pichler proved, under regularity assumptions, that the value function in Multistage Stochastic Programming (MSP) is Lipschitz continuous w.r.t. the Nested Distance, which is a distance between scenario trees (or discrete…

Optimization and Control · Mathematics 2021-07-22 Zheng Qu , Benoît Tran

Based on the Hilb type formula between Jacobi polynomials and Bessel functions, optimal decay rates on Jacobi expansion coefficients are derived, by applying van der Corput type lemmas, for functions of logarithmatic singularities, which…

Numerical Analysis · Mathematics 2020-06-09 Shuhuang Xiang

In a separable Hilbert space, we study the minimization problem of a convex smooth function with Lipschitz continuous gradient whose evaluations are corrupted by random noise. To this end, we associate a stochastic inertial system that…

Optimization and Control · Mathematics 2025-12-18 Chiara Schindler

In this paper, we prove a theorem on the rate of convergence for the optimal cost computed using PS methods. It is a first proved convergence rate in the literature of PS optimal control. In addition to the high-order convergence rate, two…

Optimization and Control · Mathematics 2009-04-07 Wei Kang

Recently, linear regression models incorporating an optimal transport (OT) loss have been explored for applications such as supervised unmixing of spectra, music transcription, and mass spectrometry. However, these task-specific approaches…

Let $X$ and $Y$ be domains of $\mathbb{R}^n$ equipped with respective probability measures $\mu$ and $ \nu$. We consider the problem of optimal transport from $\mu$ to $\nu$ with respect to a cost function $c: X \times Y \to \mathbb{R}$. To…

Optimization and Control · Mathematics 2020-05-27 Gabriel Khan , Jun Zhang

Entropy-regularized optimal transport, which has strong links to the Schr\"odinger bridge problem in statistical mechanics, enjoys a variety of applications from trajectory inference to generative modeling. A major driver of renewed…

Machine Learning · Statistics 2026-01-27 Anand Srinivasan , Jean-Jacques Slotine

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai