English
Related papers

Related papers: The statistical effect of entropic regularization …

200 papers

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

This work studies the entropic regularization formulation of the 2-Wasserstein distance on an infinite-dimensional Hilbert space, in particular for the Gaussian setting. We first present the Minimum Mutual Information property, namely the…

Machine Learning · Statistics 2022-03-15 Minh Ha Quang

A distributional route to Gaussianity, associated with the concept of Conservative Mixing Transformations in ensembles of random vector-valued variables, is proposed. This route is completely different from the additive mechanism…

Statistical Mechanics · Physics 2023-01-11 Massimiliano Giona , Chiara Pezzotti , Giuseppe Procopio

We establish the uniform in time stability, w.r.t. the marginals, of the Iterative Proportional Fitting Procedure, also known as Sinkhorn algorithm, used to solve entropy-regularised Optimal Transport problems. Our result is quantitative…

Machine Learning · Statistics 2021-10-25 George Deligiannidis , Valentin De Bortoli , Arnaud Doucet

We review two models of optimal transport, where congestion effects during the transport can be possibly taken into account. The first model is Beckmann's one, where the transport activities are modeled by vector fields with given…

Functional Analysis · Mathematics 2013-02-25 Lorenzo Brasco , Mircea Petrache

We study a generalization of the multi-marginal optimal transport problem, which has no fixed number of marginals $N$ and is inspired of statistical mechanics. It consists in optimizing a linear combination of the costs for all the possible…

Optimization and Control · Mathematics 2025-01-15 Simone Di Marino , Mathieu Lewin , Luca Nenna

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and…

Optimization and Control · Mathematics 2023-06-22 Stephan Eckstein , Marcel Nutz

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

In recent years, a range of measures of partial stochastic dominance have been introduced. These measures attempt to determine the extent to which one distribution is dominated by another. We assess these measures from intuitive, axiomatic,…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski

In optimal transport, quadratic regularization is a sparse alternative to entropic regularization: the solution measure tends to have small support. Computational experience suggests that the support decreases monotonically to the…

Optimization and Control · Mathematics 2025-04-16 Alberto González-Sanz , Marcel Nutz , Andrés Riveros Valdevenito

In this note, we generalize the classical optimal partial transport (OPT) problem by modifying the mass destruction/creation term to function-based terms, introducing what we term ``generalized optimal partial transport'' problems. We then…

Optimization and Control · Mathematics 2024-07-10 Yikun Bai

In this paper, we study the Tsallis entropic regularized optimal transport in the continuous setting and establish fundamental results such as the $\Gamma$-convergence of the Tsallis regularized optimal transport to the Monge--Kantorovich…

Optimization and Control · Mathematics 2024-10-10 Takeshi Suguro , Toshiaki Yachimura

We give a new proof of the Caffarelli contraction theorem, which states that the Brenier optimal transport map sending the standard Gaussian measure onto a uniformly log-concave probability measure is Lipschitz. The proof combines a recent…

Probability · Mathematics 2019-04-15 Max Fathi , Nathael Gozlan , Maxime Prodhomme

This paper examines an averaging technique applied to the transport equations as an alternative to vanishing viscosity. Such techniques have been shown to be valid shock-regularizations of the Burgers equation and the Euler equations, but…

Analysis of PDEs · Mathematics 2010-07-08 John Villavert , Kamran Mohseni

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer

Optimal transport (OT), and in particular the Wasserstein distance, has seen a surge of interest and applications in machine learning. However, empirical approximation under Wasserstein distances suffers from a severe curse of…

Statistics Theory · Mathematics 2020-01-28 Ziv Goldfeld , Kristjan Greenewald

This letter investigates dynamical optimal transport of underactuated linear systems over an infinite time horizon. In our previous work, we proposed to integrate model predictive control and the celebrated Sinkhorn algorithm to perform…

Optimization and Control · Mathematics 2023-08-16 Kaito Ito , Kenji Kashima

We present an optimal transport framework for performing regression when both the covariate and the response are probability distributions on a compact Euclidean subset $\Omega\subset\mathbb{R}^d$, where $d>1$. Extending beyond compactly…

Statistics Theory · Mathematics 2024-03-05 Laya Ghodrati , Victor M. Panaretos

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

We study the problem of designing hard negative sampling distributions for unsupervised contrastive representation learning. We propose and analyze a novel min-max framework that seeks a representation which minimizes the maximum…

Machine Learning · Computer Science 2023-12-18 Ruijie Jiang , Prakash Ishwar , Shuchin Aeron
‹ Prev 1 8 9 10 Next ›