English
Related papers

Related papers: Beyond entropic regularization: Debiased Gaussian …

200 papers

For probability measures on countable spaces we derive distributional limits for empirical entropic optimal transport quantities. More precisely, we show that the empirical optimal transport plan weakly converges to a centered Gaussian…

Probability · Mathematics 2022-12-27 Shayan Hundrieser , Marcel Klatt , Axel Munk

New upper bounds are developed for the $L_2$ distance between $\xi/\text{Var}[\xi]^{1/2}$ and linear and quadratic functions of $z\sim N(0,I_n)$ for random variables of the form $\xi=bz^\top f(z) - \text{div} f(z)$. The linear approximation…

Statistics Theory · Mathematics 2021-09-30 Pierre C Bellec , Cun-Hui Zhang

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

We establish weak limits for the empirical entropy regularized optimal transport cost, the expectation of the empirical plan and the conditional expectation. Our results require only uniform boundedness of the cost function and no…

Statistics Theory · Mathematics 2023-05-18 Alberto González-Sanz , Shayan Hundrieser

This paper addresses the problem of Unbalanced Optimal Transport (UOT) in which the marginal conditions are relaxed (using weighted penalties in lieu of equality) and no additional regularization is enforced on the OT plan. In this context,…

Optimization and Control · Mathematics 2021-06-09 Laetitia Chapel , Rémi Flamary , Haoran Wu , Cédric Févotte , Gilles Gasso

Estimating optimal transport (OT) maps (a.k.a. Monge maps) between two measures $P$ and $Q$ is a problem fraught with computational and statistical challenges. A promising approach lies in using the dual potential functions obtained when…

Optimization and Control · Mathematics 2022-06-20 Aram-Alexandre Pooladian , Marco Cuturi , Jonathan Niles-Weed

Sample-based trajectory optimisers are a promising tool for the control of robotics with non-differentiable dynamics and cost functions. Contemporary approaches derive from a restricted subclass of stochastic optimal control where the…

Robotics · Computer Science 2021-10-07 Tom Lefebvre , Guillaume Crevecoeur

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

Regularization is widely used in statistics and machine learning to prevent overfitting and gear solution towards prior information. In general, a regularized estimation problem minimizes the sum of a loss function and a penalty term. The…

Computation · Statistics 2012-01-18 Hua Zhou , Yichao Wu

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

Statistics Theory · Mathematics 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero

Consensus optimization enables autonomous agents to solve joint tasks through peer-to-peer exchanges alone. Classical decentralized gradient descent is appealing for its minimal state but fails to achieve exact consensus with fixed…

Optimization and Control · Mathematics 2025-12-02 Hong Wang

Solving linear programs by using entropic penalization has recently attracted new interest in the optimization community, since this strategy forms the basis for the fastest-known algorithms for the optimal transport problem, with many…

Optimization and Control · Mathematics 2018-06-07 Jonathan Weed

We develop a mathematical theory of entropic regularisation of unbalanced optimal transport problems. Focusing on static formulation and relying on the formalism developed for the unregularised case, we show that unbalanced optimal…

Optimization and Control · Mathematics 2023-05-05 Maciej Buze , Manh Hong Duong

Deep learning models are known to be overconfident in their predictions on out of distribution inputs. This is a challenge when a model is trained on a particular input dataset, but receives out of sample data when deployed in practice.…

Machine Learning · Statistics 2018-12-04 Kumar Sricharan , Kumar Kallurupalli , Ashok Srivastava

Linear programs with quadratic regularization are attracting renewed interest due to their applications in optimal transport: unlike entropic regularization, the squared-norm penalty gives rise to sparse approximations of optimal transport…

Optimization and Control · Mathematics 2025-04-23 Alberto González-Sanz , Marcel Nutz

This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach,…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Peihu Duan , Qishao Wang , Zhisheng Duan , Guanrong Chen

This paper is focused on the study of entropic regularization in optimal transport as a smoothing method for Wasserstein estimators, through the prism of the classical tradeoff between approximation and estimation errors in statistics.…

Machine Learning · Statistics 2024-10-30 Jérémie Bigot , Paul Freulon , Boris P. Hejblum , Arthur Leclaire

We extend the work of Hahn and Carvalho (2015) and develop a doubly-regularized sparse regression estimator by synthesizing Bayesian regularization with penalized least squares within a decision-theoretic framework. In contrast to existing…

Methodology · Statistics 2025-02-04 Aihua Li , Surya T. Tokdar , Jason Xu

Optimal transport (OT) serves as a natural framework for comparing probability measures, with applications in statistics, machine learning, and applied mathematics. Alas, statistical estimation and exact computation of the OT distances…

Statistics Theory · Mathematics 2024-05-14 Tao Wang , Ziv Goldfeld

Recent developments in linear system identification have proposed the use of non-parameteric methods, relying on regularization strategies, to handle the so-called bias/variance trade-off. This paper introduces an impulse response estimator…

Systems and Control · Computer Science 2014-10-01 Giulia Prando , Alessandro Chiuso , Gianluigi Pillonetto
‹ Prev 1 2 3 10 Next ›