English
Related papers

Related papers: On the sample complexity of entropic optimal trans…

200 papers

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

This paper is concerned with non-parametric estimation of the entropy in ranked set sampling. Theoretical properties of the proposed estimator are studied. The proposed estimator is compared with the rival estimator in simple random…

Computation · Statistics 2015-06-16 Morteza Amini , Mahdi Mahdizadeh

We present a new active learning algorithm based on nonparametric estimators of the regression function. Our investigation provides probabilistic bounds for the rates of convergence of the generalization error achievable by proposed method…

Statistics Theory · Mathematics 2011-11-03 Stanislav Minsker

Collecting large-scale naturalistic driving data is essential for training robust autonomous driving planners. However, real-world datasets often contain a substantial amount of repetitive and low-value samples, which lead to excessive…

Robotics · Computer Science 2025-12-23 Zhaoyang Liu , Weitao Zhou , Junze Wen , Cheng Jing , Qian Cheng , Kun Jiang , Diange Yang

Entropically regularized optimal transport between probability measures supported on compact subsets of Euclidean space admits a representation as an information projection under moment inequality constraints. Exploiting this structure, I…

Statistics Theory · Mathematics 2026-01-15 Rami V. Tabri

The Cross Entropy method is a well-known adaptive importance sampling method for rare-event probability estimation, which requires estimating an optimal importance sampling density within a parametric class. In this article we estimate an…

Computation · Statistics 2013-10-15 Z. I. Botev , A. Ridder , L. Rojas-Nandayapa

We prove a new sample complexity result for divergence regularized optimal transport. Our bound holds for probability measures on~$\mathbb{R}^d$ with exponential tail decay and for radial cost functions that satisfy a local Lipschitz…

Statistics Theory · Mathematics 2026-03-23 Ruiyu Han , Johannes Wiesel

Large optimal transport problems can be approached via domain decomposition, i.e. by iteratively solving small partial problems independently and in parallel. Convergence to the global minimizers under suitable assumptions has been shown in…

Optimization and Control · Mathematics 2021-06-16 Mauro Bonafini , Ismael Medina , Bernhard Schmitzer

In many statistical settings, two types of data are available: coupled data, which preserve the joint structure among variables but are limited in size due to cost or privacy constraints, and marginal data, which are available at larger…

Methodology · Statistics 2026-03-31 Jakwang Kim , Young-Heon Kim , Chan Park

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

We study the convergence rate of Sinkhorn's algorithm for solving entropy-regularized optimal transport problems when at least one of the probability measures, $\mu$, admits a density over $\mathbb{R}^d$. For a semi-concave cost function…

Optimization and Control · Mathematics 2025-07-21 Lénaïc Chizat , Alex Delalande , Tomas Vaškevičius

We present a general (i.e., independent of the underlying model) interpolation technique based on optimal transportation of Gaussian models for parametric advection-dominated problems. The approach relies on a scalar testing function to…

Numerical Analysis · Mathematics 2022-10-19 Angelo Iollo , Tommaso Taddei

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and…

Optimization and Control · Mathematics 2023-06-22 Stephan Eckstein , Marcel Nutz

Optimal transport has gained significant attention in recent years due to its effectiveness in deep learning and computer vision. Its descendant metric, the Wasserstein distance, has been particularly successful in measuring distribution…

Optimization and Control · Mathematics 2025-02-18 Kaiwen Shi

In this paper, we present a novel and principled approach to learn the optimal transport between two distributions, from samples. Guided by the optimal transport theory, we learn the optimal Kantorovich potential which induces the optimal…

Machine Learning · Computer Science 2020-06-19 Ashok Vardhan Makkuva , Amirhossein Taghvaei , Sewoong Oh , Jason D. Lee

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky

Estimating a vector $\mathbf{x}$ from noisy linear measurements $\mathbf{Ax}+\mathbf{w}$ often requires use of prior knowledge or structural constraints on $\mathbf{x}$ for accurate reconstruction. Several recent works have considered…

Information Theory · Computer Science 2020-01-29 Alyson K. Fletcher , Sundeep Rangan , Subrata Sarkar , Philip Schniter

Recent advances in large-scale optimal transport have greatly extended its application scenarios in machine learning. However, existing methods either not explicitly learn the transport map or do not support general cost function. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Guansong Lu , Zhiming Zhou , Jian Shen , Cheng Chen , Weinan Zhang , Yong Yu

In machine learning and computer vision, optimal transport has had significant success in learning generative models and defining metric distances between structured and stochastic data objects, that can be cast as probability measures. The…

Machine Learning · Computer Science 2020-10-20 Anton Mallasto , Markus Heinonen , Samuel Kaski