English
Related papers

Related papers: On minimax density estimation via measure transpor…

200 papers

Transport maps have become a popular mechanic to express complicated probability densities using sample propagation through an optimized push-forward. Beside their broad applicability and well-known success, transport maps suffer from…

Numerical Analysis · Mathematics 2020-08-11 Martin Eigel , Robert Gruhlke , Manuel Marschall

We analyze a number of natural estimators for the optimal transport map between two distributions and show that they are minimax optimal. We adopt the plugin approach: our estimators are simply optimal couplings between measures derived…

Statistics Theory · Mathematics 2024-06-18 Tudor Manole , Sivaraman Balakrishnan , Jonathan Niles-Weed , Larry Wasserman

Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of…

Machine Learning · Statistics 2018-10-18 Rui Zhuang , Johannes Lederer

The log-concave maximum likelihood estimator of a density on the real line based on a sample of size $n$ is known to attain the minimax optimal rate of convergence of $O(n^{-4/5})$ with respect to, e.g., squared Hellinger distance. In this…

Statistics Theory · Mathematics 2016-09-06 Arlene K. H. Kim , Adityanand Guntuboyina , Richard J. Samworth

Transport map methods offer a powerful statistical learning tool that can couple a target high-dimensional random variable with some reference random variable using invertible transformations. This paper presents new computational…

Numerical Analysis · Mathematics 2023-03-07 Tiangang Cui , Sergey Dolgov , Olivier Zahm

We consider the Monge problem of optimal transport between a compactly supported source measure and a target probability measure with unbounded support. We consider the convergence of optimal maps and potential functions when the target…

Numerical Analysis · Mathematics 2026-03-03 Axel G. R. Turnquist

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

This paper studies the convergence rates of optimal transport (OT) map estimators, a topic of growing interest in statistics, machine learning, and various scientific fields. Despite recent advancements, existing results rely on regularity…

Statistics Theory · Mathematics 2024-12-12 Yizhe Ding , Runze Li , Lingzhou Xue

We present an optimal transport framework for performing regression when both the covariate and the response are probability distributions on a compact Euclidean subset $\Omega\subset\mathbb{R}^d$, where $d>1$. Extending beyond compactly…

Statistics Theory · Mathematics 2024-03-05 Laya Ghodrati , Victor M. Panaretos

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

The likelihood function is a fundamental component in Bayesian statistics. However, evaluating the likelihood of an observation is computationally intractable in many applications. In this paper, we propose a non-parametric approximation of…

Machine Learning · Computer Science 2019-10-24 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Man-Chung Yue , Daniel Kuhn , Wolfram Wiesemann

We study the rate of convergence of posterior distributions in density estimation problems for log-densities in periodic Sobolev classes characterized by a smoothness parameter p. The posterior expected density provides a nonparametric…

Statistics Theory · Mathematics 2009-09-29 Catia Scricciolo

We obtain an explicit solution for the static Kullback--Leibler (KL) unbalanced optimal transport problem between finite non-degenerate Gaussian measures with quadratic cost, two independent positive marginal relaxation parameters, and no…

Optimization and Control · Mathematics 2026-05-05 Jiaping Yang , Yunxin Zhang

This paper is concerned with the estimation of the partial derivatives of a probability density function of directional data on the $d$-dimensional torus within the local thresholding framework. The estimators here introduced are built by…

Statistics Theory · Mathematics 2023-05-11 Claudio Durastanti , Nicola Turchi

This paper proposes a theory for $\ell_1$-norm penalized high-dimensional $M$-estimators, with nonconvex risk and unrestricted domain. Under high-level conditions, the estimators are shown to attain the rate of convergence…

Statistics Theory · Mathematics 2022-04-14 Jad Beyhum , François Portier

We consider the problem of estimating the probability density function of a circular random variable observed under censoring. To this end, we introduce a projection estimator constructed via a regression approach on linear sieves. We first…

Statistics Theory · Mathematics 2025-12-09 Nicolas Conanec , Claire Lacour , Thanh Mai Pham Ngoc

We consider the problem of estimating a mixture of power series distributions with infinite support, to which belong very well-known models such as Poisson, Geometric, Logarithmic or Negative Binomial probability mass functions. We consider…

Statistics Theory · Mathematics 2025-08-04 Fadoua Balabdaoui , Harald Besdziek , Yong Wang

We study Bregman divergences in probability density space embedded with the $L^2$-Wasserstein metric. Several properties and dualities of transport Bregman divergences are provided. In particular, we derive the transport Kullback-Leibler…

Information Theory · Computer Science 2025-04-08 Wuchen Li

Optimal transport is a geometrically intuitive, robust and flexible metric for sample comparison in data analysis and machine learning. Its formal Riemannian structure allows for a local linearization via a tangent space approximation. This…

Optimization and Control · Mathematics 2024-06-07 Clément Sarrazin , Bernhard Schmitzer

Estimating Kullback-Leibler divergence from identical and independently distributed samples is an important problem in various domains. One simple and effective estimator is based on the k nearest neighbor distances between these samples.…

Information Theory · Computer Science 2020-02-27 Puning Zhao , Lifeng Lai