English
Related papers

Related papers: Minimum cross-entropy distributions on Wasserstein…

200 papers

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

Consider a measure-preserving transition kernel $T$ on an arbitrary probability space $(\mathbb X,\mathcal cA,\pi)$. In this level of generality, we prove that a one-step hyper-contractivity estimate of the form $\|T\|_{p\to q}\le 1$ with…

Probability · Mathematics 2026-02-20 Justin Salez

It was recently shown that estimating the Shannon entropy $H({\rm p})$ of a discrete $k$-symbol distribution ${\rm p}$ requires $\Theta(k/\log k)$ samples, a number that grows near-linearly in the support size. In many applications $H({\rm…

Information Theory · Computer Science 2016-03-11 Jayadev Acharya , Alon Orlitsky , Ananda Theertha Suresh , Himanshu Tyagi

A novel framework for density estimation under expectation constraints is proposed. The framework minimizes the Wasserstein distance between the estimated density and a prior, subject to the constraints that the expected value of a set of…

Machine Learning · Statistics 2026-02-24 Yinan Hu , Esteban G. Tabak

We define a modified Wasserstein distance for distribution clustering which inherits many of the properties of the Wasserstein distance but which can be estimated easily and computed quickly. The modified distance is the sum of two terms.…

Methodology · Statistics 2018-12-31 Isabella Verdinelli , Larry Wasserman

We study the problem of robust distribution estimation under the Wasserstein distance, a popular discrepancy measure between probability distributions rooted in optimal transport (OT) theory. Given $n$ samples from an unknown distribution…

Machine Learning · Statistics 2024-09-25 Sloan Nietert , Rachel Cummings , Ziv Goldfeld

An independence model for discrete random variables is a Segre-Veronese variety in a probability simplex. Any metric on the set of joint states of the random variables induces a Wasserstein metric on the probability simplex. The unit ball…

Optimization and Control · Mathematics 2020-10-16 Türkü Özlüm Çelik , Asgar Jamneshan , Guido Montúfar , Bernd Sturmfels , Lorenzo Venturello

This paper is focused on the statistical analysis of probability measures $\nu_{1},\ldots,\nu_{n}$ on $\mathbb{R}$ that can be viewed as independent realizations of an underlying stochastic process. We consider the situation of practical…

Statistics Theory · Mathematics 2017-03-30 Jérémie Bigot , Raúl Gouet , Thierry Klein , Alfredo López

Detecting weak, systematic distribution shifts and quantitatively modeling individual, heterogeneous responses to policies or incentives have found increasing empirical applications in social and economic sciences. Given two probability…

Statistics Theory · Mathematics 2024-03-29 YoonHaeng Hur , Tengyuan Liang

Wasserstein barycenters correspond to optimal solutions of transportation problems for several marginals, and as such have a wide range of applications ranging from economics to statistics and computer science. When the marginal probability…

Optimization and Control · Mathematics 2015-08-11 Ethan Anderes , Steffen Borgwardt , Jacob Miller

We propose to quantify the entanglement of pure states of $N \times N$ bipartite quantum system by defining its Husimi distribution with respect to $SU(N)\times SU(N)$ coherent states. The Wehrl entropy is minimal if and only if the pure…

Quantum Physics · Physics 2009-11-10 Florian Mintert , Karol Zyczkowski

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

Machine Learning · Computer Science 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Impractical assumptions, an inherently myopic nature, and the crucial role of the initial design, all together contribute to making theoretical convergence proofs of little value in real-life Bayesian Optimization applications. In this…

Optimization and Control · Mathematics 2026-02-13 Antonio Candelieri , Francesco Archetti

In this paper, we use the class of Wasserstein metrics to study asymptotic properties of posterior distributions. Our first goal is to provide sufficient conditions for posterior consistency. In addition to the well-known Schwartz's…

Statistics Theory · Mathematics 2021-07-01 Minwoo Chae , Pierpaolo De Blasi , Stephen G. Walker

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

We consider synthesis and analysis of probability measures using the entropy-regularized Wasserstein-2 cost and its unbiased version, the Sinkhorn divergence. The synthesis problem consists of computing the barycenter, with respect to these…

Machine Learning · Statistics 2025-03-25 Brendan Mallery , James M. Murphy , Shuchin Aeron

We apply two variations of the principle of Minimum Cross Entropy (the Kullback information measure) to fit parameterized probability density models to observed data densities. For an array beamforming problem with P incident narrowband…

Information Theory · Computer Science 2008-06-24 Cheng-Yuan Liou , Bruce R. Musicus

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

Statistics Theory · Mathematics 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

The Wasserstein distance quantifies the distance between two probability measures on a metric space. We prove an analogue of the Berry-Esseen inequality for the Wasserstein distance on a finite area hyperbolic surface. This inequality…

Number Theory · Mathematics 2025-12-18 Peter Humphries

We study the dependence on $\varepsilon$ in the critical dimension $k(n,p,\varepsilon)$ for which one can find random sections of the $\ell_p^n$-ball which are $(1+\varepsilon)$-spherical. We give lower (and upper) estimates for…

Functional Analysis · Mathematics 2017-03-10 Grigoris Paouris , Petros Valettas , Joel Zinn
‹ Prev 1 8 9 10 Next ›