English
Related papers

Related papers: Density estimates and concentration inequalities w…

200 papers

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

In this paper we prove an estimate for the total variation distance, in the framework of the Breuer-Major theorem, using the Malliavin-Stein method, assuming the underlying function $g$ to be once weakly differentiable with $g$ and $g'$…

Probability · Mathematics 2019-07-12 Ivan Nourdin , David Nualart , Giovanni Peccati

Consider a Gaussian stationary sequence with unit variance $X=\{X_k;k\in {\mathbb{N}}\cup\{0\}\}$. Assume that the central limit theorem holds for a weighted sum of the form $V_n=n^{-1/2}\sum^{n-1}_{k=0}f(X_k)$, where $f$ designates a…

Probability · Mathematics 2015-09-30 Yaozhong Hu , David Nualart , Samy Tindel , Fangjun Xu

We provide sufficient density condition for a set of nonuniform samples to give rise to a set of sampling for multivariate bandlimited functions when the measurements consist of pointwise evaluations of a function and its first $k$…

Numerical Analysis · Mathematics 2016-09-12 Ben Adcock , Milana Gataric , Anders C. Hansen

We derive novel concentration inequalities that bound the statistical error for a large class of stochastic optimization problems, focusing on the case of unbounded objective functions. Our derivations utilize the following key tools: 1) A…

Machine Learning · Statistics 2026-01-01 Jeremiah Birrell

In this paper, we study the Dvoretzky covering problem with non-uniformly distributed centers. When the probability law of the centers admits an absolutely continuous density which satisfies a regular condition on the set of essential…

Probability · Mathematics 2021-11-02 Aihua Fan , Davit Karagulyan

The paper, that continuous some previous work of Sch\"onherr & Schuricht, treats density measures on ${\mathbb R}^n$ that concentrate in any neighborhood of a Lebesgue null set. Such measures are typical for purely finitely additive…

Analysis of PDEs · Mathematics 2026-04-14 Friedemann Schuricht

Conditional Density Estimation (CDE) models deal with estimating conditional distributions. The conditions imposed on the distribution are the inputs of the model. CDE is a challenging task as there is a fundamental trade-off between model…

Machine Learning · Statistics 2018-10-31 Vincent Dutordoir , Hugh Salimbeni , Marc Deisenroth , James Hensman

By using the mirror coupling for solutions of SDEs driven by pure jump L\'evy processes, we extend some transportation and concentration inequalities, which were previously known only in the case where the coefficients in the equation…

Probability · Mathematics 2019-11-12 Mateusz B. Majka

We consider here estimation of an unknown probability density s belonging to L2(mu) where mu is a probability measure. We have at hand n i.i.d. observations with density s and use the squared L2-norm as our loss function. The purpose of…

Statistics Theory · Mathematics 2013-01-22 Lucien Birgé

In this paper, we give an upper bound for a probabilistic distance between a Gaussian vector and a vector of U-statistics of Poisson point processes by applying Malliavin-Stein inequality on the Poisson space.

Probability · Mathematics 2011-11-10 Nguyen Tuan Minh

We consider a solution to a generic Markovian jump diffusion and show that for positive times the law of the solution process has a smooth density with respect to Lebesgue measure under a uniform version of Hoermander's conditions. Unlike…

Probability · Mathematics 2007-10-02 Thomas Cass

We show that rate-adaptive multivariate density estimation can be performed using Bayesian methods based on Dirichlet mixtures of normal kernels with a prior distribution on the kernel's covariance matrix parameter. We derive sufficient…

Statistics Theory · Mathematics 2013-08-22 Weining Shen , Surya T. Tokdar , Subhashis Ghosal

We combine Malliavin calculus with Stein's method, in order to derive explicit bounds in the Gaussian and Gamma approximations of random variables in a fixed Wiener chaos of a general Gaussian process. We also prove results concerning…

Probability · Mathematics 2008-05-10 Ivan Nourdin , Giovanni Peccati

We propose a new approach to non-parametric density estimation that is based on regularizing a Sobolev norm of the density. This method is statistically consistent, and makes the inductive bias of the model clear and interpretable. While…

Machine Learning · Statistics 2024-02-15 Mark Kozdoba , Binyamin Perets , Shie Mannor

Concentration inequalities for the sample mean, like those due to Bernstein, Hoeffding, and Bentkus, are valid for any sample size but overly conservative, yielding confidence intervals that are unnecessarily wide. The central limit theorem…

Probability · Mathematics 2025-12-23 Morgane Austern , Lester Mackey

We derive simple concentration inequalities for bounded random vectors, which generalize Hoeffding's inequalities for bounded scalar random variables. As applications, we apply the general results to multinomial and Dirichlet distributions…

Probability · Mathematics 2013-11-05 Xinjia Chen

We propose Bayesian model averaging (BMA) as a method for postprocessing the results of model-based clustering. Given a number of competing models, appropriate model summaries are averaged, using the posterior model probabilities, instead…

Computation · Statistics 2015-07-01 Niamh Russell , Thomas Brendan Murphy , Adrian E Raftery

Quantum tomography involves obtaining a full classical description of a prepared quantum state from experimental results. We propose a Langevin sampler for quantum tomography, that relies on a new formulation of Bayesian quantum tomography…

We study the rates of convergence of the posterior distribution for Bayesian density estimation with Dirichlet mixtures of normal distributions as the prior. The true density is assumed to be twice continuously differentiable. The bandwidth…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart