English
Related papers

Related papers: Some asymptotic results on density estimators by w…

200 papers

We analyze a plug-in estimator for a large class of integral functionals of one or more continuous probability densities. This class includes important families of entropy, divergence, mutual information, and their conditional versions. For…

Statistics Theory · Mathematics 2016-03-30 Shashank Singh , Barnabás P óczos

Consider the Mills ratio $f(x)=\big(1-\Phi(x)\big)/\phi(x), \, x\ge 0$, where $\phi$ is the density function of the standard Gaussian law and $\Phi$ its cumulative distribution.We introduce a general procedure to approximate $f$ on the…

Probability · Mathematics 2013-07-15 Armengol Gasull , Frederic Utzet

We consider density estimation for Besov spaces when each sample is quantized to only a limited number of bits. We provide a noninteractive adaptive estimator that exploits the sparsity of wavelet bases, along with a simulate-and-infer…

Statistics Theory · Mathematics 2021-07-22 Jayadev Acharya , Clément L. Canonne , Aditya Vikram Singh , Himanshu Tyagi

Given $n$ independent random vectors with common density $f$ on $\mathbb{R}^d$, we study the weak convergence of three empirical-measure based estimators of the convex $\lambda$-level set $L_\lambda$ of $f$, namely the excess mass set, the…

Statistics Theory · Mathematics 2020-06-04 Philippe Berthet , John H. J. Einmahl

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

We give a general proof of the strong consistency of the Maximum Likelihood Estimator for the case of independent non-identically distributed (i.n.i.d) data, assuming that the density functions of the random variables follow a particular…

Statistics Theory · Mathematics 2025-01-14 Ricardo Ferreira , Filipa Valdeira , Marta Guimarães , Cláudia Soares

We consider a (random permutation model) binary search tree with n nodes and give asymptotics on the loglog scale for the height H_n and saturation level h_n of the tree as n\to\infty, both almost surely and in probability. We then consider…

Probability · Mathematics 2010-02-23 Matthew I. Roberts

In the regression model with errors in variables, we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f_{\theta^0}(X)+\xi$ and $Z=X+\epsilon$ involving independent and unobserved random variables $X,\xi,\epsilon$ plus a regression…

Statistics Theory · Mathematics 2009-09-29 Cristina Butucea , Marie-Luce Taupin

Considering the family of $L$-functions $\{L(s,f)\}_{f \in H_k}$ where $H_k$ is the set of weight $k$ Hecke-eigen cusp forms for $SL_2(\mathbb{Z})$, we prove a zero density estimate near the central point, valid as the weight $k \to…

Number Theory · Mathematics 2014-12-01 Bob Hough

In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide…

Methodology · Statistics 2018-12-06 Robert Bassett , James Sharpnack

We present a concentration result concerning random weighted projections in high dimensional spaces. As applications, we prove (1) New concentration inequalities for random quadratic forms; (2) The infinity norm of most unit eigenvectors of…

Probability · Mathematics 2014-08-19 Van Vu , Ke Wang

Let $f$ be a Rademacher or a Steinhaus random multiplicative function. Let $\varepsilon>0$ small. We prove that, as $x\rightarrow +\infty$, we almost surely have $$\bigg|\sum_{\substack{n\leq x\\…

Number Theory · Mathematics 2021-05-21 Daniele Mastrostefano

We prove two main results on how arbitrary linear threshold functions $f(x) = \sign(w\cdot x - \theta)$ over the $n$-dimensional Boolean hypercube can be approximated by simple threshold functions. Our first result shows that every…

Computational Complexity · Computer Science 2009-10-21 Ilias Diakonikolas , Rocco A. Servedio

Linear wavelet density estimators are wavelet projections of the empirical measure based on independent, identically distributed observations. We study here the law of the iterated logarithm (LIL) and a Berry-Esseen type theorem. These…

Statistics Theory · Mathematics 2012-10-31 Lu Lu

We revisit the problem of estimating the center of symmetry $\theta$ of an unknown symmetric density $f$. Although Stone (1975), Van Eden (1970), and Sacks (1975) constructed adaptive estimators of $\theta$ in this model, their estimators…

Statistics Theory · Mathematics 2019-11-15 Nilanjana Laha

We aim at estimating in a non-parametric way the density $\pi$ of the stationary distribution of a $d$-dimensional stochastic differential equation $(X_t)_{t \in [0, T]}$, for $d \ge 2$, from the discrete observations of a finite sample…

Statistics Theory · Mathematics 2022-12-29 Chiara Amorino , Arnaud Gloter

This Note presents original rates of convergence for the deconvolution problem. We assume that both the estimated density and noise density are supersmooth and we compute the risk for two kinds of estimators.

Statistics Theory · Mathematics 2009-09-29 Claire Lacour

Given $n$ independent random marked $d$-vectors $X_i$ with a common density, define the measure $\nu_n = \sum_i \xi_i $, where $\xi_i$ is a measure (not necessarily a point measure) determined by the (suitably rescaled) set of points near…

Probability · Mathematics 2007-05-23 Mathew D. Penrose

We observe an unknown function of $d$ variables $f(\boldsymbol{t})$, $\boldsymbol{t} \in[0,1]^d$, in the Gaussian white noise model of intensity $\varepsilon>0$. We assume that the function $f$ is regular and that it is a sum of $k$-variate…

Statistics Theory · Mathematics 2025-12-17 Natalia Stepanova , Marie Turcicova , Xiang Zhao

We analyze four different approaches to estimate a multivariate probability density (or the log-density) and its first and second order derivatives. Two methods, local log-likelihood and local Hyv\"arinen score estimation, are in terms of…

Statistics Theory · Mathematics 2020-08-11 Christof Strähl , Johanna F. Ziegel , Lutz Duembgen