English
Related papers

Related papers: Limit theorems for kernel density estimators under…

200 papers

In this paper we study the concentration properties for the eigenvalues of kernel matrices, which are central objects in a wide range of kernel methods and, more recently, in network analysis. We present a set of concentration inequalities…

Machine Learning · Statistics 2020-10-27 Ernesto Araya Valdivia

Partial Bergman kernels $\Pi_{k, E}$ are kernels of orthogonal projections onto subspaces $\mathcal{k} \subset H^0(M, L^k)$ of holomorphic sections of the $k$th power of an ample line bundle over a Kahler manifold $(M, \omega)$. The…

Complex Variables · Mathematics 2019-06-26 Steve Zelditch , Peng Zhou

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

We investigate the nonparametric estimation for regression in a fixed-design setting when the errors are given by a field of dependent random variables. Sufficient conditions for kernel estimators to converge uniformly are obtained. These…

Statistics Theory · Mathematics 2007-06-13 Mohamed El Machkouri

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

In this paper, under mild assumptions, we derive a law of large numbers, a central limit theorem with an error estimate, an almost sure invariance principle and a variant of Chernoff bound in finite-state hidden Markov models. These limit…

Information Theory · Computer Science 2012-04-13 Guangyue Han

In real supervised learning scenarios, it is not uncommon that the training and test sample follow different probability distributions, thus rendering the necessity to correct the sampling bias. Focusing on a particular covariate shift…

Machine Learning · Computer Science 2012-06-22 Yaoliang Yu , Csaba Szepesvari

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative.…

Statistics Theory · Mathematics 2011-01-06 Bert van Es

In this paper, a very useful lemma (in two versions) is proved: it simplifies notably the essential step to establish a Lindeberg central limit theorem for dependent processes. Then, applying this lemma to weakly dependent processes…

Statistics Theory · Mathematics 2007-06-13 Jean-Marc Bardet , Paul Doukhan , Gabriel Lang , Nicolas Ragache

We propose a kernel-based nonparametric test of relative goodness of fit, where the goal is to compare two models, both of which may have unobserved latent variables, such that the marginal distribution of the observed variables is…

Machine Learning · Statistics 2023-05-10 Heishiro Kanagawa , Wittawat Jitkrittum , Lester Mackey , Kenji Fukumizu , Arthur Gretton

We describe a construction of Stein kernels using moment maps, which are solutions to a variant of the Monge-Amp\`ere equation. As a consequence, we show how regularity bounds on these maps control the rate of convergence in the classical…

Probability · Mathematics 2023-06-08 Max Fathi

We prove a local central limit theorem (LCLT) for the number of points $N(J)$ in a region $J$ in $\mathbb R^d$ specified by a determinantal point process with an Hermitian kernel. The only assumption is that the variance of $N(J)$ tends to…

Mathematical Physics · Physics 2015-06-18 Peter J. Forrester , Joel L. Lebowitz

Consider a `dense' Erd\H{o}s--R\'enyi random graph model $G=G_{n,M}$ with $n$ vertices and $M$ edges, where we assume the edge density $M/\binom{n}{2}$ is bounded away from 0 and 1. Fix $k=k(n)$ with $k/n$ bounded away from 0 and~1, and let…

Combinatorics · Mathematics 2025-04-01 Paul Balister , Emil Powierski , Alex Scott , Jane Tan

This paper provides a unifying view of optimal kernel hypothesis testing across the MMD two-sample, HSIC independence, and KSD goodness-of-fit frameworks. Minimax optimal separation rates in the kernel and $L^2$ metrics are presented, with…

Machine Learning · Statistics 2025-12-30 Antonin Schrab

We establish a functional limit law of the logarithm for the increments of the normed quantile process based upon a random sample of size $n\to\infty$. We extend a limit law obtained by Deheuvels and Mason (12), showing that their results…

Statistics Theory · Mathematics 2009-09-29 Vivian Viallon

We consider a finite sequence of random points in a finite domain of a finite-dimensional Euclidean space. The points are sequentially allocated in the domain according to a model of cooperative sequential adsorption. The main peculiarity…

Probability · Mathematics 2009-11-11 V. Shcherbakov

We adress the problem of consistency of the $k$-nearest neighbors kernel estimators of the density and the regression function in the multivariate case. We get the rates of strong uniform consistency on the whole space $\mathbb{R}^p$ for…

Statistics Theory · Mathematics 2024-08-26 Luran Bengono Mintogo , Emmanuel de Dieu Nkou , Guy Martial Nkiet

Shape restriction, like monotonicity or convexity, imposed on a function of interest, such as a regression or density function, allows for its estimation without smoothness assumptions. The concept of $k$-monotonicity encompasses a family…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

We analyze the $\ell_1$ and $\ell_\infty$ convergence rates of k nearest neighbor density estimation method. Our analysis includes two different cases depending on whether the support set is bounded or not. In the first case, the…

Machine Learning · Statistics 2020-10-02 Puning Zhao , Lifeng Lai

Convergence rate estimates in limit theorems for sums of independent random variables are considered.

History and Overview · Mathematics 2021-10-22 Irina Shevtsova