English
Related papers

Related papers: A note on kernel density estimation at a parametri…

200 papers

We show that geometric inference of a point cloud can be calculated by examining its kernel density estimate with a Gaussian kernel. This allows one to consider kernel density estimates, which are robust to spatial noise, subsampling, and…

Computational Geometry · Computer Science 2015-03-27 Jeff M. Phillips , Bei Wang , Yan Zheng

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

This paper presents minimax rates for density estimation when the data dimension $d$ is allowed to grow with the number of observations $n$ rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which…

Statistics Theory · Mathematics 2017-08-16 Daniel J. McDonald

Asymptotic properties of three estimators of probability density function of sample maximum $f_{(m)}:=mfF^{m-1}$ are derived, where $m$ is a function of sample size $n$. One of the estimators is the parametrically fitted by the…

Statistics Theory · Mathematics 2022-06-13 Taku Moriyama

Generalization beyond a training dataset is a main goal of machine learning, but theoretical understanding of generalization remains an open problem for many models. The need for a new theory is exacerbated by recent observations in deep…

Machine Learning · Statistics 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan

We study nonparametric estimation of density functions for undirected dyadic random variables (i.e., random variables defined for all n\overset{def}{\equiv}\tbinom{N}{2} unordered pairs of agents/nodes in a weighted network of order N).…

Statistics Theory · Mathematics 2019-08-01 Bryan S. Graham , Fengshi Niu , James L. Powell

The problem of estimating the regression function in a fixed design models with correlated observations is considered. Such observations are obtained from several experimental units, each of them forms a time series. Based on the…

Statistics Theory · Mathematics 2019-06-13 D. Benelmadani , K. Benhenni , S. Louhichi

We investigate the issue of bandwidth estimation in a nonparametric functional regression model with function-valued, continuous real-valued and discrete-valued regressors under the framework of unknown error density. Extending from the…

Methodology · Statistics 2016-06-20 Han Lin Shang

Kernel estimation of a probability density function supported on the unit interval has proved difficult, because of the well known boundary bias issues a conventional kernel density estimator would necessarily face in this situation.…

Methodology · Statistics 2013-03-19 Gery Geenens

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard

We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used…

Methodology · Statistics 2020-09-15 Andrea De Simone , Alessandro Morandini

Kernel density estimation is a well known method involving a smoothing parameter (the bandwidth) that needs to be tuned by the user. Although this method has been widely used the bandwidth selection remains a challenging issue in terms of…

Statistics Theory · Mathematics 2019-02-05 Suzanne Varet , Claire Lacour , Pascal Massart , Vincent Rivoirard

Quantum kernel methods are considered a promising avenue for applying quantum computers to machine learning problems. Identifying hyperparameters controlling the inductive bias of quantum machine learning models is expected to be crucial…

Quantum Physics · Physics 2022-10-18 Ruslan Shaydulin , Stefan M. Wild

A mean function in a reproducing kernel Hilbert space (RKHS), or a kernel mean, is central to kernel methods in that it is used by many classical algorithms such as kernel principal component analysis, and it also forms the core inference…

Machine Learning · Statistics 2016-02-26 Krikamol Muandet , Bharath Sriperumbudur , Kenji Fukumizu , Arthur Gretton , Bernhard Schölkopf

Kernel density estimators with circular data have been studied extensively for decades, as they allow flexible estimations even when the shape of the underlying density is complex. Many recent studies have examined bias correction methods;…

Methodology · Statistics 2026-03-03 Yasuhito Tsuruta

We propose a new estimator for nonparametric binary choice models that does not impose a parametric structure on either the systematic function of covariates or the distribution of the error term. A key advantage of our approach is its…

Econometrics · Economics 2026-01-13 Guo Yan

The kernel-based method has been successfully applied in linear system identification using stable kernel designs. From a Gaussian process perspective, it automatically provides probabilistic error bounds for the identified models from the…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Roy S. Smith

Let $ (T_i)_i$ be a sequence of independent identically distributed (i.i.d.) random variables (r.v.) of interest distributed as $ T$ and $(X_i)_i$ be a corresponding vector of covariates taking values on $ \mathbb{R}^d$. In censorship…

Statistics Theory · Mathematics 2019-01-29 Bouhadjera Feriel , Ould Saïd , Mohamed Remita

In this paper, we introduce a robust nonparametric density estimator combining the popular Kernel Density Estimation method and the Median-of-Means principle (MoM-KDE). This estimator is shown to achieve robustness to any kind of anomalous…

Statistics Theory · Mathematics 2020-07-01 Pierre Humbert , Batiste Le Bars , Ludovic Minvielle , Nicolas Vayatis

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu