English
Related papers

Related papers: Kernel Choice Matters for Local Polynomial Density…

200 papers

We estimate the derivative of a probability density function defined on $[0,\infty)$. For this purpose, we choose the class of kernel estimators with asymmetric gamma kernel functions. The use of gamma kernels is fruitful due to the fact…

Statistics Theory · Mathematics 2015-02-10 L. A. Markovich

This paper presents an intuitive application of multivariate kernel density estimation (KDE) for data correction. The method utilizes the expected value of the conditional probability density function (PDF) and a credible interval to…

Applications · Statistics 2025-09-19 Hai Bui , Mostafa Bakhoday-Paskyabi

Kernel density estimation is a well known method involving a smoothing parameter (the bandwidth) that needs to be tuned by the user. Although this method has been widely used the bandwidth selection remains a challenging issue in terms of…

Statistics Theory · Mathematics 2019-02-05 Suzanne Varet , Claire Lacour , Pascal Massart , Vincent Rivoirard

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

This paper introduces a novel kernel density estimator (KDE) based on the generalised exponential (GE) distribution, designed specifically for positive continuous data. The proposed GE KDE offers a mathematically tractable form that avoids…

Methodology · Statistics 2026-02-18 Laura M. Craig , Wagner Barreto-Souza

Quantum computing, with its potential to enhance various machine learning tasks, allows significant advancements in kernel calculation and model precision. Utilizing the one-class Support Vector Machine alongside a quantum kernel, known for…

Estimator selection has become a crucial issue in non parametric estimation. Two widely used methods are penalized empirical risk minimization (such as penalized log-likelihood estimation) or pairwise comparison (such as Lepski's method).…

Statistics Theory · Mathematics 2017-10-19 Claire Lacour , Pascal Massart , Vincent Rivoirard

Kernel ridge regression is used to approximate the kinetic energy of non-interacting fermions in a one-dimensional box as a functional of their density. The properties of different kernels and methods of cross-validation are explored, and…

In this paper, we construct a moment inequality for mixing dependent random variables, it is of independent interest. As applications, the consistency of the kernel density estimation is investigated. Several limit theorems are established:…

Statistics Theory · Mathematics 2013-06-07 Yuexu Zhao , Zhengyan Lin

Kernel mean embeddings -- integrals of a kernel with respect to a probability distribution -- are essential in Bayesian quadrature, but also widely used in other computational tools for numerical integration or for statistical inference…

Machine Learning · Statistics 2025-04-29 François-Xavier Briol , Alexandra Gessner , Toni Karvonen , Maren Mahsereci

This paper introduces an approach for detecting differences in the first-order structures of spatial point patterns. The proposed approach leverages the kernel mean embedding in a novel way by introducing its approximate version tailored to…

Methodology · Statistics 2020-06-15 Raif M. Rustamov , James T. Klosowski

Marginalising over families of Gaussian Process kernels produces flexible model classes with well-calibrated uncertainty estimates. Existing approaches require likelihood evaluations of many kernels, rendering them prohibitively expensive…

Machine Learning · Statistics 2023-03-16 Saad Hamid , Sebastian Schulze , Michael A. Osborne , Stephen J. Roberts

Motivated by the increasing use of kernel-based metrics for high-dimensional and large-scale data, we study the asymptotic behavior of kernel two-sample tests when the dimension and sample sizes both diverge to infinity. We focus on the…

Statistics Theory · Mathematics 2024-10-31 Jian Yan , Xianyang Zhang

This paper presents a new perspective on the identification at infinity for the intercept of the sample selection model as identification at the boundary via a transformation of the selection index. This perspective suggests generalizations…

Econometrics · Economics 2023-02-13 Zhewen Pan

The use of second order boundary kernels for distribution function estimation was recently addressed in the literature (C. Tenreiro, 2013, Boundary kernels for distribution function estimation, REVSTAT-Statistical Journal, 11, 169-190). In…

Statistics Theory · Mathematics 2015-02-05 Carlos Tenreiro

Model inference for dynamical systems aims to estimate the future behaviour of a system from observations. Purely model-free statistical methods, such as Artificial Neural Networks, tend to perform poorly for such tasks. They are therefore…

Machine Learning · Computer Science 2019-08-07 David K. E. Green , Filip Rindler

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

Maintaining or improving the performance of Deep Neural Networks (DNNs) through fine-tuning requires labeling newly collected inputs, a process that is often costly and time-consuming. To alleviate this problem, input selection approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Amin Abbasishahkoo , Mahboubeh Dadkhah , Lionel Briand

Kernelized Stein discrepancy (KSD) is a score-based discrepancy widely used in goodness-of-fit tests. It can be applied even when the target distribution has an unknown normalising factor, such as in Bayesian analysis. We show theoretically…

Machine Learning · Statistics 2023-06-06 Xing Liu , Andrew B. Duncan , Axel Gandy

Estimating the innovation probability density is an important issue in any regression analysis. This paper focuses on functional autoregressive models. A residual-based kernel estimator is proposed for the innovation density. Asymptotic…

Methodology · Statistics 2010-05-07 Nadine Hilgert , Bruno Portier