English
Related papers

Related papers: Bandwidth choice for nonparametric classification

200 papers

We show that the cumulative distribution function corresponding to a kernel density estimator with optimal bandwidth lies outside any confidence interval, around the empirical distribution function, with probability tending to 1 as the…

Statistics Theory · Mathematics 2026-04-17 Nils Lid Hjort , Stephen G. Walker

Kernel-based modal statistical methods include mode estimation, regression, and clustering. Estimation accuracy of these methods depends on the kernel used as well as the bandwidth. We study effect of the selection of the kernel function to…

Machine Learning · Statistics 2023-04-21 Ryoya Yamasaki , Toshiyuki Tanaka

We are interested in the nonparametric estimation of the probability density of price returns, using the kernel approach. The output of the method heavily relies on the selection of a bandwidth parameter. Many selection methods have been…

Statistical Finance · Quantitative Finance 2023-05-23 Matthieu Garcin

This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model. Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the…

Methodology · Statistics 2020-11-17 Han Lin Shang

This paper presents an intuitive application of multivariate kernel density estimation (KDE) for data correction. The method utilizes the expected value of the conditional probability density function (PDF) and a credible interval to…

Applications · Statistics 2025-09-19 Hai Bui , Mostafa Bakhoday-Paskyabi

We investigate the issue of bandwidth estimation in a nonparametric functional regression model with function-valued, continuous real-valued and discrete-valued regressors under the framework of unknown error density. Extending from the…

Methodology · Statistics 2016-06-20 Han Lin Shang

Semiparametric Bayesian networks (SPBNs) integrate parametric and non-parametric probabilistic models, offering flexibility in learning complex data distributions from samples. In particular, kernel density estimators (KDEs) are employed…

Machine Learning · Computer Science 2025-06-23 Victor Alejandre , Concha Bielza , Pedro Larrañaga

We study kernel estimation of highest-density regions (HDR). Our main contributions are two-fold. First, we derive a uniform-in-bandwidth asymptotic approximation to a risk that is appropriate for HDR estimation. This approximation is then…

Statistics Theory · Mathematics 2010-10-05 R. J. Samworth , M. P. Wand

Most machine learning methods require tuning of hyper-parameters. For kernel ridge regression with the Gaussian kernel, the hyper-parameter is the bandwidth. The bandwidth specifies the length scale of the kernel and has to be carefully…

Machine Learning · Statistics 2023-12-04 Oskar Allerbo , Rebecka Jörnsten

A modified gamma kernel should not be automatically preferred to the standard gamma kernel, especially for univariate convex densities with a pole at the origin. In the multivariate case, multiple combined gamma kernels, defined as a…

Statistics Theory · Mathematics 2024-04-12 Sobom M. Somé , Célestin C. Kokonendji , Smail Adjabi , Naushad A. Mamode Khan , Said Beddek

Cross-validation is a well-known and widely used bandwidth selection method in nonparametric regression estimation. However, this technique has two remarkable drawbacks: (i) the large variability of the selected bandwidths, and (ii) the…

Methodology · Statistics 2021-05-11 D. Barreiro-Ures , R. Cao , M. Francisco-Fernández

Multivariate kernel density estimations have received much spate of interest. In addition to conventional methods of (non-)classical associated-kernels for (un)bounded densities and bandwidth selections, the multiple extended-beta kernel…

Statistics Theory · Mathematics 2025-02-11 Sobom M. Somé , Célestin C. Kokonendji , Francial G. B. Libengué Dobélé-Kpoka

We study the kernel estimator of the transition density of bifurcating Markov chains. Under some ergodic and regularity properties, we prove that this estimator is consistent and asymptotically normal. Next, in the numerical studies, we…

Statistics Theory · Mathematics 2023-03-28 S. Valère Bitseki Penda

We focus on the nonparametric density estimation problem with directional data. We propose a new rule for bandwidth selection for kernel density estimation. Our procedure is automatic, fully data-driven and adaptive to the smoothness degree…

Statistics Theory · Mathematics 2018-08-08 Thanh Mai Pham Ngoc

Estimating expected polynomials of density functions from samples is a basic problem with numerous applications in statistics and information theory. Although kernel density estimators are widely used in practice for such functional…

Information Theory · Computer Science 2017-02-13 Weihao Gao , Sewoong Oh , Pramod Viswanath

We estimate on a compact interval densities with isolated irregularities, such as discontinuities or discontinuities in some derivatives. From independent and identically distributed observations we construct a kernel estimator with…

Statistics Theory · Mathematics 2024-07-16 Céline Duval , Émeline Schmisser

Kernel Estimation is one of the most widely used estimation methods in non-parametric Statistics, having a wide-range of applications, including spot volatility estimation of stochastic processes. The selection of bandwidth and kernel…

Statistics Theory · Mathematics 2016-12-15 José E. Figueroa-López , Cheng Li

We consider a nonparametric regression setup, where the covariate is a random element in a complete separable metric space, and the parameter of interest associated with the conditional distribution of the response lies in a separable…

Statistics Theory · Mathematics 2018-11-16 Joydeep Chowdhury , Probal Chaudhuri

Spike trains data find a growing list of applications in computational neuroscience, imaging, streaming data and finance. Machine learning strategies for spike trains are based on various neural network and probabilistic models. The…

Information Theory · Computer Science 2023-08-10 Mirosław Pawlak , Mateusz Pabian , Dominik Rzepka

When nonlinear measures are estimated from sampled temporal signals with finite-length, a radius parameter must be carefully selected to avoid a poor estimation. These measures are generally derived from the correlation integral which…

Methodology · Statistics 2024-01-09 Johan Medrano , Abderrahmane Kheddar , Annick Lesne , Sofiane Ramdani