English
Related papers

Related papers: A Fast, Closed-Form Bandwidth Selector for the Bet…

200 papers

For the purpose of maximum likelihood estimation of static parameters, we apply a kernel smoother to the particles in the standard SIR filter for non-linear state space models with additive Gaussian observation noise. This reduces the Monte…

Computation · Statistics 2015-05-07 Tore Selland Kleppe , Hans Julius Skaug

A modified gamma kernel should not be automatically preferred to the standard gamma kernel, especially for univariate convex densities with a pole at the origin. In the multivariate case, multiple combined gamma kernels, defined as a…

Statistics Theory · Mathematics 2024-04-12 Sobom M. Somé , Célestin C. Kokonendji , Smail Adjabi , Naushad A. Mamode Khan , Said Beddek

An exact, closed form, and easy to compute expression for the mean integrated squared error (MISE) of a kernel estimator of a normal mixture cumulative distribution function is derived for the class of arbitrary order Gaussian-based…

Methodology · Statistics 2020-03-04 Vitaliy Oryshchenko

Estimators of information theoretic measures such as entropy and mutual information are a basic workhorse for many downstream applications in modern data science. State of the art approaches have been either geometric (nearest neighbor (NN)…

Information Theory · Computer Science 2016-09-09 Weihao Gao , Sewoong Oh , Pramod Viswanath

A new plug-in rule procedure for bandwidth selection in kernel circular density estimation is introduced. The performance of this proposal is checked throughout a simulation study considering a variety of circular distributions exhibiting…

Methodology · Statistics 2012-02-29 M. Oliveira , R. M. Crujeiras , A. Rodríguez-Casal

In this paper we propose an automatic selection of the bandwidth of the semi-recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and some…

Statistics Theory · Mathematics 2016-07-05 Yousri Slaoui

Most machine learning methods require tuning of hyper-parameters. For kernel ridge regression with the Gaussian kernel, the hyper-parameter is the bandwidth. The bandwidth specifies the length scale of the kernel and has to be carefully…

Machine Learning · Statistics 2023-12-04 Oskar Allerbo , Rebecka Jörnsten

Support vector data description (SVDD) is a popular technique for detecting anomalies. The SVDD classifier partitions the whole space into an inlier region, which consists of the region near the training data, and an outlier region, which…

Machine Learning · Computer Science 2018-07-23 Arin Chaudhuri , Deovrat Kakde , Carol Sadek , Laura Gonzalez , Seunghyun Kong

We define a new bandwidth-dependent kernel density estimator that improves existing convergence rates for the bias, and preserves that of the variation, when the error is measured in $L_1$. No additional assumptions are imposed to the…

Statistics Theory · Mathematics 2016-12-28 Kairat Mynbaev , Carlos Martins-Filho

We extend balloon and sample-smoothing estimators, two types of variable-bandwidth kernel density estimators, by a shift parameter and derive their asymptotic properties. Our approach facilitates the unified study of a wide range of density…

Methodology · Statistics 2015-12-11 Till Hoffmann , Nick S. Jones

Kernel estimation of a probability density function supported on the unit interval has proved difficult, because of the well known boundary bias issues a conventional kernel density estimator would necessarily face in this situation.…

Methodology · Statistics 2013-03-19 Gery Geenens

It is a common practice to evaluate probability density function or matter spatial density function from statistical samples. Kernel density estimation is a frequently used method, but to select an optimal bandwidth of kernel estimation,…

Methodology · Statistics 2021-04-27 Zhen-Wei Li , Ping He

Semiparametric Bayesian networks (SPBNs) integrate parametric and non-parametric probabilistic models, offering flexibility in learning complex data distributions from samples. In particular, kernel density estimators (KDEs) are employed…

Machine Learning · Computer Science 2025-06-23 Victor Alejandre , Concha Bielza , Pedro Larrañaga

This study proposes multivariate kernel density estimation by stagewise minimization algorithm based on $U$-divergence and a simple dictionary. The dictionary consists of an appropriate scalar bandwidth matrix and a part of the original…

Machine Learning · Statistics 2021-08-11 Kiheiji Nishida , Kanta Naito

Variable kernel density estimation allows the approximation of a probability density by the mean of differently stretched and rotated kernels centered at given sampling points $y_n\in\mathbb{R}^d,\ n=1,\dots,N$. Up to now, the choice of the…

Statistics Theory · Mathematics 2018-05-07 Ilja Klebanov

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

Kernel-based nonparametric hazard rate estimation is considered with a special class of infinite-order kernels that achieves favorable bias and mean square error properties. A fully automatic and adaptive implementation of a density and…

Statistics Theory · Mathematics 2018-10-17 Arthur Berg , Dimitris N Politis , Kagba Suaray , Hui Zeng

The article derives a novel Gram-Charlier A (GCA) Series based Extended Rule-of-Thumb (ExROT) for bandwidth selection in Kernel Density Estimation (KDE). There are existing various bandwidth selection rules achieving minimization of the…

Machine Learning · Computer Science 2015-04-06 Dharmani Bhaveshkumar C

In this paper we propose a new method of joint nonparametric estimation of probability density and its support. As is well known, nonparametric kernel density estimator has "boundary bias problem" when the support of the population density…

Statistics Theory · Mathematics 2024-07-19 Taku Moriyama

Estimating expected polynomials of density functions from samples is a basic problem with numerous applications in statistics and information theory. Although kernel density estimators are widely used in practice for such functional…

Information Theory · Computer Science 2017-02-13 Weihao Gao , Sewoong Oh , Pramod Viswanath