English
Related papers

Related papers: Variable bandwidth kernel regression estimation

200 papers

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised…

Machine Learning · Computer Science 2016-07-15 Ferenc Huszar , David Duvenaud

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised…

Machine Learning · Statistics 2016-07-18 Ferenc Huszár , David Duvenaud

We first revisit the problem of estimating the spot volatility of an It\^o semimartingale using a kernel estimator. We prove a Central Limit Theorem with optimal convergence rate for a general two-sided kernel. Next, we introduce a new…

Econometrics · Economics 2022-02-08 José E. Figueroa-López , Bei Wu

We study kernel-based estimation of nonparametric time-varying parameters (TVPs) in linear models. Our contributions are threefold. First, we establish consistency and asymptotic normality of the kernel-based estimator for a broad class of…

Econometrics · Economics 2026-01-26 Mikihito Nishi

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

We propose a method for variable selection in multiple regression with random predictors. This method is based on a criterion that permits to reduce the variable selection problem to a problem of estimating suitable permutation and…

Statistics Theory · Mathematics 2015-06-29 Alban Mbina Mbina , Guy Martial Nkiet , Assi Nguessan

Let $\{(X_i,Y_i)\}_{i\in \{1,..., n\}}$ be an i.i.d. sample from the random design regression model $Y=f(X)+\epsilon$ with $(X,Y)\in [0,1]\times [-M,M]$. In dealing with such a model, adaptation is naturally to be intended in terms of…

Statistics Theory · Mathematics 2008-01-23 Pierpaolo Brutti

We propose a method for incorporating variable selection into local polynomial regression. This can improve the accuracy of the regression by extending the bandwidth in directions corresponding to those variables judged to be are…

Statistics Theory · Mathematics 2010-06-18 Hugh Miller , Peter Hall

An evolution of Wireless Communications towards 5G and beyond provides improved user experience in terms of quality of services. Understanding and estimating Channel information plays crucial role in providing better user experience.…

Signal Processing · Electrical Eng. & Systems 2026-05-05 A. Sathi Babu , V. Udaya Sankar , Vishnu Ram OV

We consider the problem of bandwidth selection by cross-validation from a sequential point of view in a nonparametric regression model. Having in mind that in applications one often aims at estimation, prediction and change detection…

Statistics Theory · Mathematics 2018-03-20 Ansgar Steland

The bandwidth of a kernel function is a crucial parameter in the mean shift algorithm. This paper proposes a novel adaptive bandwidth strategy which contains three main contributions. (1) The differences among different adaptive bandwidth…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Fanyang Meng , Hong Liu , Yongsheng Liang , Wei Liu , Jihong Pei

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

Quantum kernel methods are a promising branch of quantum machine learning, yet their effectiveness on diverse, high-dimensional, real-world data remains unverified. Current research has largely been limited to low-dimensional or synthetic…

Machine Learning · Computer Science 2026-02-19 Jiang Yuhan , Matthew Otten

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

Modern empirical work in Regression Discontinuity (RD) designs often employs local polynomial estimation and inference with a mean square error (MSE) optimal bandwidth choice. This bandwidth yields an MSE-optimal RD treatment effect…

Econometrics · Economics 2020-07-21 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

A hybrid estimator of the log-spectral density of a stationary time series is proposed. First, a multiple taper estimate is performed, followed by kernel smoothing the log-multitaper estimate. This procedure reduces the expected mean square…

Methodology · Statistics 2020-02-18 Alexander Sidorenko , Kurt S. Riedel

This paper studies higher-order inference properties of nonparametric local polynomial regression methods under random sampling. We prove Edgeworth expansions for $t$ statistics and coverage error expansions for interval estimators that (i)…

Econometrics · Economics 2021-07-26 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

Three common classes of kernel regression estimators are considered: the Nadaraya--Watson (NW) estimator, the Priestley--Chao (PC) estimator, and the Gasser--M\"uller (GM) estimator. It is shown that (i) the GM estimator has a certain…

Statistics Theory · Mathematics 2021-05-13 Iosif Pinelis

This paper proposes a new method for estimating high-dimensional binary choice models. We consider a semiparametric model that places no distributional assumptions on the error term, allows for heteroskedastic errors, and permits endogenous…

Econometrics · Economics 2025-07-15 Fu Ouyang , Thomas Tao Yang

A new method of bandwidth selection for kernel density estimators is proposed. The method, termed indirect cross-validation, or ICV, makes use of so-called selection kernels. Least squares cross-validation (LSCV) is used to select the…

Methodology · Statistics 2008-12-02 Olga Y. Savchuk , Jeffrey D. Hart , Simon J. Sheather