English
Related papers

Related papers: Simultaneous Selection of Optimal Bandwidths for t…

200 papers

In this paper, we consider a weighted local linear estimator based on the inverse selection probability for nonparametric regression with missing covariates at random. The asymptotic distribution of the maximal deviation between the…

Methodology · Statistics 2020-03-03 Li Cai , Lijie Gu , Qihua Wang , Suojin Wang

High-dimensional data analysis has been an active area, and the main focuses have been variable selection and dimension reduction. In practice, it occurs often that the variables are located on an unknown, lower-dimensional nonlinear…

Statistics Theory · Mathematics 2012-07-31 Ming-Yen Cheng , Hau-tieng Wu

In a regression model, we write the Nadaraya-Watson estimator of the regression function as the quotient of two kernel estimators, and propose a bandwidth selection method for both the numerator and the denominator. We prove risk bounds for…

Statistics Theory · Mathematics 2021-05-10 Fabienne Comte , Nicolas Marie

It is a common practice to evaluate probability density function or matter spatial density function from statistical samples. Kernel density estimation is a frequently used method, but to select an optimal bandwidth of kernel estimation,…

Methodology · Statistics 2021-04-27 Zhen-Wei Li , Ping He

This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model. Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the…

Methodology · Statistics 2020-11-17 Han Lin Shang

In the context of estimating local modes of a conditional density based on kernel density estimators, we show that existing bandwidth selection methods developed for kernel density estimation are unsuitable for mode estimation. We propose…

Computation · Statistics 2017-11-02 Haiming Zhou , Xianzheng Huang

In this paper we propose a variable bandwidth kernel regression estimator for $i.i.d.$ observations in $\mathbb{R}^2$ to improve the classical Nadaraya-Watson estimator. The bias is improved to the order of $O(h_n^4)$ under the condition…

Statistics Theory · Mathematics 2021-01-14 Janet Nakarmi , Hailin Sang , Lin Ge

Kernel estimation techniques, such as mean shift, suffer from one major drawback: the kernel bandwidth selection. The bandwidth can be fixed for all the data set or can vary at each points. Automatic bandwidth selection becomes a real…

Computer Vision and Pattern Recognition · Computer Science 2011-11-10 Aurelie Bugeau , Patrick Pérez

We develop a finite-sample optimal estimator for regression discontinuity design when the outcomes are bounded, including binary outcomes as the leading case. Our estimator achieves minimax mean squared error among linear shrinkage…

Econometrics · Economics 2025-12-29 Takuya Ishihara , Masayuki Sawada , Kohei Yata

Adaptive bandwidth selection is a fundamental challenge in nonparametric regression. This paper introduces a new bandwidth selection procedure inspired by the optimality criteria for $\ell_0$-penalized regression. Although similar in spirit…

Machine Learning · Statistics 2025-05-21 Sabyasachi Chatterjee , Subhajit Goswami , Soumendu Sundar Mukherjee

The density weighted average derivative (DWAD) of a regression function is a canonical parameter of interest in economics. Classical first-order large sample distribution theory for kernel-based DWAD estimators relies on tuning parameter…

Econometrics · Economics 2024-02-16 Matias D. Cattaneo , Max H. Farrell , Michael Jansson , Ricardo Masini

This paper studies higher-order inference properties of nonparametric local polynomial regression methods under random sampling. We prove Edgeworth expansions for $t$ statistics and coverage error expansions for interval estimators that (i)…

Econometrics · Economics 2021-07-26 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

Regression discontinuity (RD) designs are a popular approach to estimating a treatment effect of cutoff-based interventions. Two current estimation approaches dominate the literature. One fits separate regressions on either side of the…

Methodology · Statistics 2025-03-10 Daryl Swartzentruber , Eloise Kaizar

We provide a way to infer about existence of topological circularity in high-dimensional data sets in $\mathbb{R}^d$ from its projection in $\mathbb{R}^2$ obtained through a fast manifold learning map as a function of the high-dimensional…

Machine Learning · Statistics 2016-12-30 Susovan Pal , Praneeth Vepakomma

This paper proposes a new method of bandwidth selection in kernel estimation of density and distribution functions motivated by the connection between maximisation of the entropy of probability integral transforms and maximum likelihood in…

Methodology · Statistics 2016-07-14 Vitaliy Oryshchenko

Estimators of information theoretic measures such as entropy and mutual information are a basic workhorse for many downstream applications in modern data science. State of the art approaches have been either geometric (nearest neighbor (NN)…

Information Theory · Computer Science 2016-09-09 Weihao Gao , Sewoong Oh , Pramod Viswanath

This paper studies nonparametric regression with long memory (LRD) errors and predictors. First, we formulate general conditions which guarantee the standard rate of convergence for a nonparametric kernel estimator. Second, we calculate the…

Statistics Theory · Mathematics 2011-02-25 Rafal Kulik , Pawel Lorek

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

The Beta kernel estimator offers a theoretically superior alternative to the Gaussian kernel for unit interval data, eliminating boundary bias without requiring reflection or transformation. However, its adoption remains limited by the lack…

Methodology · Statistics 2026-05-12 Johan Hallberg Szabadváry

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti