English
Related papers

Related papers: A Simple Adjustment for Bandwidth Snooping

200 papers

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

The performance of kernel density estimators is usually studied via Taylor expansions and asymptotic approximation arguments, in which the bandwidth parameter tends to zero with increasing sample size. In contrast, this paper focusses…

Statistics Theory · Mathematics 2026-02-25 Nils Lid Hjort , Nikolai G. Ushakov

We estimate the derivative of a probability density function defined on $[0,\infty)$. For this purpose, we choose the class of kernel estimators with asymmetric gamma kernel functions. The use of gamma kernels is fruitful due to the fact…

Statistics Theory · Mathematics 2015-02-10 L. A. Markovich

The lack of sufficient flexibility is the key bottleneck of kernel-based learning that relies on manually designed, pre-given, and non-trainable kernels. To enhance kernel flexibility, this paper introduces the concept of…

Machine Learning · Computer Science 2023-10-10 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Recent contributions to kernel smoothing show that the performance of cross-validated bandwidth selectors improve significantly from indirectness. Indirect crossvalidation first estimates the classical cross-validated bandwidth from a more…

We study the kernel estimator of the transition density of bifurcating Markov chains. Under some ergodic and regularity properties, we prove that this estimator is consistent and asymptotically normal. Next, in the numerical studies, we…

Statistics Theory · Mathematics 2023-03-28 S. Valère Bitseki Penda

The bandwidth of a kernel function is a crucial parameter in the mean shift algorithm. This paper proposes a novel adaptive bandwidth strategy which contains three main contributions. (1) The differences among different adaptive bandwidth…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Fanyang Meng , Hong Liu , Yongsheng Liang , Wei Liu , Jihong Pei

Bootstrap smoothed (bagged) estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. Efron, 2014, derived a widely applicable formula for a delta method approximation to the standard…

Methodology · Statistics 2019-07-11 Paul Kabaila , Christeen Wijethunga

For the nonparametric regression models with covariates contaminated with normal measurement errors, this paper proposes an extrapolation algorithm to estimate the nonparametric regression functions. By applying the conditional expectation…

Methodology · Statistics 2021-07-28 Weixing Song , Kanwal Ayub , Jianhong Shi

We study policy evaluation of offline contextual bandits subject to unobserved confounders. Sensitivity analysis methods are commonly used to estimate the policy value under the worst-case confounding over a given uncertainty set. However,…

Machine Learning · Statistics 2023-09-25 Kei Ishikawa , Niao He

We develop a novel procedure for constructing confidence bands for components of a sparse additive model. Our procedure is based on a new kernel-sieve hybrid estimator that combines two most popular nonparametric estimation methods in the…

Machine Learning · Statistics 2018-02-14 Junwei Lu , Mladen Kolar , Han Liu

We determine the expected error by smoothing the data locally. Then we optimize the shape of the kernel smoother to minimize the error. Because the optimal estimator depends on the unknown function, our scheme automatically adjusts to the…

Methodology · Statistics 2019-11-19 Kurt S. Riedel , A. Sidorenko

We study confidence interval construction for linear regression under Huber's contamination model, where an unknown fraction of noise variables is arbitrarily corrupted. While robust point estimation in this setting is well understood,…

Statistics Theory · Mathematics 2026-04-03 Dong Xie , Chao Gao , John Lafferty

This article deals with adaptive nonparametric estimation for L\'evy processes observed at low frequency. For general linear functionals of the L\'evy measure, we construct kernel estimators, provide upper risk bounds and derive rates of…

Statistics Theory · Mathematics 2014-07-15 Johanna Kappus

Standard approaches to constructing nonparametric confidence bands for functions are frustrated by the impact of bias, which generally is not estimated consistently when using the bootstrap and conventionally smoothed function estimators.…

Statistics Theory · Mathematics 2014-01-30 Peter Hall , Joel Horowitz

Local polynomial density (LPD) estimators are widely used for inference on boundary features of the density function. Contrary to conventional wisdom, we show that kernel choice substantially affects efficiency. Theory, simulations, and…

Econometrics · Economics 2026-01-08 Shunsuke Imai , Yuta Okamoto

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

Statistics Theory · Mathematics 2025-11-21 Melanie Birke , Tim Greger

Estimating the kernel mean in a reproducing kernel Hilbert space is a critical component in many kernel learning algorithms. Given a finite sample, the standard estimate of the target kernel mean is the empirical average. Previous works…

Machine Learning · Computer Science 2021-07-13 Xiaobo Xia , Shuo Shan , Mingming Gong , Nannan Wang , Fei Gao , Haikun Wei , Tongliang Liu

Nonparametric density and regression estimators commonly depend on a bandwidth. The asymptotic properties of these estimators have been widely studied when bandwidths are nonstochastic. In practice, however, in order to improve finite…

Statistics Theory · Mathematics 2014-09-02 Carlos Martins-Filho , Paulo Saraiva

A number of applications in engineering, social sciences, physics, and biology involve inference over networks. In this context, graph signals are widely encountered as descriptors of vertex attributes or features in graph-structured data.…

Machine Learning · Statistics 2016-12-21 Daniel Romero , Meng Ma , Georgios B. Giannakis