English
Related papers

Related papers: Bagging cross-validated bandwidths with applicatio…

200 papers

Analytical join queries over unstructured data are increasingly prevalent in data analytics. Applying machine learning (ML) models to label every pair in the cross product of tables can achieve state-of-the-art accuracy, but the cost of…

Databases · Computer Science 2026-03-18 Yuxuan Zhu , Tengjun Jin , Chenghao Mo , Daniel Kang

In kernel methods, the median heuristic has been widely used as a way of setting the bandwidth of RBF kernels. While its empirical performances make it a safe choice under many circumstances, there is little theoretical understanding of why…

Statistics Theory · Mathematics 2018-10-31 Damien Garreau , Wittawat Jitkrittum , Motonobu Kanagawa

A new bandwidth selection rule that uses different bandwidths for the local linear regression estimators on the left and the right of the cut-off point is proposed for the sharp regression discontinuity estimator of the mean program impact…

Methodology · Statistics 2015-08-10 Yoichi Arai , Hidehiko Ichimura

We develop a stochastic foundation for bandwidth estimation of networks with random service, where bandwidth availability is expressed in terms of bounding functions with a defined violation probability. Exploiting properties of a…

Networking and Internet Architecture · Computer Science 2010-08-03 Ralf Lübben , Markus Fidler , Jörg Liebeherr

We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used…

We set up a formal framework to characterize encompassing of nonparametric models through the L2 distance. We contrast it to previous literature on the comparison of nonparametric regression models. We then develop testing procedures for…

Econometrics · Economics 2025-05-07 Elia Lapenta , Pascal Lavergne

We explore the performance of several automatic bandwidth selectors, originally designed for density gradient estimation, as data-based procedures for nonparametric, modal clustering. The key tool to obtain a clustering from density…

Machine Learning · Statistics 2013-10-30 José E. Chacón , Pablo Monfort

Cross-validation is a popular non-parametric method for evaluating the accuracy of a predictive rule. The usefulness of cross-validation depends on the task we want to employ it for. In this note, I discuss a simple non-parametric setting,…

Methodology · Statistics 2019-09-27 Stefan Wager

The smooth backfitting introduced by Mammen, Linton and Nielsen [Ann. Statist. 27 (1999) 1443-1490] is a promising technique to fit additive regression models and is known to achieve the oracle efficiency bound. In this paper, we propose…

Statistics Theory · Mathematics 2007-06-13 Enno Mammen , Byeong U. Park

It is shown that the Hall, Hu and Marron [Hall, P., Hu, T., and Marron J.S. (1995), Improved Variable Window Kernel Estimates of Probability Densities, {\it Annals of Statistics}, 23, 1--10] modification of Abramson's [Abramson, I. (1982),…

Statistics Theory · Mathematics 2016-08-14 Evarist Giné , Hailin Sang

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and…

Machine Learning · Statistics 2023-09-07 Hugo Cui , Florent Krzakala , Lenka Zdeborová

Bayesian neural networks (BNNs) promise improved generalization under covariate shift by providing principled probabilistic representations of epistemic uncertainty. However, weight-based BNNs often struggle with high computational…

Machine Learning · Statistics 2022-06-13 Trung Trinh , Markus Heinonen , Luigi Acerbi , Samuel Kaski

Kernel-based nonparametric hazard rate estimation is considered with a special class of infinite-order kernels that achieves favorable bias and mean square error properties. A fully automatic and adaptive implementation of a density and…

Statistics Theory · Mathematics 2018-10-17 Arthur Berg , Dimitris N Politis , Kagba Suaray , Hui Zeng

Kernel estimation techniques, such as mean shift, suffer from one major drawback: the kernel bandwidth selection. The bandwidth can be fixed for all the data set or can vary at each points. Automatic bandwidth selection becomes a real…

Computer Vision and Pattern Recognition · Computer Science 2011-11-10 Aurelie Bugeau , Patrick Pérez

In this paper we provide insight into the empirical properties of indirect cross-validation (ICV), a new method of bandwidth selection for kernel density estimators. First, we describe the method and report on the theoretical results used…

Methodology · Statistics 2008-12-02 Olga Y. Savchuk , Jeffrey D. Hart , Simon J. Sheather

A new plug-in rule procedure for bandwidth selection in kernel circular density estimation is introduced. The performance of this proposal is checked throughout a simulation study considering a variety of circular distributions exhibiting…

Methodology · Statistics 2012-02-29 M. Oliveira , R. M. Crujeiras , A. Rodríguez-Casal

With the increasing size of today's data sets, finding the right parameter configuration in model selection via cross-validation can be an extremely time-consuming task. In this paper we propose an improved cross-validation procedure which…

Machine Learning · Computer Science 2016-02-05 Tammo Krueger , Danny Panknin , Mikio Braun

An important challenge with the current generation of noisy, large-scale quantum computers is the question of validation. Does the hardware generate correct answers? If not, what are the errors? This issue is often combined with questions…

Quantum Physics · Physics 2025-07-11 Alexander S. Dellios , Margaret D. Reid , Peter D. Drummond

Binary neural networks (BNNs) have demonstrated their ability to solve complex tasks with comparable accuracy as full-precision deep neural networks (DNNs), while also reducing computational power and storage requirements and increasing the…

Machine Learning · Computer Science 2022-07-12 Riccardo Schiavone , Maria A. Zuluaga

In this paper, we present a new approach for the analysis of iterative node-based verification-based (NB-VB) recovery algorithms in the context of compressive sensing. These algorithms are particularly interesting due to their low…

Information Theory · Computer Science 2011-06-02 Yaser Eftekhari , Anoosheh Heidarzadeh , Amir H. Banihashemi , Ioannis Lambadaris