English
Related papers

Related papers: Bandwidth choice for nonparametric classification

200 papers

Comparing Bayesian neural networks (BNNs) with different widths is challenging because, as the width increases, multiple model properties change simultaneously, and, inference in the finite-width case is intractable. In this work, we…

Machine Learning · Statistics 2022-11-29 Jiayu Yao , Yaniv Yacoby , Beau Coker , Weiwei Pan , Finale Doshi-Velez

In this paper we propose an automatic selection of the bandwidth of the semi-recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and some…

Statistics Theory · Mathematics 2016-07-05 Yousri Slaoui

This paper deals with the nonparametric density estimation of the regression error term assuming its independence with the covariate. The difference between the feasible estimator which uses the estimated residuals and the unfeasible one…

Statistics Theory · Mathematics 2010-10-05 Rawane Samb

How many links can be cut before a network is bisected? What is the maximal bandwidth that can be pushed between two nodes of a network? These questions are closely related to network resilience, path choice for multipath routing or…

Networking and Internet Architecture · Computer Science 2016-11-10 Rowan Kloti , Vasileios Kotronis , Bernhard Ager , Xenofontas Dimitropoulos

This paper presents minimax rates for density estimation when the data dimension $d$ is allowed to grow with the number of observations $n$ rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which…

Statistics Theory · Mathematics 2017-08-16 Daniel J. McDonald

We consider estimating the density of a response conditioning on an error-prone covariate. Motivated by two existing kernel density estimators in the absence of covariate measurement error, we propose a method to correct the existing…

Methodology · Statistics 2020-01-09 Xianzheng Huang , Haiming Zhou

With the heterogeneous nature of tissue texture, using a single resolution approach for optimum classification might not suffice. In contrast, a multiresolution wavelet packet analysis can decompose the input signal into a set of frequency…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Omar S. Al-Kadi

We provide a way to infer about existence of topological circularity in high-dimensional data sets in $\mathbb{R}^d$ from its projection in $\mathbb{R}^2$ obtained through a fast manifold learning map as a function of the high-dimensional…

Machine Learning · Statistics 2016-12-30 Susovan Pal , Praneeth Vepakomma

The traditional kernel density estimator of an unknown density is by construction completely nonparametric, in the sense that it has no preferences and will work reasonably well for all shapes. The present paper develops a class of…

Methodology · Statistics 2026-05-05 Nils Lid Hjort , Ingrid Kristine Glad

In this paper, we study classification and regression error bounds for inhomogenous data that are independent but not necessarily identically distributed. First, we consider classification of data in the presence of non-stationary noise and…

Information Theory · Computer Science 2024-04-04 Ghurumuruhan Ganesan

In kernel methods, the median heuristic has been widely used as a way of setting the bandwidth of RBF kernels. While its empirical performances make it a safe choice under many circumstances, there is little theoretical understanding of why…

Statistics Theory · Mathematics 2018-10-31 Damien Garreau , Wittawat Jitkrittum , Motonobu Kanagawa

Previous influential work showed that infinite width limits of neural networks in the lazy training regime are described by kernel machines. Here, we show that neural networks trained in the rich, feature learning infinite-width regime in…

Machine Learning · Computer Science 2025-09-12 Clarissa Lauditi , Blake Bordelon , Cengiz Pehlevan

Low-bit width neural networks have been extensively explored for deployment on edge devices to reduce computational resources. Existing approaches have focused on gradient-based optimization in a two-stage train-and-compress setting or as a…

Machine Learning · Computer Science 2022-06-07 Han Zhou , Aida Ashrafi , Matthew B. Blaschko

Anomaly detection based on one-class classification algorithms is broadly used in many applied domains like image processing (e.g. detection of whether a patient is "cancerous" or "healthy" from mammography image), network intrusion…

Machine Learning · Statistics 2017-07-14 Evgeny Burnaev , Pavel Erofeev , Dmitry Smolyakov

It is shown that bandwidth estimation in packet networks can be viewed in terms of min-plus linear system theory. The available bandwidth of a link or complete path is expressed in terms of a {\em service curve}, which is a function that…

Networking and Internet Architecture · Computer Science 2008-01-04 Jorg Liebeherr , Markus Fidler , Shahrokh Valaee

Spatial autocorrelation in regression models can lead to downward biased standard errors and thus incorrect inference. The most common correction in applied economics is the spatial heteroskedasticity and autocorrelation consistent (HAC)…

Econometrics · Economics 2026-03-05 Alexander Lehner

In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is…

Methodology · Statistics 2025-04-29 Sisheng Liu , Xiaoli Kong

In this paper, we deal with nonparametric regression for circular data, meaning that observations are represented by points lying on the unit circle. We propose a kernel estimation procedure with data-driven selection of the bandwidth…

Statistics Theory · Mathematics 2023-07-03 Tien Dat Nguyen , Thanh Mai Pham Ngoc , Vincent Rivoirard

Hyperspectral imagery is composed of huge amount of data which creates significant transmission latencies for communication systems. It is vital to decrease the huge data size before transmitting the Hyperspectral imagery. Besides, large…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Onur Haliloğlu , Ufuk Sakarya , B. Uğur Töreyin , Orhan Gazi

Motivated by the latest effort to employ banded matrices to estimate a high-dimensional covariance $\Sigma$, we propose a test for $\Sigma$ being banded with possible diverging bandwidth. The test is adaptive to the "large $p$, small $n$"…

Statistics Theory · Mathematics 2012-08-17 Yumou Qiu , Song Xi Chen