English

Kernel Ridge Regression Inference

Statistics Theory 2025-08-19 v3 Machine Learning Machine Learning Statistics Theory

Abstract

We provide uniform confidence bands for kernel ridge regression (KRR), a widely used nonparametric regression estimator for nonstandard data such as preferences, sequences, and graphs. Despite the prevalence of these data--e.g., student preferences in school matching mechanisms--the inferential theory of KRR is not fully known. We construct valid and sharp confidence sets that shrink at nearly the minimax rate, allowing nonstandard regressors. Our bootstrap procedure uses anti-symmetric multipliers for computational efficiency and for validity under mis-specification. We use the procedure to develop a test for match effects, i.e. whether students benefit more from the schools they rank highly.

Keywords

Cite

@article{arxiv.2302.06578,
  title  = {Kernel Ridge Regression Inference},
  author = {Rahul Singh and Suhas Vijaykumar},
  journal= {arXiv preprint arXiv:2302.06578},
  year   = {2025}
}