English

Tight bounds for minimum l1-norm interpolation of noisy data

Statistics Theory 2022-03-09 v2 Information Theory Machine Learning math.IT Machine Learning Statistics Theory

Abstract

We provide matching upper and lower bounds of order σ2/log(d/n)\sigma^2/\log(d/n) for the prediction error of the minimum 1\ell_1-norm interpolator, a.k.a. basis pursuit. Our result is tight up to negligible terms when dnd \gg n, and is the first to imply asymptotic consistency of noisy minimum-norm interpolation for isotropic features and sparse ground truths. Our work complements the literature on "benign overfitting" for minimum 2\ell_2-norm interpolation, where asymptotic consistency can be achieved only when the features are effectively low-dimensional.

Keywords

Cite

@article{arxiv.2111.05987,
  title  = {Tight bounds for minimum l1-norm interpolation of noisy data},
  author = {Guillaume Wang and Konstantin Donhauser and Fanny Yang},
  journal= {arXiv preprint arXiv:2111.05987},
  year   = {2022}
}

Comments

33 pages, 1 figure; accepted to AISTATS 2022