Tight bounds for minimum l1-norm interpolation of noisy data
Statistics Theory
2022-03-09 v2 Information Theory
Machine Learning
math.IT
Machine Learning
Statistics Theory
Abstract
We provide matching upper and lower bounds of order for the prediction error of the minimum -norm interpolator, a.k.a. basis pursuit. Our result is tight up to negligible terms when , and is the first to imply asymptotic consistency of noisy minimum-norm interpolation for isotropic features and sparse ground truths. Our work complements the literature on "benign overfitting" for minimum -norm interpolation, where asymptotic consistency can be achieved only when the features are effectively low-dimensional.
Cite
@article{arxiv.2111.05987,
title = {Tight bounds for minimum l1-norm interpolation of noisy data},
author = {Guillaume Wang and Konstantin Donhauser and Fanny Yang},
journal= {arXiv preprint arXiv:2111.05987},
year = {2022}
}
Comments
33 pages, 1 figure; accepted to AISTATS 2022