English

Generic chaining and the l1-penalty

Statistics Theory 2012-05-17 v1 Statistics Theory

Abstract

We address the choice of the tuning parameter λ\lambda in 1\ell_1-penalized M-estimation. Our main concern is models which are highly nonlinear, such as the Gaussian mixture model. The number of parameters pp is moreover large, possibly larger than the number of observations nn. The generic chaining technique of Talagrand[2005] is tailored for this problem. It leads to the choice λlogp/n\lambda \asymp \sqrt {\log p / n}, as in the standard Lasso procedure (which concerns the linear model and least squares loss).

Keywords

Cite

@article{arxiv.1205.3703,
  title  = {Generic chaining and the l1-penalty},
  author = {Sara van de Geer},
  journal= {arXiv preprint arXiv:1205.3703},
  year   = {2012}
}

Comments

19 pages

R2 v1 2026-06-21T21:05:07.111Z