English

An error bound for Lasso and Group Lasso in high dimensions

Machine Learning 2020-02-27 v2 Machine Learning Statistics Theory Statistics Theory

Abstract

We leverage recent advances in high-dimensional statistics to derive new L2 estimation upper bounds for Lasso and Group Lasso in high-dimensions. For Lasso, our bounds scale as (k/n)log(p/k)(k^*/n) \log(p/k^*)---n×pn\times p is the size of the design matrix and kk^* the dimension of the ground truth β\boldsymbol{\beta}^*---and match the optimal minimax rate. For Group Lasso, our bounds scale as (s/n)log(G/s)+m/n(s^*/n) \log\left( G / s^* \right) + m^* / n---GG is the total number of groups and mm^* the number of coefficients in the ss^* groups which contain β\boldsymbol{\beta}^*---and improve over existing results. We additionally show that when the signal is strongly group-sparse, Group Lasso is superior to Lasso.

Cite

@article{arxiv.1912.11398,
  title  = {An error bound for Lasso and Group Lasso in high dimensions},
  author = {Antoine Dedieu},
  journal= {arXiv preprint arXiv:1912.11398},
  year   = {2020}
}

Comments

arXiv admin note: text overlap with arXiv:1910.08880

R2 v1 2026-06-23T12:55:48.540Z