English

Fast projections onto mixed-norm balls with applications

Machine Learning 2012-04-09 v1 Machine Learning Optimization and Control

Abstract

Joint sparsity offers powerful structural cues for feature selection, especially for variables that are expected to demonstrate a "grouped" behavior. Such behavior is commonly modeled via group-lasso, multitask lasso, and related methods where feature selection is effected via mixed-norms. Several mixed-norm based sparse models have received substantial attention, and for some cases efficient algorithms are also available. Surprisingly, several constrained sparse models seem to be lacking scalable algorithms. We address this deficiency by presenting batch and online (stochastic-gradient) optimization methods, both of which rely on efficient projections onto mixed-norm balls. We illustrate our methods by applying them to the multitask lasso. We conclude by mentioning some open problems.

Keywords

Cite

@article{arxiv.1204.1437,
  title  = {Fast projections onto mixed-norm balls with applications},
  author = {Suvrit Sra},
  journal= {arXiv preprint arXiv:1204.1437},
  year   = {2012}
}

Comments

Preprint of paper under review

R2 v1 2026-06-21T20:45:39.928Z