English

Ridge Regularization: an Essential Concept in Data Science

Methodology 2024-11-01 v2 Machine Learning Machine Learning

Abstract

Ridge or more formally 2\ell_2 regularization shows up in many areas of statistics and machine learning. It is one of those essential devices that any good data scientist needs to master for their craft. In this brief ridge fest I have collected together some of the magic and beauty of ridge that my colleagues and I have encountered over the past 40 years in applied statistics.

Cite

@article{arxiv.2006.00371,
  title  = {Ridge Regularization: an Essential Concept in Data Science},
  author = {Trevor Hastie},
  journal= {arXiv preprint arXiv:2006.00371},
  year   = {2024}
}

Comments

17 pages, 5 figures. This paper was invited by Technometrics to appear in a special section to celebrate the 50th anniversary of the 1970 original ridge paper by Hoerl and Kennard

R2 v1 2026-06-23T15:56:05.938Z