A New Angle on L2 Regularization
Computer Vision and Pattern Recognition
2018-07-02 v1 Machine Learning
Abstract
Imagine two high-dimensional clusters and a hyperplane separating them. Consider in particular the angle between: the direction joining the two clusters' centroids and the normal to the hyperplane. In linear classification, this angle depends on the level of L2 regularization used. Can you explain why?
Cite
@article{arxiv.1806.11186,
title = {A New Angle on L2 Regularization},
author = {Thomas Tanay and Lewis D Griffin},
journal= {arXiv preprint arXiv:1806.11186},
year = {2018}
}
Comments
An explorable explanation on the phenomenon of adversarial examples in linear classification and its relation to L2 regularization. Interactive version available at: https://thomas-tanay.github.io/post--L2-regularization/