English

Partial differential equation regularization for supervised machine learning

Machine Learning 2019-10-04 v1 Analysis of PDEs Machine Learning

Abstract

This article is an overview of supervised machine learning problems for regression and classification. Topics include: kernel methods, training by stochastic gradient descent, deep learning architecture, losses for classification, statistical learning theory, and dimension independent generalization bounds. Implicit regularization in deep learning examples are presented, including data augmentation, adversarial training, and additive noise. These methods are reframed as explicit gradient regularization.

Keywords

Cite

@article{arxiv.1910.01612,
  title  = {Partial differential equation regularization for supervised machine learning},
  author = {Adam M Oberman},
  journal= {arXiv preprint arXiv:1910.01612},
  year   = {2019}
}

Comments

16 pages, 5 figures