English

The structure of conservative gradient fields

Optimization and Control 2021-01-05 v1 Machine Learning Numerical Analysis Numerical Analysis

Abstract

The classical Clarke subdifferential alone is inadequate for understanding automatic differentiation in nonsmooth contexts. Instead, we can sometimes rely on enlarged generalized gradients called "conservative fields", defined through the natural path-wise chain rule: one application is the convergence analysis of gradient-based deep learning algorithms. In the semi-algebraic case, we show that all conservative fields are in fact just Clarke subdifferentials plus normals of manifolds in underlying Whitney stratifications.

Cite

@article{arxiv.2101.00699,
  title  = {The structure of conservative gradient fields},
  author = {Adrian Lewis and Tonghua Tian},
  journal= {arXiv preprint arXiv:2101.00699},
  year   = {2021}
}
R2 v1 2026-06-23T21:43:46.181Z