Stochastic gradient descent with discontinuity across a manifold

Vivek S. Borkar

Stochastic gradient descent with discontinuity across a manifold

Machine Learning 2026-08-07 v1 Machine Learning Probability

Authors: Vivek S. Borkar

Abstract

Stochastic gradient descent for a loss function discontinuous across lower dimensional manifolds is analyzed by studying its differential equation limit.

Keywords

stochastic gradient descent discontinuity manifold differential equation limit non-smooth optimization

Cite

@article{arxiv.2608.07618,
  title  = {Stochastic gradient descent with discontinuity across a manifold},
  author = {Vivek S. Borkar},
  journal= {arXiv preprint arXiv:2608.07618},
  year   = {2026}
}

Comments

13 pages