Markov Chain Gradient Descent in Hilbert Spaces
Machine Learning
2025-12-16 v4 Machine Learning
Functional Analysis
Abstract
In this paper, we study a Markov chain-based stochastic gradient algorithm in general Hilbert spaces, aiming at approximating the optimal solution of a quadratic loss function. We establish probabilistic upper bounds on its convergence. We further extend these results to an online regularized learning algorithm in reproducing kernel Hilbert spaces, where the samples are drawn along a Markov chain trajectory.
Cite
@article{arxiv.2410.08361,
title = {Markov Chain Gradient Descent in Hilbert Spaces},
author = {Priyanka Roy and Susanne Saminger-Platz},
journal= {arXiv preprint arXiv:2410.08361},
year = {2025}
}