English

Convergence of Langevin-Simulated Annealing algorithms with multiplicative noise II: Total Variation

Probability 2022-05-31 v1

Abstract

We study the convergence of Langevin-Simulated Annealing type algorithms with multiplicative noise, i.e. for V:RdRV : \mathbb{R}^d \to \mathbb{R} a potential function to minimize, we consider the stochastic differential equation dYt=σσV(Yt)dt+a(t)σ(Yt)dWt+a(t)2Υ(Yt)dtdY_t = - \sigma \sigma^\top \nabla V(Y_t) dt + a(t)\sigma(Y_t)dW_t + a(t)^2\Upsilon(Y_t)dt, where (Wt)(W_t) is a Brownian motion, where σ:RdMd(R)\sigma : \mathbb{R}^d \to \mathcal{M}_d(\mathbb{R}) is an adaptive (multiplicative) noise, where a:R+R+a : \mathbb{R}^+ \to \mathbb{R}^+ is a function decreasing to 00 and where Υ\Upsilon is a correction term. Allowing σ\sigma to depend on the position brings faster convergence in comparison with the classical Langevin equation dYt=V(Yt)dt+σdWtdY_t = -\nabla V(Y_t)dt + \sigma dW_t. In a previous paper we established the convergence in L1L^1-Wasserstein distance of YtY_t and of its associated Euler scheme Yˉt\bar{Y}_t to argmin(V)\text{argmin}(V) with the classical schedule a(t)=Alog1/2(t)a(t) = A\log^{-1/2}(t). In the present paper we prove the convergence in total variation distance. The total variation case appears more demanding to deal with and requires regularization lemmas.

Keywords

Cite

@article{arxiv.2205.15039,
  title  = {Convergence of Langevin-Simulated Annealing algorithms with multiplicative noise II: Total Variation},
  author = {Pierre Bras and Gilles Pagès},
  journal= {arXiv preprint arXiv:2205.15039},
  year   = {2022}
}

Comments

18 pages. arXiv admin note: text overlap with arXiv:2109.11669