Non-convex sampling for a mixture of locally smooth potentials
Abstract
The purpose of this paper is to examine the sampling problem through Euler discretization, where the potential function is assumed to be a mixture of locally smooth distributions and weakly dissipative. We introduce -mixture locally smooth and -mixture locally Hessian smooth, which are novel and typically satisfied with a mixture of distributions. Under our conditions, we prove the convergence in Kullback-Leibler (KL) divergence with the number of iterations to reach -neighborhood of a target distribution in only polynomial dependence on the dimension. The convergence rate is improved when the potential is -smooth and -mixture locally Hessian smooth. Our result for the non-strongly convex outside the ball of radius is obtained by convexifying the non-convex domains. In addition, we provide some nice theoretical properties of -generalized Gaussian smoothing and prove the convergence in the -Wasserstein distance for stochastic gradients in a general setting.
Keywords
Cite
@article{arxiv.2301.13706,
title = {Non-convex sampling for a mixture of locally smooth potentials},
author = {Dao Nguyen},
journal= {arXiv preprint arXiv:2301.13706},
year = {2023}
}
Comments
arXiv admin note: substantial text overlap with arXiv:2112.09311