English
Related papers

Related papers: Stochastic Gradient Hamiltonian Monte Carlo for No…

200 papers

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) approach that exhibits favourable exploration properties in high-dimensional models such as neural networks. Unfortunately, HMC has limited use in large-data regimes and…

Machine Learning · Statistics 2020-10-15 Adam D. Cobb , Brian Jalaian

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

Machine Learning · Computer Science 2019-01-07 Duo Xu

Stochastic gradient methods (SGMs) have been extensively used for solving stochastic problems or large-scale machine learning problems. Recent works employ various techniques to improve the convergence rate of SGMs for both convex and…

Optimization and Control · Mathematics 2022-05-02 Yangyang Xu , Yibo Xu

In this work we define a unified mathematical framework to deepen our understanding of the role of stochastic gradient (SG) noise on the behavior of Markov chain Monte Carlo sampling (SGMCMC) algorithms. Our formulation unlocks the design…

Machine Learning · Computer Science 2020-06-11 Giulio Franzese , Rosa Candela , Dimitrios Milios , Maurizio Filippone , Pietro Michiardi

Stochastic gradient Markov chain Monte Carlo (SG-MCMC) methods are Bayesian analogs to popular stochastic optimization methods; however, this connection is not well studied. We explore this relationship by applying simulated annealing to an…

Machine Learning · Statistics 2016-08-08 Changyou Chen , David Carlson , Zhe Gan , Chunyuan Li , Lawrence Carin

Understanding stochastic gradient descent (SGD) and its variants is essential for machine learning. However, most of the preceding analyses are conducted under amenable conditions such as unbiased gradient estimator and bounded objective…

Machine Learning · Statistics 2024-03-26 Tianyou Li , Fan Chen , Huajie Chen , Zaiwen Wen

Bayesian deep learning offers a principled way to address many issues concerning safety of artificial intelligence (AI), such as model uncertainty,model interpretability, and prediction bias. However, due to the lack of efficient Monte…

Machine Learning · Statistics 2020-09-22 Sehwan Kim , Qifan Song , Faming Liang

Stochastic gradient descent with momentum (SGDM) has been widely used in many machine learning and statistical applications. Despite the observed empirical benefits of SGDM over traditional SGD, the theoretical understanding of the role of…

Machine Learning · Computer Science 2024-02-02 Kejie Tang , Weidong Liu , Yichen Zhang , Xi Chen

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants that subsample the…

Statistics Theory · Mathematics 2015-11-03 Yi-An Ma , Tianqi Chen , Emily B. Fox

We consider parallel asynchronous Markov Chain Monte Carlo (MCMC) sampling for problems where we can leverage (stochastic) gradients to define continuous dynamics which explore the target distribution. We outline a solution strategy for…

Machine Learning · Statistics 2016-12-09 Jost Tobias Springenberg , Aaron Klein , Stefan Falkner , Frank Hutter

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

The training of modern machine learning models often consists in solving high-dimensional non-convex optimisation problems that are subject to large-scale data. In this context, momentum-based stochastic optimisation algorithms have become…

Optimization and Control · Mathematics 2024-11-06 Kexin Jin , Jonas Latz , Chenguang Liu , Alessandro Scagliotti

Stochastic gradient descent in continuous time (SGDCT) provides a computationally efficient method for the statistical learning of continuous-time models, which are widely used in science, engineering, and finance. The SGDCT algorithm…

Probability · Mathematics 2019-06-18 Justin Sirignano , Konstantinos Spiliopoulos

We study the Stochastic Gradient Langevin Dynamics (SGLD) algorithm for non-convex optimization. The algorithm performs stochastic gradient descent, where in each step it injects appropriately scaled Gaussian noise to the update. We analyze…

Machine Learning · Computer Science 2018-04-10 Yuchen Zhang , Percy Liang , Moses Charikar

Stochastic gradient Langevin dynamics (SGLD) and stochastic gradient Hamiltonian Monte Carlo (SGHMC) are two popular Markov Chain Monte Carlo (MCMC) algorithms for Bayesian inference that can scale to large datasets, allowing to sample from…

Machine Learning · Statistics 2021-08-30 Mert Gürbüzbalaban , Xuefeng Gao , Yuanhan Hu , Lingjiong Zhu

In this paper, we propose a generalized framework for developing learning-rate-free momentum stochastic gradient descent (SGD) methods in the minimization of nonsmooth nonconvex functions, especially in training nonsmooth neural networks.…

Optimization and Control · Mathematics 2024-06-27 Xiaoyin Hu , Nachuan Xiao , Xin Liu , Kim-Chuan Toh

The Stochastic Gradient Descent method (SGD) and its stochastic variants have become methods of choice for solving finite-sum optimization problems arising from machine learning and data science thanks to their ability to handle large-scale…

Optimization and Control · Mathematics 2024-03-06 Trang H. Tran , Quoc Tran-Dinh , Lam M. Nguyen

The problem of optimising functions with intractable gradients frequently arise in machine learning and statistics, ranging from maximum marginal likelihood estimation procedures to fine-tuning of generative models. Stochastic approximation…

Machine Learning · Statistics 2026-01-30 James Cuin , Davide Carbone , Yanbo Tang , O. Deniz Akyildiz

Stochastic gradient descent (SGD) algorithm is the method of choice in many machine learning tasks thanks to its scalability and efficiency in dealing with large-scale problems. In this paper, we focus on the shuffling version of SGD which…

Machine Learning · Computer Science 2023-10-27 Lam M. Nguyen , Trang H. Tran