中文
相关论文

相关论文: Improved Langevin Monte Carlo for stochastic optim…

200 篇论文

In this article, we consider the preconditioned Hamiltonian Monte Carlo (pHMC) algorithm defined directly on an infinite-dimensional Hilbert space. In this context, and under a condition reminiscent of strong log-concavity of the target…

概率论 · 数学 2020-11-18 Jakiw Pidstrigach

We propose a Langevin diffusion-based algorithm for non-convex optimization and sampling on a product manifold of spheres. Under a logarithmic Sobolev inequality, we establish a guarantee for finite iteration convergence to the Gibbs…

机器学习 · 统计学 2023-06-21 Mufan Bill Li , Murat A. Erdogdu

This paper introduces a new Markov Chain Monte Carlo method for Bayesian variable selection in high dimensional settings. The algorithm is a Hastings-Metropolis sampler with a proposal mechanism which combines a Metropolis Adjusted Langevin…

统计理论 · 数学 2015-09-14 Amandine Schreck , Gersende Fort , Sylvain Le Corff , Eric Moulines

In this paper, we introduce a new approach for integrating score-based models with the Metropolis-Hastings algorithm. While traditional score-based diffusion models excel in accurately learning the score function from data points, they lack…

机器学习 · 计算机科学 2025-04-01 Ahmed Aloui , Ali Hasan , Juncheng Dong , Zihao Wu , Vahid Tarokh

We present the Local Self-Balancing sampler (LSB), a local Markov Chain Monte Carlo (MCMC) method for sampling in purely discrete domains, which is able to autonomously adapt to the target distribution and to reduce the number of target…

人工智能 · 计算机科学 2022-07-06 Emanuele Sansone

Hamiltonian Monte Carlo (HMC) is an efficient Bayesian sampling method that can make distant proposals in the parameter space by simulating a Hamiltonian dynamical system. Despite its popularity in machine learning and data science, HMC is…

机器学习 · 统计学 2020-09-02 Ziming Liu , Zheng Zhang

We develop Hybrid Monte Carlo (HMC) algorithms for constrained Hamiltonian systems of gauge- Higgs models and introduce a new observable for the constraint effective Higgs potential. We use an extension of the so-called Rattle algorithm to…

高能物理 - 格点 · 物理学 2020-05-15 Michael Günther , Roman Höllwieser , Francesco Knechtli

Hamiltonian Monte Carlo (HMC) is a popular method in sampling. While there are quite a few works of studying this method on various aspects, an interesting question is how to choose its integration time to achieve acceleration. In this…

机器学习 · 计算机科学 2023-02-16 Jun-Kun Wang , Andre Wibisono

We propose a new Monte Carlo method for sampling from multimodal distributions. The idea of this technique is based on splitting the task into two: finding the modes of a target distribution $\pi$ and sampling, given the knowledge of the…

统计计算 · 统计学 2019-01-14 Emilia Pompe , Chris Holmes , Krzysztof Łatuszyński

Existing rigorous convergence guarantees for the Hamiltonian Monte Carlo (HMC) algorithm use Gaussian auxiliary momentum variables, which are crucially symmetrically distributed. We present a novel convergence analysis for HMC utilizing new…

机器学习 · 统计学 2026-05-12 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

We present a novel Monte Carlo algorithm which enhances equilibrization of low-temperature simulations and allows sampling of configurations over a large range of energies. The method is based on a non-Boltzmann probability weight factor…

凝聚态物理 · 物理学 2009-10-30 Ulrich H. E. Hansmann , Yuko Okamoto

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

统计计算 · 统计学 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

In the last few decades, Markov chain Monte Carlo (MCMC) methods have been widely applied to Bayesian updating of structural dynamic models in the field of structural health monitoring. Recently, several MCMC algorithms have been developed…

应用统计 · 统计学 2026-04-29 Xianghao Meng , James L. Beck , Yong Huang , Hui Li

We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin…

This paper introduces and analyses interacting underdamped Langevin algorithms, termed Kinetic Interacting Particle Langevin Monte Carlo (KIPLMC) methods, for statistical inference in latent variable models. We propose a diffusion process…

统计计算 · 统计学 2026-04-17 Paul Felix Valsecchi Oliva , O. Deniz Akyildiz

Stochastic gradient Langevin dynamics (SGLD) is a computationally efficient sampler for Bayesian posterior inference given a large scale dataset. Although SGLD is designed for unbounded random variables, many practical models incorporate…

机器学习 · 统计学 2019-06-21 Soma Yokoi , Takuma Otsuka , Issei Sato

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

机器学习 · 统计学 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

We consider posterior sampling in the very common Bayesian hierarchical model in which observed data depends on high-dimensional latent variables that, in turn, depend on relatively few hyperparameters. When the full conditional over the…

统计计算 · 统计学 2016-10-24 Richard A. Norton , J. Andres Christen , Colin Fox

Stochastic Gradient (SG) Markov Chain Monte Carlo algorithms (MCMC) are popular algorithms for Bayesian sampling in the presence of large datasets. However, they come with little theoretical guarantees and assessing their empirical…

机器学习 · 统计学 2024-05-16 Lorenzo Mauri , Giacomo Zanella

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…

机器学习 · 统计学 2021-02-03 Adrià Garriga-Alonso , Vincent Fortuin
‹ 上一页 1 8 9 10 下一页 ›