English
Related papers

Related papers: Refined Gradient-Based Temperature Optimization fo…

200 papers

We introduce \textit{Policy Guided Monte Carlo} (PGMC), a computational framework using reinforcement learning to improve Markov chain Monte Carlo (MCMC) sampling. The methodology is generally applicable, unbiased and opens up a new path to…

Computational Physics · Physics 2018-12-12 Troels Arnfred Bojesen

In the replica-exchange molecular dynamics method, where constant-temperature molecular dynamics simulations are performed in each replica, one usually rescales the momentum of each particle after replica exchange. This rescaling method had…

Statistical Mechanics · Physics 2010-04-14 Yoshiharu Mori , Yuko Okamoto

Markov Chain Monte Carlo (MCMC) methods are a powerful tool for computation with complex probability distributions. However the performance of such methods is critically dependant on properly tuned parameters, most of which are difficult if…

Computation · Statistics 2021-10-27 James A. Brofos , Marylou Gabrié , Marcus A. Brubaker , Roy R. Lederman

In this work, we tackle the problem of minimising the Conditional-Value-at-Risk (CVaR) of output quantities of complex differential models with random input data, using gradient-based approaches in combination with the Multi-Level Monte…

Numerical Analysis · Mathematics 2023-10-16 Sundar Ganesh , Fabio Nobile

Bayesian analysis is widely used in science and engineering for real-time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of…

Optimization and Control · Mathematics 2020-02-24 Jiangjiang Zhang , Jasper A. Vrugt , Xiaoqing Shi , Guang Lin , Lingzao Zeng , Laosheng Wu

We develop a new Markov chain on graph partitions that makes relatively global moves yet is computationally feasible to be used as the proposal in the Metropolis-Hastings method. Our resulting algorithm can be made reversible and able to…

Data Structures and Algorithms · Computer Science 2021-05-11 Eric Autrey , Daniel Carter , Gregory Herschlag , Zach Hunter , Jonathan C. Mattingly

We discuss a rejectionless global optimization technique which, while being technically similar to the recently introduced method of Extremal Optimization, still relies on a physical analogy with a thermalizing system. Our waiting time…

Statistical Mechanics · Physics 2009-11-07 Jesper Dall , Paolo Sibani

Bayesian inference for models with intractable likelihoods, such as Markov random fields, poses a fundamental computational challenge due to the tradeoff between inferential accuracy and computational cost. Various MCMC methods have been…

Methodology · Statistics 2026-04-01 Laura Bazahica , Alejandra Avalos-Pacheco , Matthew Moores , Lassi Roininen

This work proposes an adaptive sequential Monte Carlo sampling algorithm to solve Bayesian inverse problems in scenarios where likelihood evaluations are costly but can be approximated using a surrogate model built from previous evaluations…

Computation · Statistics 2025-08-26 Frederic Cerou , Patrick Heas , Mathias Rousset

We propose a Monte-Carlo-based method for reconstructing sparse signals in the formulation of sparse linear regression in a high-dimensional setting. The basic idea of this algorithm is to explicitly select variables or covariates to…

Machine Learning · Statistics 2021-02-01 Kao Hayashi , Tomoyuki Obuchi , Yoshiyuki Kabashima

The Diffusion Monte Carlo method is devoted to the computation of electronic ground-state energies of molecules. In this paper, we focus on implementations of this method which consist in exploring the configuration space with a {\bf fixed}…

Numerical Analysis · Mathematics 2007-05-23 Tony Lelievre , Mohamed El Makrini , Benjamin Jourdain

Recent papers have demonstrated the possibility of energy-based text generation by adapting gradient-based sampling algorithms, a paradigm of MCMC algorithms that promises fast convergence. However, as we show in this paper, previous…

Computation and Language · Computer Science 2024-01-01 Li Du , Afra Amini , Lucas Torroba Hennigen , Xinyan Velocity Yu , Jason Eisner , Holden Lee , Ryan Cotterell

The reversible jump Markov chain Monte Carlo (RJMCMC) method offers an across-model simulation approach for Bayesian estimation and model comparison, by exploring the sampling space that consists of several models of possibly varying…

Methodology · Statistics 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

We present the Monte Carlo with Absorbing Markov Chains (MCAMC) method for extremely long kinetic Monte Carlo simulations. The MCAMC algorithm does not modify the system dynamics. It is extremely useful for models with discrete state spaces…

Materials Science · Physics 2007-05-23 M. A. Novotny , Shannon M. Wheeler

Sequential Monte Carlo (SMC) methods are not only a popular tool in the analysis of state space models, but offer an alternative to MCMC in situations where Bayesian inference must proceed via simulation. This paper introduces a new SMC…

Computation · Statistics 2010-05-11 Paul Fearnhead , Benjamin M. Taylor

Markov chain Monte Carlo methods are a powerful and commonly used family of numerical methods for sampling from complex probability distributions. As applications of these methods increase in size and complexity, the need for efficient…

Numerical Analysis · Mathematics 2019-01-31 Colin Cotter , Simon Cotter , Paul Russell

Monte Carlo simulations are methods for simulating statistical systems. The aim is to generate a representative ensemble of configurations to access thermodynamical quantities without the need to solve the system analytically or to perform…

Statistical Mechanics · Physics 2015-06-19 Jean-Charles Walter , Gerard Barkema

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Many Bayesian inference problems involve target distributions whose density functions are computationally expensive to evaluate. Replacing the target density with a local approximation based on a small number of carefully chosen density…

Computation · Statistics 2022-07-13 Andrew D. Davis , Youssef Marzouk , Aaron Smith , Natesh Pillai

Importance sampling (IS) is a powerful Monte Carlo methodology for the approximation of intractable integrals, very often involving a target probability density function. The performance of IS heavily depends on the appropriate selection of…

Computation · Statistics 2023-06-22 Víctor Elvira , Emilie Chouzenoux , Ömer Deniz Akyildiz , Luca Martino