English
Related papers

Related papers: Belief-Propagation Guided Monte-Carlo Sampling

200 papers

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

A plethora of problems in AI, engineering and the sciences are naturally formalized as inference in discrete probabilistic models. Exact inference is often prohibitively expensive, as it may require evaluating the (unnormalized) target…

Machine Learning · Computer Science 2019-10-16 Lars Buesing , Nicolas Heess , Theophane Weber

This paper introduces a Monte Carlo method for maximum likelihood inference in the context of discretely observed diffusion processes. The method gives unbiased and a.s.\@ continuous estimators of the likelihood function for a family of…

Statistics Theory · Mathematics 2009-03-03 Alexandros Beskos , Omiros Papaspiliopoulos , Gareth Roberts

Belief Propagation (BP) is an efficient message-passing algorithm widely used for inference in graphical models and for solving various problems in statistical physics. However, BP often yields inaccurate estimates of order parameters and…

Social and Information Networks · Computer Science 2025-10-23 Seongmin Kim , Alec Kirkley

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating…

Machine Learning · Computer Science 2021-03-17 Victor Garcia Satorras , Max Welling

Robust inference for stochastic dynamical systems is often hampered by sparse sampling and the absence of closed-form likelihoods. We introduce a Monte Carlo path-inference framework that leverages full-path statistics and bridge processes…

Statistical Mechanics · Physics 2025-10-07 Javier Aguilar , Miguel A. Muñoz , Sandro Azaele

A statistical method is derived for the calculation of thermodynamic properties of many-body systems at low temperatures. This method is based on the self-healing diffusion Monte Carlo method for complex functions [F. A. Reboredo J. Chem.…

Other Condensed Matter · Physics 2014-03-05 Fernando A. Reboredo , Jeongnim Kim

We present a new efficient method for Monte Carlo simulations of diffusion-reaction processes. First introduced by us in [Phys. Rev. Lett., 97:230602, 2006], the new algorithm skips the traditional small diffusion hops and propagates the…

Materials Science · Physics 2013-05-29 T. Oppelstrup , V. V. Bulatov , A. Donev , M. H. Kalos , G. H. Gilmer , B. Sadigh

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

We present two Monte Carlo sampling algorithms for probabilistic inference that guarantee polynomial-time convergence for a larger class of network than current sampling algorithms provide. These new methods are variants of the known…

Artificial Intelligence · Computer Science 2013-02-18 Malcolm Pradhan , Paul Dagum

We use Monte Carlo techniques to simulate an organized prediction competition between a group of a scientific experts acting under the influence of a ``self-governing'' prediction reward algorithm. Our aim is to illustrate the advantages of…

Social and Information Networks · Computer Science 2023-05-09 J. O. Gonzalez-Hernandez , Jonathan Marino , Ted Rogers , Brandon Velasco

A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good…

Statistics Theory · Mathematics 2011-11-11 Christian Schäfer , Nicolas Chopin

Belief propagation (BP) algorithm is a widely used message-passing method for inference in graphical models. BP on loop-free graphs converges in linear time. But for graphs with loops, BP's performance is uncertain, and the understanding of…

Machine Learning · Statistics 2020-06-30 Dong Liu , Minh Thành Vu , Zuxing Li , Lars K. Rasmussen

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is…

Machine Learning · Computer Science 2019-08-26 Dong Liu , Nima N. Moghadam , Lars K. Rasmussen , Jinliang Huang , Saikat Chatterjee

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting…

Computation · Statistics 2025-04-28 Shenggang Hu , Hongsheng Dai , Fanlin Meng , Louis Aslett , Murray Pollock , Gareth O. Roberts

Tree graphs are routinely used in statistics. When estimating a Bayesian model with a tree component, sampling the posterior remains a core difficulty. Existing Markov chain Monte Carlo methods tend to rely on local moves, often leading to…

Methodology · Statistics 2025-02-05 Edric Tam , David B. Dunson , Leo L. Duan