English
Related papers

Related papers: Partition Functions from Rao-Blackwellized Tempere…

200 papers

The partition function for two-dimensional nearest neighbour Ising models in the presence of a magnetic field is derived . A comparison with the partition functions predicted by Onsager is carried out. The critical temperature estimated by…

Chemical Physics · Physics 2007-06-28 G. Nandhini , M. V. Sangaranarayanan

Tempering is a popular tool in Bayesian computation, being used to transform a posterior distribution $p_1$ into a reference distribution $p_0$ that is more easily approximated. Several algorithms exist that start by approximating $p_0$ and…

Computation · Statistics 2025-09-16 Mengxin Xi , Zheyang Shen , Marina Riabiz , Nicolas Chopin , Chris J. Oates

Sampling from multimodal distributions is a central challenge in Bayesian inference and machine learning. In light of hardness results for sampling -- classical MCMC methods, even with tempering, can suffer from exponential mixing times --…

Machine Learning · Statistics 2025-12-23 Holden Lee , Matheau Santana-Gijzen

Sampling Boltzmann probability distributions plays a key role in machine learning and optimization, motivating the design of hardware accelerators such as Ising machines. While the Ising model can in principle encode arbitrary optimization…

Machine Learning · Computer Science 2025-08-01 Corentin Delacour , M Mahmudul Hasan Sajeeb , Joao P. Hespanha , Kerem Y. Camsari

This article presents new methodology for sample-based Bayesian inference when data are partitioned and communication between the parts is expensive, as arises by necessity in the context of "big data" or by choice in order to take…

Methodology · Statistics 2022-11-01 Marc Box

Partition density functional theory is a formally exact procedure for calculating molecular properties from Kohn-Sham calculations on isolated fragments, interacting via a global partition potential that is a functional of the fragment…

Other Condensed Matter · Physics 2015-05-13 Peter Elliott , Kieron Burke , Morrel H. Cohen , Adam Wasserman

Parameterized artificial neural networks (ANNs) can be very expressive ansatzes for variational algorithms, reaching state-of-the-art energies on many quantum many-body Hamiltonians. Nevertheless, the training of the ANN can be slow and…

Quantum Physics · Physics 2025-06-04 Conor Smith , Quinn T. Campbell , Tameem Albash

Importance sampling has been known as a powerful tool to reduce the variance of Monte Carlo estimator for rare event simulation. Based on the criterion of minimizing the variance of Monte Carlo estimator within a parametric family, we…

Methodology · Statistics 2013-02-11 Cheng-Der Fuh , Huei-Wen Teng , Ren-Her Wang

Zero-free based algorithm is a major technique for deterministic approximate counting. In Barvinok's original framework[Bar17], by calculating truncated Taylor expansions, a quasi-polynomial time algorithm was given for estimating zero-free…

Data Structures and Algorithms · Computer Science 2022-02-01 Penghui Yao , Yitong Yin , Xinyuan Zhang

A sequential importance sampling algorithm is developed for the distribution that results when a matrix of independent, but not identically distributed, Bernoulli random variables is conditioned on a given sequence of row and column sums.…

Computation · Statistics 2013-01-18 Matthew T. Harrison , Jeffrey W. Miller

The estimation of the probability of rare events is an important task in reliability and risk assessment. We consider failure events that are expressed in terms of a limit state function, which depends on the solution of a partial…

Numerical Analysis · Mathematics 2020-07-15 Fabian Wagner , Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divides the problem of…

Machine Learning · Statistics 2015-03-06 Michalis K. Titsias

We construct a pathwise calculus for functionals of integer-valued measures and use it to derive an martingale representation formula with respect to a large class of integer-valued random measures. Using these results, we extend the…

Probability · Mathematics 2020-02-28 Pierre M. Blacque-Florentin , Rama Cont

We wish to compute the gradient of an expectation over a finite or countably infinite sample space having $K \leq \infty$ categories. When $K$ is indeed infinite, or finite but very large, the relevant summation is intractable. Accordingly,…

Machine Learning · Statistics 2019-05-14 Runjing Liu , Jeffrey Regier , Nilesh Tripuraneni , Michael I. Jordan , Jon McAuliffe

The ratio between the probability that two distributions $R$ and $P$ give to points $x$ are known as importance weights or propensity scores and play a fundamental role in many different fields, most notably, statistics and machine…

Machine Learning · Computer Science 2021-03-11 Parikshit Gopalan , Omer Reingold , Vatsal Sharan , Udi Wieder

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

We investigate the utility to computational Bayesian analyses of a particular family of recursive marginal likelihood estimators characterized by the (equivalent) algorithms known as "biased sampling" or "reverse logistic regression" in the…

Methodology · Statistics 2014-10-16 Ewan Cameron , Anthony Pettitt

Computing the partition function, $Z$, of an Ising model over a graph of $N$ \enquote{spins} is most likely exponential in $N$. Efficient variational methods, such as Belief Propagation (BP) and Tree Re-Weighted (TRW) algorithms, compute…

Machine Learning · Computer Science 2024-11-14 Hamidreza Behjoo , Michael Chertkov

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

Quantum computing raises the possibility of solving a variety of problems in physics that are presently intractable. A number of such problems involves the physics of systems in or near thermal equilibrium. There are two main ways to…

Quantum Physics · Physics 2023-08-16 Carter Ball , Thomas D. Cohen