English
Related papers

Related papers: Monte Carlo Anti-Differentiation for Approximate W…

200 papers

We revisit the theory of importance weighted variational inference (IWVI), a promising strategy for learning latent variable models. IWVI uses new variational bounds, known as Monte Carlo objectives (MCOs), obtained by replacing intractable…

Machine Learning · Statistics 2022-01-27 Pierre-Alexandre Mattei , Jes Frellsen

In this article we consider the approximation of expectations w.r.t. probability distributions associated to the solution of partial differential equations (PDEs); this scenario appears routinely in Bayesian inverse problems. In practice,…

Computation · Statistics 2017-02-07 Alexandros Beskos , Ajay Jasra , Kody Law , Raul Tempone , Yan Zhou

The Multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty Quantification (UQ) in Partial Differential Equation (PDE) models, combining model computations at different levels…

Mathematical Software · Computer Science 2023-05-24 Santiago Badia , Jerrad Hampton , Javier Principe

Weighted model counting (WMC) is the task of computing the weighted sum of all satisfying assignments (i.e., models) of a propositional formula. Similarly, weighted model sampling (WMS) aims to randomly generate models with probability…

Artificial Intelligence · Computer Science 2024-06-17 Yuanhong Wang , Juhua Pu , Yuyi Wang , Ondřej Kuželka

This paper considers a new approach to using Markov chain Monte Carlo (MCMC) in contexts where one may adopt multilevel (ML) Monte Carlo. The underlying problem is to approximate expectations w.r.t. an underlying probability measure that is…

Numerical Analysis · Mathematics 2018-06-27 Ajay Jasra , Kody Law , Yaxian Xu

Conditional Monte Carlo or pre-integration is a powerful tool for reducing variance and improving the regularity of integrands when using Monte Carlo and quasi-Monte Carlo (QMC) methods. To select the variable to pre-integrate, one must…

Computation · Statistics 2023-07-26 Sifan Liu

This paper proposes a new theory and methodology to tackle the problem of unifying distributed analyses and inferences on shared parameters from multiple sources, into a single coherent inference. This surprisingly challenging problem…

Methodology · Statistics 2019-07-22 Hongsheng Dai , Murray Pollock , Gareth Roberts

Warm dense matter (WDM) is an active field of research, with applications ranging from astrophysics to inertial confinement fusion. Ionization degree and continuum lowering are important quantities to understand how materials behave under…

We provide a pedagogical introduction to the two main variants of real-space quantum Monte Carlo methods for electronic-structure calculations: variational Monte Carlo (VMC) and diffusion Monte Carlo (DMC). Assuming no prior knowledge on…

Chemical Physics · Physics 2015-08-13 Julien Toulouse , Roland Assaraf , C. J. Umrigar

This paper investigates a class of algorithms for numerical integration of a function in d dimensions over a compact domain by Monte Carlo methods. We construct a histogram approximation to the function using a partition of the integration…

Computational Physics · Physics 2015-06-11 Rudy Arthur , A. D. Kennedy

Discrete data are abundant and often arise as counts or rounded data. These data commonly exhibit complex distributional features such as zero-inflation, over-/under-dispersion, boundedness, and heaping, which render many parametric models…

Methodology · Statistics 2023-02-27 Daniel R. Kowal , Bohan Wu

Correlated fermions are of high interest in condensed matter (Fermi liquids, Wigner molecules), cold atomic gases and dense plasmas. Here we propose a novel approach to path integral Monte Carlo (PIMC) simulations of strongly degenerate…

Quantum Gases · Physics 2016-01-15 Tobias Dornheim , Simon Groth , Alexey Filinov , Michael Bonitz

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

Variational inference lies at the core of many state-of-the-art algorithms. To improve the approximation of the posterior beyond parametric families, it was proposed to include MCMC steps into the variational lower bound. In this work we…

Machine Learning · Statistics 2016-09-28 Christopher Wolf , Maximilian Karl , Patrick van der Smagt

Quantum Monte Carlo (QMC) methods are one of the most important tools for studying interacting quantum many-body systems. The vast majority of QMC calculations in interacting fermion systems require a constraint to control the sign problem.…

Strongly Correlated Electrons · Physics 2016-12-08 Mingpu Qin , Hao Shi , Shiwei Zhang

Modeling complex phenomena typically involves the use of both discrete and continuous variables. Such a setting applies across a wide range of problems, from identifying trends in time-series data to performing effective compositional scene…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Tuan Anh Le , Katherine M. Collins , Luke Hewitt , Kevin Ellis , N. Siddharth , Samuel J. Gershman , Joshua B. Tenenbaum

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a…

Methodology · Statistics 2020-11-03 Jiaxin Zhang

A technique for reducing the number of integrals in a Monte Carlo calculation is introduced. For integrations relying on classical or mean-field trajectories with local weighting functions, it is possible to integrate analytically at least…

Statistical Mechanics · Physics 2024-05-17 Jarod Tall , Steven Tomsovic

The variational quantum Monte Carlo (VQMC) method received significant attention in the recent past because of its ability to overcome the curse of dimensionality inherent in many-body quantum systems. Close parallels exist between VQMC and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-01 Tianchen Zhao , Saibal De , Brian Chen , James Stokes , Shravan Veerapaneni

We introduce a new algorithm for approximate inference that combines reparametrization, Markov chain Monte Carlo and variational methods. We construct a very flexible implicit variational distribution synthesized by an arbitrary Markov…

Machine Learning · Statistics 2017-08-07 Michalis K. Titsias