English
Related papers

Related papers: Vertical-likelihood Monte Carlo

200 papers

Computing the marginal likelihood (ML) of a model requires marginalizing out all of the parameters and latent variables, a difficult high-dimensional summation or integration problem. To make matters worse, it is often hard to measure the…

Machine Learning · Statistics 2015-11-10 Roger B. Grosse , Zoubin Ghahramani , Ryan P. Adams

In this paper, we propose an efficient importance sampling algorithm for rare event simulation under copula models. In the algorithm, the derived optimal probability measure is based on the criterion of minimizing the variance of the…

Computation · Statistics 2025-04-07 Siang Cheng , Cheng-Der Fuh , Tianxiao Pang

Monte Carlo simulations are based on the manipulation of random numbers to evaluate probable outcomes, with applicability in a variety of different fields. By assigning probabilities, which can be determined a priori, to various events, it…

Physics Education · Physics 2022-01-03 Parasuraman Swaminathan

The aim of this paper is to introduce a new Monte Carlo method based on importance sampling techniques for the simulation of stochastic differential equations. The main idea is to combine random walk on squares or rectangles methods with…

Probability · Mathematics 2010-10-22 Madalina Deaconu , Antoine Lejay

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

A key goal in the design of probabilistic inference algorithms is identifying and exploiting properties of the distribution that make inference tractable. Lifted inference algorithms identify symmetry as a property that enables efficient…

Artificial Intelligence · Computer Science 2019-07-02 Steven Holtzen , Todd Millstein , Guy Van den Broeck

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

Statistics Theory · Mathematics 2014-11-18 Mark Huber

We introduce a general Monte Carlo method based on Nested Sampling (NS), for sampling complex probability distributions and estimating the normalising constant. The method uses one or more particles, which explore a mixture of nested…

Computation · Statistics 2012-02-27 Brendon J. Brewer , Livia B. Pártay , Gábor Csányi

A core problem in statistics and probabilistic machine learning is to compute probability distributions and expectations. This is the fundamental problem of Bayesian statistics and machine learning, which frames all inference as…

Machine Learning · Statistics 2024-12-06 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

This paper introduces a class of Monte Carlo algorithms which are based upon the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current…

Methodology · Statistics 2020-04-14 Murray Pollock , Paul Fearnhead , Adam M. Johansen , Gareth O. Roberts

Continuous level Monte Carlo is an unbiased, continuous version of the celebrated multilevel Monte Carlo method. The approximation level is assumed to be continuous resulting in a stochastic process describing the quantity of interest.…

Numerical Analysis · Mathematics 2024-02-19 Cedric Aaron Beschle , Andrea Barth

We propose a new Monte Carlo algorithm for complex discrete distributions. The algorithm is motivated by the N-Fold Way, which is an ingenious event-driven MCMC sampler that avoids rejection moves at any specific state. The N-Fold Way can…

Computation · Statistics 2012-06-26 Firas Hamze , Nando de Freitas

Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo…

Numerical Analysis · Mathematics 2019-11-06 Jingrun Chen , Rui Du , Panchi Li , Liyao Lyu

Monte Carlo maximum likelihood (MCML) provides an elegant approach to find maximum likelihood estimators (MLEs) for latent variable models. However, MCML algorithms are computationally expensive when the latent variables are…

Computation · Statistics 2020-08-05 Jaewoo Park , Murali Haran

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

We provide a pedagogical introduction to the two main variants of real-space quantum Monte Carlo methods for electronic-structure calculations: variational Monte Carlo (VMC) and diffusion Monte Carlo (DMC). Assuming no prior knowledge on…

Chemical Physics · Physics 2015-08-13 Julien Toulouse , Roland Assaraf , C. J. Umrigar

This paper considers uncertainty quantification for an elliptic nonlocal equation. In particular, it is assumed that the parameters which define the kernel in the nonlocal operator are uncertain and a priori distributed according to a…

Computation · Statistics 2016-03-22 Ajay Jasra , Kody Law , Yan Zhou

Hypothesis tests calibrated by (re)sampling methods (such as permutation, rank and bootstrap tests) are useful tools for statistical analysis, at the computational cost of requiring Monte-Carlo sampling for calibration. It is common and…

Methodology · Statistics 2024-09-30 Ivo V. Stoepker , Rui M. Castro

Population Monte Carlo (PMC) sampling methods are powerful tools for approximating distributions of static unknowns given a set of observations. These methods are iterative in nature: at each step they generate samples from a proposal…

Computation · Statistics 2022-01-17 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo