English
Related papers

Related papers: Quasi-Monte Carlo and importance sampling methods …

200 papers

Importance sampling (IS) is a Monte Carlo technique that relies on weighted samples, simulated from a proposal distribution, to estimate intractable integrals. The quality of the estimators improves with the number of samples. However, for…

Computation · Statistics 2022-07-18 Medha Agarwal , Dootika Vats , Víctor Elvira

Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of…

Machine Learning · Computer Science 2022-09-29 Ali Mousavi , Reza Monsefi , Víctor Elvira

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira

In this paper we present a rigorous cost and error analysis of a multilevel estimator based on randomly shifted Quasi-Monte Carlo (QMC) lattice rules for lognormal diffusion problems. These problems are motivated by uncertainty…

Numerical Analysis · Mathematics 2016-09-05 Frances Y. Kuo , Robert Scheichl , Christoph Schwab , Ian H. Sloan , Elisabeth Ullmann

Reverse Monte Carlo (RMC) is an algorithm that incorporates stochastic modification of the action as part of the process that updates the fields in a Monte Carlo simulation. Such update moves have the potential of lowering or eliminating…

High Energy Physics - Lattice · Physics 2015-06-22 Arjun Singh Gambhir , Kostas Orginos

Bayesian methods and their implementations by means of sophisticated Monte Carlo techniques have become very popular in signal processing over the last years. Importance Sampling (IS) is a well-known Monte Carlo technique that approximates…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , G. Camps-Valls

The multilevel Monte Carlo (MLMC) method for continuous-time Markov chains, first introduced by Anderson and Higham (SIAM Multiscal Model. Simul. 10(1), 2012), is a highly efficient simulation technique that can be used to estimate various…

Numerical Analysis · Mathematics 2022-11-08 Chiheb Ben Hammouda , Nadhir Ben Rached , Raul Tempone

Adaptive importance sampling (AIS) methods are increasingly used for the approximation of distributions and related intractable integrals in the context of Bayesian inference. Population Monte Carlo (PMC) algorithms are a subclass of AIS…

Computation · Statistics 2022-06-08 Víctor Elvira , Émilie Chouzenoux

Importance sampling (IS) is a Monte Carlo technique for the approximation of intractable distributions and integrals with respect to them. The origin of IS dates from the early 1950s. In the last decades, the rise of the Bayesian paradigm…

Computation · Statistics 2024-06-21 Víctor Elvira , Luca Martino

Evaluating expectations on an Ising model (or Boltzmann machine) is essential for various applications, including statistical machine learning. However, in general, the evaluation is computationally difficult because it involves intractable…

Machine Learning · Statistics 2021-05-19 Muneki Yasuda , Kaiji Sekimoto

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. This setting is ubiquitous…

Numerical Analysis · Mathematics 2023-03-23 Kody J. H. Law , Neil Walton , Shangda Yang , Ajay Jasra

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in…

Machine Learning · Statistics 2014-11-04 Tom Gunter , Michael A. Osborne , Roman Garnett , Philipp Hennig , Stephen J. Roberts

We consider the problem of computing an approximation to the integral $I=\int_{[0,1]^d}f(x) dx$. Monte Carlo (MC) sampling typically attains a root mean squared error (RMSE) of $O(n^{-1/2})$ from $n$ independent random function evaluations.…

Computation · Statistics 2008-11-05 Art B. Owen

Importance sampling (IS) and numerical integration methods are usually employed for approximating moments of complicated target distributions. In its basic procedure, the IS methodology randomly draws samples from a proposal distribution…

Computation · Statistics 2022-04-12 Víctor Elvira , Luca Martino , Pau Closas

We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator…

Numerical Analysis · Mathematics 2024-03-12 Chiheb Ben Hammouda , Nadhir Ben Rached , Raúl Tempone , Sophia Wiechert

Recent advances in machine learning have led to the development of new methods for enhancing Monte Carlo methods such as Markov chain Monte Carlo (MCMC) and importance sampling (IS). One such method is normalizing flows, which use a neural…

Computation · Statistics 2024-01-12 Charly Andral

Existing multilevel quasi-Monte Carlo (MLQMC) methods often rely on multiple independent randomizations of a low-discrepancy (LD) sequence to estimate statistical errors on each level. While this approach is standard, it can be less…

Driven by several successful applications such as in stochastic gradient descent or in Bayesian computation, control variates have become a major tool for Monte Carlo integration. However, standard methods do not allow the distribution of…

Machine Learning · Statistics 2022-10-06 Rémi Leluc , François Portier , Johan Segers , Aigerim Zhuman

We investigate the applicability of Quasi-Monte Carlo methods to Euclidean lattice systems for quantum mechanics in order to improve the asymptotic error behavior of observables for such theories. In most cases the error of an observable…

High Energy Physics - Lattice · Physics 2013-11-19 K. Jansen , H. Leovey , A. Ammon , A. Griewank , M. Müller-Preussker

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan