English
Related papers

Related papers: Multilevel Monte Carlo with Surrogate Models for R…

200 papers

The Multilevel Monte Carlo method is an efficient variance reduction technique. It uses a sequence of coarse approximations to reduce the computational cost in uncertainty quantification applications. The method is nowadays often considered…

Numerical Analysis · Mathematics 2018-06-15 Pieterjan Robbe , Dirk Nuyens , Stefan Vandewalle

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

Computation · Statistics 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

Variational inference is a powerful paradigm for approximate Bayesian inference with a number of appealing properties, including support for model learning and data subsampling. By contrast MCMC methods like Hamiltonian Monte Carlo do not…

Machine Learning · Statistics 2022-07-14 Martin Jankowiak , Du Phan

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

The development of a reliable and robust surrogate model is often constrained by the dimensionality of the problem. For a system with high-dimensional inputs/outputs (I/O), conventional approaches usually use a low-dimensional manifold to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-01 Xihaier Luo , Ahsan Kareem

I develop a numerical algorithm for stochastic impulse control in the spirit of Regression Monte Carlo for optimal stopping. The approach consists in generating statistical surrogates (aka functional approximators) for the continuation…

Computational Finance · Quantitative Finance 2022-03-15 Mike Ludkovski

Markov Chain Monte Carlo (MCMC) algorithms are often used for approximate inference inside learning, but their slow mixing can be difficult to diagnose and the approximations can seriously degrade learning. To alleviate these issues, we…

Machine Learning · Computer Science 2015-02-25 Jacob Steinhardt , Percy Liang

The recently-introduced self-learning Monte Carlo method is a general-purpose numerical method that speeds up Monte Carlo simulations by training an effective model to propose uncorrelated configurations in the Markov chain. We implement…

Strongly Correlated Electrons · Physics 2017-10-11 Yuki Nagai , Huitao Shen , Yang Qi , Junwei Liu , Liang Fu

We show how to extend a recently proposed multi-level Monte Carlo approach to the continuous time Markov chain setting, thereby greatly lowering the computational complexity needed to compute expected values of functions of the state of the…

Probability · Mathematics 2011-11-23 David F. Anderson , Desmond J. Higham

This paper examines the use of Monte Carlo simulations to understand statistical concepts in A/B testing and Randomized Controlled Trials (RCTs). We discuss the applicability of simulations in understanding false positive rates and estimate…

Applications · Statistics 2024-11-12 Márton Trencséni

We develop the self-learning Monte Carlo (SLMC) method, a general-purpose numerical method recently introduced to simulate many-body systems, for studying interacting fermion systems. Our method uses a highly-efficient update algorithm,…

Strongly Correlated Electrons · Physics 2017-06-14 Junwei Liu , Huitao Shen , Yang Qi , Zi Yang Meng , Liang Fu

Uncertainty propagation of large scale discrete supply chains can be prohibitive when a large number of events occur during the simulated period and discrete event simulations (DES) are costly. We present a time bucket method to approximate…

Computation · Statistics 2019-01-17 Nai-Yuan Chiang , Yinqing Lin , Quan Long

Sampling from high-dimensional distributions has wide applications in data science and machine learning but poses significant computational challenges. We introduce Subspace Langevin Monte Carlo (SLMC), a novel and efficient sampling method…

Machine Learning · Statistics 2025-05-21 Tyler Maunu , Jiayi Yao

Markov chain Monte Carlo methods are a powerful tool for sampling equilibrium configurations in complex systems. One problem these methods often face is slow convergence over large energy barriers. In this work, we propose a novel method…

Computational Physics · Physics 2024-05-29 Luigi Sbailò , Manuel Dibak , Frank Noé

We present a case-study on the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods. Graphics cards, containing multiple Graphics Processing Units (GPUs), are self-contained parallel…

Computation · Statistics 2015-05-05 Anthony Lee , Christopher Yau , Michael B. Giles , Arnaud Doucet , Christopher C. Holmes

The polynomial chaos (PC) expansion has been widely used as a surrogate model in the Bayesian inference to speed up the Markov chain Monte Carlo (MCMC) calculations. However, the use of a PC surrogate introduces the modeling error, that may…

Numerical Analysis · Mathematics 2019-02-20 Liang Yan , Tao Zhou

This position paper summarizes a recently developed research program focused on inference in the context of data centric science and engineering applications, and forecasts its trajectory forward over the next decade. Often one endeavours…

Computation · Statistics 2021-12-06 Ajay Jasra , Kody J. H. Law , Alexander Tarakanov , Fangyuan Yu

We consider the computational efficiency of Monte Carlo (MC) and Multilevel Monte Carlo (MLMC) methods applied to partial differential equations with random coefficients. These arise, for example, in groundwater flow modelling, where a…

Numerical Analysis · Mathematics 2024-12-12 Anastasia Istratuca , Aretha Teckentrup

In this paper, we present a generalisation of the Multilevel Monte Carlo (MLMC) method to a setting where the level parameter is a continuous variable. This Continuous Level Monte Carlo (CLMC) estimator provides a natural framework in PDE…

Numerical Analysis · Mathematics 2018-02-22 Gianluca Detommaso , Tim Dodwell , Rob Scheichl

Due to a hard dependency between time steps, large-scale simulations of gas using the Direct Simulation Monte Carlo (DSMC) method proceed at the pace of the slowest processor. Scalability is therefore achievable only by ensuring that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 William McDoniel , Paolo Bientinesi