English
Related papers

Related papers: Multilevel Adaptive Sparse Grid Quadrature for Mon…

200 papers

We introduce a variant of the multi-grid Monte Carlo (MGMC) method, based on the embedding of an $XY$ model into the target model, and we study its mathematical properties for a variety of nonlinear $\sigma$-models. We then apply the method…

High Energy Physics - Lattice · Physics 2011-07-19 Tereza Mendes , Andrea Pelissetto , Alan D. Sokal

In this paper we propose a new class of coupling methods for the sensitivity analysis of high dimensional stochastic systems and in particular for lattice Kinetic Monte Carlo. Sensitivity analysis for stochastic systems is typically based…

Numerical Analysis · Mathematics 2015-06-18 Georgios Arampatzis , Markos Katsoulakis

In the following article we consider approximate Bayesian computation (ABC) inference. We introduce a method for numerically approximating ABC posteriors using the multilevel Monte Carlo (MLMC). A sequential Monte Carlo version of the…

Methodology · Statistics 2017-02-14 Ajay Jasra , Seongil Jo , David Nott , Christine Shoemaker , Raul Tempone

We consider the theoretical analysis of Multiscale Sampling Methods, which are a new class of gradient-free Markov chain Monte Carlo (MCMC) methods for high dimensional inverse differential equation problems. A detailed presentation of…

Methodology · Statistics 2025-03-06 Lucas Seiffert , Felipe Pereira

In this paper we consider sequential joint state and static parameter estimation given discrete time observations associated to a partially observed stochastic partial differential equation (SPDE). It is assumed that one can only estimate…

Numerical Analysis · Mathematics 2020-09-11 Yaxian Xu , Ajay Jasra , Kody J. H. Law

This paper is a broad and accessible survey of the methods we have at our disposal for Monte Carlo gradient estimation in machine learning and across the statistical sciences: the problem of computing the gradient of an expectation of a…

Machine Learning · Statistics 2020-09-30 Shakir Mohamed , Mihaela Rosca , Michael Figurnov , Andriy Mnih

We study the feature-scaled version of the Monte Carlo algorithm with linear function approximation. This algorithm converges to a scale-invariant solution, which is not unduly affected by states having feature vectors with large norms. The…

Machine Learning · Computer Science 2022-05-31 Rahul Madhavan , Hemanta Makwana

We consider stochastic optimization when one only has access to biased stochastic oracles of the objective and the gradient, and obtaining stochastic gradients with low biases comes at high costs. This setting captures various optimization…

Optimization and Control · Mathematics 2024-08-22 Yifan Hu , Jie Wang , Xin Chen , Niao He

Distributed learning methods have gained substantial momentum in recent years, with communication overhead often emerging as a critical bottleneck. Gradient compression techniques alleviate communication costs but involve an inherent…

Machine Learning · Computer Science 2025-07-09 Ze'ev Zukerman , Bassel Hamoud , Kfir Y. Levy

Continuous level Monte Carlo is an unbiased, continuous version of the celebrated multilevel Monte Carlo method. The approximation level is assumed to be continuous resulting in a stochastic process describing the quantity of interest.…

Numerical Analysis · Mathematics 2024-02-19 Cedric Aaron Beschle , Andrea Barth

Lattice simulations are an important class of problems in crystalline solids, surface science, alloys, adsorption, absorption, separation, catalysis, to name a few. We describe a fast computational method for performing lattice…

Statistical Mechanics · Physics 2023-07-24 Suhail Haque , Abhijit Chatterjee

Monte Carlo (MC) methods are widely used for Bayesian inference and optimization in statistics, signal processing and machine learning. A well-known class of MC methods are Markov Chain Monte Carlo (MCMC) algorithms. In order to foster…

Computation · Statistics 2016-09-27 L. Martino , V. Elvira , D. Luengo , J. Corander , F. Louzada

A kinetic Monte Carlo (KMC) method is presented to simulate the electrodeposition of a metal on a single crystal surface of the same metal under galvanostatic conditions. This method utilizes the multi-body embedded-atom method (EAM)…

Chemical Physics · Physics 2014-01-08 Tanyakarn Treeratanaphitak , Mark D. Pritzker , Nasser Mohieddin Abukhdeir

Stochastic partial differential equations (SPDEs) are often difficult to solve numerically due to their low regularity and high dimensionality. These challenges limit the practical use of computer-aided studies and pose significant barriers…

Numerical Analysis · Mathematics 2025-02-04 Abdul-Lateef Haji-Ali , Håkon Hoel , Andreas Petersson

Active subspaces can effectively reduce the dimension of high-dimensional parameter studies enabling otherwise infeasible experiments with expensive simulations. The key components of active subspace methods are the eigenvectors of a…

Numerical Analysis · Mathematics 2015-07-03 Paul Constantine , David Gleich

Stochastic PDE eigenvalue problems often arise in the field of uncertainty quantification, whereby one seeks to quantify the uncertainty in an eigenvalue, or its eigenfunction. In this paper we present an efficient multilevel quasi-Monte…

Numerical Analysis · Mathematics 2022-10-07 Alexander D. Gilbert , Robert Scheichl

We present a multilevel stochastic gradient descent method for the optimal control of systems governed by partial differential equations under uncertain input data. The gradient descent method used to find the optimal control leverages a…

Optimization and Control · Mathematics 2025-06-04 Niklas Baumgarten , David Schneiderhan

Monte Carlo simulations of quantum field theories on a lattice become increasingly expensive as the continuum limit is approached since the cost per independent sample grows with a high power of the inverse lattice spacing. Simulations on…

High Energy Physics - Lattice · Physics 2021-01-04 Karl Jansen , Eike Hermann Müller , Robert Scheichl

In this article, we analyse the accuracy and computational complexity of estimators for expected functionals of the solution to multi-dimensional parabolic stochastic partial differential equations (SPDE) of Zakai-type. Here, we use the…

Numerical Analysis · Mathematics 2019-04-18 Christoph Reisinger , Zhenru Wang

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou