English
Related papers

Related papers: Some variance reduction methods for numerical stoc…

200 papers

We present simple and practical strategies to reduce the variance of Monte Carlo estimators. Our focus is on variational Monte Carlo calculations of atomic forces and pressure in electronic systems, although we show that the underlying…

Strongly Correlated Electrons · Physics 2026-03-17 David Linteau , Saverio Moroni , Giuseppe Carleo , Markus Holzmann

In this paper we study homogenization of a class of control problems in a stationary and ergodic random environment. This problem has been mostly studied in the calculus of variations setting in connection to the homogenization of the…

Analysis of PDEs · Mathematics 2018-06-21 Alexander Van-Brunt

While nowadays most gradient-based optimization methods focus on exploring the high-dimensional geometric features, the random error accumulated in a stochastic version of any algorithm implementation has not been stressed yet. In this…

Machine Learning · Computer Science 2020-08-14 Tong Yang , Long Sha , Pengyu Hong

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

Quantum mechanics for many-body systems may be reduced to the evaluation of integrals in 3N dimensions using Monte-Carlo, providing the Quantum Monte Carlo ab initio methods. Here we limit ourselves to expectation values for trial…

Computational Physics · Physics 2010-11-22 John Robert Trail , Ryo Maezono

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

Fabrication process variations are a major source of yield degradation in the nano-scale design of integrated circuits (IC), microelectromechanical systems (MEMS) and photonic circuits. Stochastic spectral methods are a promising technique…

Computational Engineering, Finance, and Science · Computer Science 2016-11-08 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

Methods for generating sequences of surrogates approximating fine scale models of two-phase random heterogeneous media are presented that are designed to adaptively control the modeling error in key quantities of interest (QoIs). For…

Numerical Analysis · Mathematics 2019-03-07 Laura Scarabosio , Barbara Wohlmuth , J. Tinsley Oden , Danial Faghihi

Gradient-based Monte Carlo sampling algorithms, like Langevin dynamics and Hamiltonian Monte Carlo, are important methods for Bayesian inference. In large-scale settings, full-gradients are not affordable and thus stochastic gradients…

Machine Learning · Computer Science 2019-06-25 Zhize Li , Tianyi Zhang , Shuyu Cheng , Jun Zhu , Jian Li

Stochastic spectral methods have become a popular technique to quantify the uncertainties of nano-scale devices and circuits. They are much more efficient than Monte Carlo for certain design cases with a small number of random parameters.…

Computational Engineering, Finance, and Science · Computer Science 2016-03-22 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

Variational Monte Carlo (VMC) is a powerful and fast-growing method for optimizing and evolving parameterized many-body wave functions, especially with modern neural-network quantum states. In practice, however, the stochastic estimators…

Strongly Correlated Electrons · Physics 2026-03-20 Zhou-Quan Wan , Roeland Wiersema , Shiwei Zhang

We introduce a variant of the Hybrid Monte Carlo (HMC) algorithm to address large-deviation statistics in stochastic hydrodynamics. Based on the path-integral approach to stochastic (partial) differential equations, our HMC algorithm…

Computational Physics · Physics 2019-10-29 G. Margazoglou , L. Biferale , R. Grauer , K. Jansen , D. Mesterházy , T. Rosenow , R. Tripiccione

A minimal requirement for simulating multi-scale systems is to reproduce the statistical behavior of the slow variables. In particular, a good numerical method should accurately aproximate the probability density function of the…

Dynamical Systems · Mathematics 2018-04-13 J. Frank , G. A. Gottwald

This paper investigates a novel a-posteriori variance reduction approach in Monte Carlo image synthesis. Unlike most established methods based on lateral filtering in the image space, our proposition is to produce the best possible estimate…

Graphics · Computer Science 2019-06-04 Oskar Elek , Manu M. Thomas , Angus Forbes

Numerical homogenization of multiscale equations typically requires taking an average of the solution to a microscale problem. Both the boundary conditions and domain size of the microscale problem play an important role in the accuracy of…

Numerical Analysis · Mathematics 2024-04-03 Sean P. Carney , Milica Dussinger , Bjorn Engquist

We propose a novel numerical homogenization method based on the edge multiscale approach for solving indefinite time-harmonic Maxwell equations in heterogeneous media with large wavenumber. Numerical methods for these equations in…

Numerical Analysis · Mathematics 2026-04-27 Yueqi Wang , Wing Tat Leung , Guanglian Li

Random numbers play a crucial role in science and industry. Many numerical methods require the use of random numbers, in particular the Monte Carlo method. Therefore it is of paramount importance to have efficient random number generators.…

Computational Physics · Physics 2010-05-25 Helmut G. Katzgraber

Sequential Monte Carlo (SMC) methods are a class of Monte Carlo methods that are used to obtain random samples of a high dimensional random variable in a sequential fashion. Many problems encountered in applications often involve different…

Methodology · Statistics 2018-12-20 Chencheng Cai , Rong Chen , Ming Lin

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

Probability · Mathematics 2015-09-29 Konstantinos Spiliopoulos