English
Related papers

Related papers: Some variance reduction methods for numerical stoc…

200 papers

We consider the variant of stochastic homogenization theory introduced in [X. Blanc, C. Le Bris and P.-L. Lions, C. R. Acad. Sci. Serie I 2006 and Journal de Mathematiques Pures et Appliquees 2007]. The equation under consideration is a…

Analysis of PDEs · Mathematics 2019-02-20 Frederic Legoll , Florian Thomines

In the day-to-day operation of a power system, the system operator repeatedly solves short-term generation planning problems. When formulating these problems the operators have to weigh the risk of costly failures against increased…

Optimization and Control · Mathematics 2015-12-31 Magnus Perninge

This paper explores the non-convex composition optimization in the form including inner and outer finite-sum functions with a large number of component functions. This problem arises in some important applications such as nonlinear…

Machine Learning · Statistics 2017-11-15 Liu Liu , Ji Liu , Dacheng Tao

In Monte Carlo calculations of expectation values in lattice quantum field theories, the stochastic variance of the sampling procedure that is used defines the precision of the calculation for a fixed number of samples. If the variance of…

High Energy Physics - Lattice · Physics 2022-12-07 Cagin Yunus , William Detmold

Monte Carlo (MC) integration is an important calculational technique in the physical sciences. Practical considerations require that the calculations are performed as accurately as possible for a given set of computational resources. To…

High Energy Physics - Phenomenology · Physics 2024-11-08 Prasanth Shyamsundar , Jacob L. Scott , Stephen Mrenna , Konstantin T. Matchev , Kyoungchul Kong

We are concerned with the numerical resolution of backward stochastic differential equations. We propose a new numerical scheme based on iterative regressions on function bases, which coefficients are evaluated using Monte Carlo…

Probability · Mathematics 2007-05-23 Emmanuel Gobet , Jean-Philippe Lemor , Xavier Warin

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble (GOE), sparse random…

Statistical Mechanics · Physics 2013-05-29 Nen Saito , Yukito Iba , Koji Hukushima

Numerical homogenization methods aim at providing appropriate coarse-scale approximations of solutions to (elliptic) partial differential equations that involve highly oscillatory coefficients. The localized orthogonal decomposition (LOD)…

Numerical Analysis · Mathematics 2026-02-13 Mehdi Elasmi , Felix Krumbiegel , Roland Maier

We introduce a method for non-uniform random number generation based on sampling a physical process in a controlled environment. We demonstrate one proof-of-concept implementation of the method that reduces the error of Monte Carlo…

Other Computer Science · Computer Science 2020-04-24 James Timothy Meech , Phillip Stanley-Marbell

Computing systems interacting with real-world processes must safely and reliably process uncertain data. The Monte Carlo method is a popular approach for computing with such uncertain values. This article introduces a framework for…

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

Improving efficiency of importance sampler is at the center of research in Monte Carlo methods. While adaptive approach is usually difficult within the Markov Chain Monte Carlo framework, the counterpart in importance sampling can be…

Methodology · Statistics 2007-12-11 Heng Lian

Variational inference is increasingly being addressed with stochastic optimization. In this setting, the gradient's variance plays a crucial role in the optimization procedure, since high variance gradients lead to poor convergence. A…

Machine Learning · Computer Science 2020-10-23 Tomas Geffner , Justin Domke

Black-box variational inference performance is sometimes hindered by the use of gradient estimators with high variance. This variance comes from two sources of randomness: Data subsampling and Monte Carlo sampling. While existing control…

Machine Learning · Computer Science 2024-03-11 Xi Wang , Tomas Geffner , Justin Domke

Probability Theory and Statistics are two of the most useful mathematical fields, and also two of the most difficult to learn. In other science fields, as Physics, experimentation is an useful tool to develop students intuition, but the…

Physics Education · Physics 2014-04-08 FM Alexander Bueno , Daniel Manzano

A brief introduction to the technique of Monte Carlo simulations in statistical physics is presented. The topics covered include statistical ensembles random and pseudo random numbers, random sampling techniques, importance sampling, Markov…

Statistical Mechanics · Physics 2016-08-31 K. P. N. Murthy

The basic problem in equilibrium statistical mechanics is to compute phase space average, in which Monte Carlo method plays a very important role. We begin with a review of nonlocal algorithms for Markov chain Monte Carlo simulation in…

Statistical Mechanics · Physics 2007-05-23 Jian-Sheng Wang

We describe a number of strategies for minimizing and calculating accurately the statistical uncertainty in quantum Monte Carlo calculations. We investigate the impact of the sampling algorithm on the efficiency of the variational Monte…

Computational Physics · Physics 2012-02-14 R. M. Lee , G. J. Conduit , N. Nemec , P. Lopez Rios , N. D. Drummond