English
Related papers

Related papers: Machine-learning-assisted Monte Carlo fails at sam…

200 papers

Optimization algorithms and Monte Carlo sampling algorithms have provided the computational foundations for the rapid growth in applications of statistical machine learning in recent years. There is, however, limited theoretical…

Machine Learning · Statistics 2022-06-08 Yi-An Ma , Yuansi Chen , Chi Jin , Nicolas Flammarion , Michael I. Jordan

The Self-Learning Monte Carlo (SLMC) method is a Monte Carlo approach that has emerged in recent years by integrating concepts from machine learning with conventional Monte Carlo techniques. Designed to accelerate the numerical study of…

Strongly Correlated Electrons · Physics 2025-07-18 Gaopei Pan , Chuang Chen , Zi Yang Meng

The preferential sampling of locations chosen to observe a spatio-temporal process has been identified as a major problem across multiple fields. Predictions of the process can be severely biased when standard statistical methodologies are…

Methodology · Statistics 2020-03-05 Joe Watson

Determinantal points processes are a promising but relatively under-developed tool in machine learning and statistical modelling, being the canonical statistical example of distributions with repulsion. While their mathematical formulation…

Machine Learning · Computer Science 2022-03-31 Nicholas P Baskerville

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

Methodology · Statistics 2018-05-07 Jeremie Houssineau , Branko Ristic

We propose a Multi-level Monte Carlo technique to accelerate Monte Carlo sampling for approximation of properties of materials with random defects. The computational efficiency is investigated on test problems given by tight-binding models…

Numerical Analysis · Mathematics 2016-11-30 Petr Plecháč , Erik von Schwerin

We present a new method for conducting Monte Carlo inference in graphical models which combines explicit search with generalized importance sampling. The idea is to reduce the variance of importance sampling by searching for significant…

Machine Learning · Computer Science 2013-01-18 Dale Schuurmans , Finnegan Southey

The celebrated Monte Carlo method estimates an expensive-to-compute quantity by random sampling. Bandit-based Monte Carlo optimization is a general technique for computing the minimum of many such expensive-to-compute quantities by adaptive…

Machine Learning · Computer Science 2021-04-30 Vivek Bagaria , Tavor Z. Baharav , Govinda M. Kamath , David N. Tse

Population Monte Carlo (PMC) sampling methods are powerful tools for approximating distributions of static unknowns given a set of observations. These methods are iterative in nature: at each step they generate samples from a proposal…

Computation · Statistics 2022-01-17 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

Leveraging the coherent exploration of Hamiltonian flow, Hamiltonian Monte Carlo produces computationally efficient Monte Carlo estimators, even with respect to complex and high-dimensional target distributions. When confronted with…

Methodology · Statistics 2015-02-06 M. J. Betancourt

We examine the zero-temperature Metropolis Monte Carlo algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis…

Machine Learning · Computer Science 2022-08-11 Stephen Whitelam , Viktor Selin , Ian Benlolo , Corneel Casert , Isaac Tamblyn

Algorithms based on Monte-Carlo sampling have been widely adapted in robotics and other areas of engineering due to their performance robustness. However, these sampling-based approaches have high computational requirements, making them…

Robotics · Computer Science 2020-07-16 Yanqi Liu , Giuseppe Calderoni , R. Iris Bahar

We investigate Monte Carlo based algorithms for solving stochastic control problems with probabilistic constraints. Our motivation comes from microgrid management, where the controller tries to optimally dispatch a diesel generator while…

Optimization and Control · Mathematics 2024-02-06 Alessandro Balata , Michael Ludkovski , Aditya Maheshwari , Jan Palczewski

Using fermionic representation of spin degrees of freedom within the Popov-Fedotov approach we develop an algorithm for Monte Carlo sampling of skeleton Feynman diagrams for Heisenberg type models. Our scheme works without modifications for…

Strongly Correlated Electrons · Physics 2013-02-07 Sergey Kulagin , Nikolay Prokof'ev , Oleg Starykh , Boris Svistunov , Christopher N. Varney

Importance sampling is a Monte Carlo method which designs estimators of expectations under a target distribution using weighted samples from a proposal distribution. When the target distribution is complex, such as multimodal distributions…

Methodology · Statistics 2026-02-04 Anas Cherradi , Yazid Janati , Alain Durmus , Sylvain Le Corff , Yohan Petetin , Julien Stoehr

An alternative to Monte Carlo techniques requiring large sampling times is presented here. Ideas from a genetic algorithm are used to select the best initial states from many independent, parallel Metropolis-Hastings iterations that are run…

Statistical Mechanics · Physics 2018-01-30 Thomas E. Baker

Optimizing or sampling complex cost functions of combinatorial optimization problems is a longstanding challenge across disciplines and applications. When employing family of conventional algorithms based on Markov Chain Monte Carlo (MCMC)…

Machine Learning · Computer Science 2025-08-15 Dmitrii Dobrynin , Masoud Mohseni , John Paul Strachan

Sequential Monte Carlo (SMC) methods are a class of Monte Carlo methods that are used to obtain random samples of a high dimensional random variable in a sequential fashion. Many problems encountered in applications often involve different…

Methodology · Statistics 2018-12-20 Chencheng Cai , Rong Chen , Ming Lin

This paper is a broad and accessible survey of the methods we have at our disposal for Monte Carlo gradient estimation in machine learning and across the statistical sciences: the problem of computing the gradient of an expectation of a…

Machine Learning · Statistics 2020-09-30 Shakir Mohamed , Mihaela Rosca , Michael Figurnov , Andriy Mnih

A procedure for unfolding the true distribution from experimental data is presented. Machine learning methods are applied for simultaneous identification of an apparatus function and solving of an inverse problem. A priori information about…

Data Analysis, Statistics and Probability · Physics 2011-05-26 Nikolai Gagunashvili