English
Related papers

Related papers: Single-Index Importance Sampling with Stratificati…

200 papers

A rare event is defined by a low probability of occurrence. Accurate estimation of such small probabilities is of utmost importance across diverse domains. Conventional Monte Carlo methods are inefficient, demanding an exorbitant number of…

Machine Learning · Computer Science 2023-10-31 Zhenggqi Gao , Dinghuai Zhang , Luca Daniel , Duane S. Boning

Models and methods that are able to accurately and efficiently predict the flows of low-speed rarefied gases are in high demand, due to the increasing ability to manufacture devices at micro and nano scales. One such model and method is a…

Computational Physics · Physics 2016-09-21 Benjamin Collyer , Colm Connaughton , Duncan Lockerby

We present a Multi-Index Quasi-Monte Carlo method for the solution of elliptic partial differential equations with random coefficients. By combining the multi-index sampling idea with randomly shifted rank-1 lattice rules, the algorithm…

Numerical Analysis · Mathematics 2017-06-20 Pieterjan Robbe , Dirk Nuyens , Stefan Vandewalle

Simulated tempering (ST) is an established Markov chain Monte Carlo (MCMC) method for sampling from a multimodal density $\pi(\theta)$. Typically, ST involves introducing an auxiliary variable $k$ taking values in a finite subset of $[0,1]$…

Computation · Statistics 2008-11-03 Robert B. Gramacy , Richard J. Samworth , Ruth King

A central challenge to applying many off-policy reinforcement learning algorithms to real world problems is the variance introduced by importance sampling. In off-policy learning, the agent learns about a different policy than the one being…

Machine Learning · Computer Science 2022-06-20 Eric Graves , Sina Ghiassian

Minibatching is a very well studied and highly popular technique in supervised learning, used by practitioners due to its ability to accelerate training through better utilization of parallel processing power and reduction of stochastic…

Machine Learning · Computer Science 2016-02-09 Dominik Csiba , Peter Richtárik

A sequential importance sampling algorithm is developed for the distribution that results when a matrix of independent, but not identically distributed, Bernoulli random variables is conditioned on a given sequence of row and column sums.…

Computation · Statistics 2013-01-18 Matthew T. Harrison , Jeffrey W. Miller

Automated Vehicle (AV) validation based on simulated testing requires unbiased evaluation and high efficiency. One effective solution is to increase the exposure to risky rare events while reweighting the probability measure. However,…

Machine Learning · Computer Science 2024-09-25 Yichun Ye , He Zhang , Ye Tian , Jian Sun , Karl Meinke

Importance-weighting is a popular and well-researched technique for dealing with sample selection bias and covariate shift. It has desirable characteristics such as unbiasedness, consistency and low computational complexity. However,…

Machine Learning · Statistics 2019-03-12 Wouter M. Kouw , Marco Loog

In the field of structural reliability, the Monte-Carlo estimator is considered as the reference probability estimator. However, it is still untractable for real engineering cases since it requires a high number of runs of the model. In…

Methodology · Statistics 2015-03-19 V. Dubourg , F. Deheeger , B. Sudret

We consider estimating the marginal likelihood in settings with independent and identically distributed (i.i.d.) data. We propose estimating the predictive distributions in a sequential factorization of the marginal likelihood in such…

Machine Learning · Statistics 2019-11-19 Scott A. Cameron , Hans C. Eggers , Steve Kroon

Random-effects meta-analyses have been widely applied in evidence synthesis for various types of medical studies. However, standard inference methods (e.g. restricted maximum likelihood estimation) usually underestimate statistical errors…

Methodology · Statistics 2019-05-13 Shonosuke Sugasawa , Hisashi Noma

Estimating rare events in complex systems is a key challenge in reliability analysis. The challenge grows in multimodal problems, where traditional methods often rely on a small set of design points and risk overlooking critical failure…

Computation · Statistics 2025-08-04 Sara Helal , Victor Elvira

We consider the problem of adaptive stratified sampling for Monte Carlo integration of a noisy function, given a finite budget n of noisy evaluations to the function. We tackle in this paper the problem of adapting to the function at the…

Machine Learning · Statistics 2013-03-13 Alexandra Carpentier , Remi Munos

Markov chain Monte Carlo methods are a powerful and commonly used family of numerical methods for sampling from complex probability distributions. As applications of these methods increase in size and complexity, the need for efficient…

Numerical Analysis · Mathematics 2019-01-31 Colin Cotter , Simon Cotter , Paul Russell

Importance sampling has been reported to produce algorithms with excellent empirical performance in counting problems. However, the theoretical support for its efficiency in these applications has been very limited. In this paper, we…

Probability · Mathematics 2009-08-10 Jose H. Blanchet

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang

How to turn the flip of a coin into a random variable whose expected value equals a scattering amplitude? We answer this question by constructing a numerical algorithm to evaluate curve integrals - a novel formulation of scattering…

High Energy Physics - Theory · Physics 2025-03-12 Giulio Salvatori

The problem of optimising functions with intractable gradients frequently arise in machine learning and statistics, ranging from maximum marginal likelihood estimation procedures to fine-tuning of generative models. Stochastic approximation…

Machine Learning · Statistics 2026-01-30 James Cuin , Davide Carbone , Yanbo Tang , O. Deniz Akyildiz

We consider the problem of forecasting debt recovery from large portfolios of non-performing unsecured consumer loans under management. The state of the art in industry is to use stochastic processes to approximately model payment behaviour…

Computation · Statistics 2022-10-26 Sam Baynes , Simon Cotter , Paul Russell , Edmund Ryan , Timothy Waite