English
Related papers

Related papers: Testing Error Correcting Codes by Multicanonical S…

200 papers

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

This paper explores the possibilities and limitations of error correction by the structural simplicity of error mechanisms. Specifically, we consider channel models, called \emph{samplable additive channels}, in which (a) errors are…

Information Theory · Computer Science 2018-05-15 Kenji Yasunaga

Driven by applications in telecommunication networks, we explore the simulation task of estimating rare event probabilities for tandem queues in their steady state. Existing literature has recognized that importance sampling methods can be…

Machine Learning · Computer Science 2025-04-22 Ruoning Zhao , Xinyun Chen

Rare events can potentially occur in many applications. When manifested as opportunities to be exploited, risks to be ameliorated, or certain features to be extracted, such events become of paramount significance. Due to their sporadic…

Information Theory · Computer Science 2012-10-10 Ali Tajer , H. Vincent Poor

In solving simulation-based stochastic root-finding or optimization problems that involve rare events, such as in extreme quantile estimation, running crude Monte Carlo can be prohibitively inefficient. To address this issue, importance…

Methodology · Statistics 2021-02-23 Shengyi He , Guangxin Jiang , Henry Lam , Michael C. Fu

We explore past and recent developments in rare-event probability estimation with a particular focus on a novel Monte Carlo technique Empirical Likelihood Maximization (ELM). This is a versatile method that involves sampling from a sequence…

Computation · Statistics 2013-12-12 A. Huang , Z. I. Botev

A rare event is defined by a low probability of occurrence. Accurate estimation of such small probabilities is of utmost importance across diverse domains. Conventional Monte Carlo methods are inefficient, demanding an exorbitant number of…

Machine Learning · Computer Science 2023-10-31 Zhenggqi Gao , Dinghuai Zhang , Luca Daniel , Duane S. Boning

The probability of rare and extreme events is an important quantity for design purposes. However, computing the probability of rare events can be expensive because only a few events, if any, can be observed. To this end, it is necessary to…

Computational Physics · Physics 2020-01-08 Malik Hassanaly , Venkat Raman

This paper studies the use of a machine learning-based estimator as a control variate for mitigating the variance of Monte Carlo sampling. Specifically, we seek to uncover the key factors that influence the efficiency of control variates in…

Statistics Theory · Mathematics 2023-05-29 Jose Blanchet , Haoxuan Chen , Yiping Lu , Lexing Ying

We introduce and illustrate a number of performance measures for rare-event sampling methods. These measures are designed to be of use in a variety of expanded ensemble techniques including parallel tempering as well as infinite and partial…

Statistical Mechanics · Physics 2015-06-23 J. D. Doll , Paul Dupuis

We propose and analyze a generalized splitting method to sample approximately from a distribution conditional on the occurrence of a rare event. This has important applications in a variety of contexts in operations research, engineering,…

Methodology · Statistics 2019-09-10 Zdravko I. Botev , Pierre L'Ecuyer

It is often necessary to make sampling-based statistical inference about many probability distributions in parallel. Given a finite computational resource, this article addresses how to optimally divide sampling effort between the samplers…

Methodology · Statistics 2015-02-18 Nicholas Heard , Melissa Turcotte

Quasi-Monte Carlo sampling can attain far better accuracy than plain Monte Carlo sampling. However, with plain Monte Carlo sampling it is much easier to estimate the attained accuracy. This article describes methods old and new to quantify…

Numerical Analysis · Mathematics 2025-07-16 Art B. Owen

Rare events in non-linear dynamical systems are difficult to sample because of the sensitivity to perturbations of initial conditions and of complex landscapes in phase space. Here we discuss strategies to control these difficulties and…

Statistical Mechanics · Physics 2019-04-18 Jorge C. Leitao , Joao M. V. P. Lopes , Eduardo G. Altmann

Expectation values of physical quantities may accurately be obtained by the evaluation of integrals within Many-Body Quantum mechanics, and these multi-dimensional integrals may be estimated using Monte Carlo methods. In a previous…

Computational Physics · Physics 2009-10-01 J. R. Trail

The combination of continuum Many-Body Quantum physics and Monte Carlo methods provide a powerful and well established approach to first principles calculations for large systems. Replacing the exact solution of the problem with a…

Computational Physics · Physics 2009-10-01 J. R. Trail

In Part I (arXiv:1911.00619) of this article, we proposed an importance sampling algorithm to compute rare-event probabilities in forward uncertainty quantification problems. The algorithm, which we termed the "Bayesian Inverse Monte Carlo…

Computation · Statistics 2019-11-06 Siddhant Wahal , George Biros

A computer code can simulate a system's propagation of variation from random inputs to output measures of quality. Our aim here is to estimate a critical output tail probability or quantile without a large Monte Carlo experiment. Instead,…

Machine Learning · Statistics 2019-08-16 Hao Chen , William J. Welch

This paper presents a novel method for rare event detection from an image pair with class-imbalanced datasets. A straightforward approach for event detection tasks is to train a detection network from a large-scale dataset in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Ryuhei Hamaguchi , Ken Sakurada , Ryosuke Nakamura

Computation of extreme quantiles and tail-based risk measures using standard Monte Carlo simulation can be inefficient. A method to speed up computations is provided by importance sampling. We show that importance sampling algorithms,…

Probability · Mathematics 2009-09-21 Henrik Hult , Jens Svensson