English
Related papers

Related papers: Convergence and efficiency of adaptive importance …

200 papers

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance…

Computation · Statistics 2023-03-28 Shanyin Tong , Georg Stadler

Sequential importance sampling algorithms have been defined to estimate likelihoods in models of ancestral population processes. However, these algorithms are based on features of the models with constant population size, and become…

Statistics Theory · Mathematics 2016-03-24 Coralie Merle , Raphaël Leblois , François Rousset , Pierre Pudlo

In this paper, we consider the problem of numerical investigation of the counting statistics for a class of one-dimensional systems. Importance sampling, the cornerstone technique usually implemented for such problems, critically hinges on…

Statistical Mechanics · Physics 2024-08-12 Ivan N. Burenev , Satya N. Majumdar , Alberto Rosso

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

The Adaptive Multiple Importance Sampling (AMIS) algorithm is aimed at an optimal recycling of past simulations in an iterated importance sampling scheme. The difference with earlier adaptive importance sampling implementations like…

Computation · Statistics 2011-10-04 Jean-Marie Cornuet , Jean-Michel Marin , Antonietta Mira , Christian P. Robert

Improving efficiency of importance sampler is at the center of research in Monte Carlo methods. While adaptive approach is usually difficult within the Markov Chain Monte Carlo framework, the counterpart in importance sampling can be…

Methodology · Statistics 2007-12-11 Heng Lian

Increased access to computing resources has led to the development of algorithms that can run efficiently on multi-core processing units or in distributed computing environments. In the context of Bayesian inference, many parallel computing…

Methodology · Statistics 2025-09-11 Daniel Würzler Barreto , Mevin B. Hooten

Importance sampling is a well developed method in statistics. Given a random variable $X$, the problem of estimating its expected value $\mu$ is addressed. The standard approach is to use the sample mean as an estimator $\bar x$. In…

Applications · Statistics 2014-05-09 Georg Hofmann

We present an efficient sampling method for computing a partition function and accelerating configuration sampling. The method performs a random walk in the $\lambda$ space, with $\lambda$ being any thermodynamic variable that characterizes…

Computational Physics · Physics 2010-03-02 Cheng Zhang , Jianpeng Ma

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

We introduce new quantile estimators with adaptive importance sampling. The adaptive estimators are based on weighted samples that are neither independent nor identically distributed. Using a new law of iterated logarithm for martingales,…

Statistics Theory · Mathematics 2010-03-01 Daniel Egloff , Markus Leippold

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

Applications · Statistics 2024-04-11 Jianhua Xian , Ziqi Wang

The weighting of critical-point samples in the weighted randomized maximum likelihood method depend on the magnitude of the data mismatch at the critical points and on the Jacobian of the transformation from the prior density to the…

Methodology · Statistics 2023-01-16 Yuming Ba , Dean S. Oliver

We present the umbrella sampling (US) technique and show that it can be used to sample extremely low probability areas of the posterior distribution that may be required in statistical analyses of data. In this approach sampling of the…

Instrumentation and Methods for Astrophysics · Physics 2018-08-15 Charles Matthews , Jonathan Weare , Andrey Kravtsov , Elise Jennings

Sampling rare events in metastable dynamical systems is often a computationally expensive task and one needs to resort to enhanced sampling methods such as importance sampling. Since we can formulate the problem of finding optimal…

Optimization and Control · Mathematics 2023-10-05 Enric Ribera Borrell , Jannes Quer , Lorenz Richter , Christof Schütte

Bias in datasets can be very detrimental for appropriate statistical estimation. In response to this problem, importance weighting methods have been developed to match any biased distribution to its corresponding target unbiased…

Machine Learning · Computer Science 2022-09-12 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Given a sequence of observations from a discrete-time, finite-state hidden Markov model, we would like to estimate the sampling distribution of a statistic. The bootstrap method is employed to approximate the confidence regions of a…

Computation · Statistics 2009-09-29 Cheng-Der Fuh , Inchi Hu

In this paper, we propose an adaptive algorithm that iteratively updates both the weights and component parameters of a mixture importance sampling density so as to optimise the importance sampling performances, as measured by an entropy…

Computation · Statistics 2009-08-18 Olivier Cappé , Randal Douc , Arnaud Guillin , Jean-Michel Marin , Christian P. Robert

The primary goal of this paper is to provide an efficient solution algorithm based on the augmented Lagrangian framework for optimization problems with a stochastic objective function and deterministic constraints. Our main contribution is…

Optimization and Control · Mathematics 2023-12-29 Raghu Bollapragada , Cem Karamanli , Brendan Keith , Boyan Lazarov , Socratis Petrides , Jingyi Wang

In this paper, we introduce a new algorithm for rare event estimation based on adaptive importance sampling. We consider a smoothed version of the optimal importance sampling density, which is approximated by an ensemble of interacting…

Computation · Statistics 2023-04-19 Konstantin Althaus , Iason Papaioannou , Elisabeth Ullmann