English
Related papers

Related papers: Efficient Importance Sampling for the Left Tail of…

200 papers

Gaussian time-series models are often specified through their spectral density. Such models present several computational challenges, in particular because of the non-sparse nature of the covariance matrix. We derive a fast approximation of…

Computation · Statistics 2012-11-20 Nicolas Chopin , Judith Rousseau , Brunero Liseo

Importance sampling Monte-Carlo methods are widely used for the approximation of expectations with respect to partially known probability measures. In this paper we study a deterministic version of such an estimator based on quasi-Monte…

Computation · Statistics 2024-12-20 Josef Dick , Daniel Rudolf , Houying Zhu

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

Importance sampling is a well developed method in statistics. Given a random variable $X$, the problem of estimating its expected value $\mu$ is addressed. The standard approach is to use the sample mean as an estimator $\bar x$. In…

Applications · Statistics 2014-05-09 Georg Hofmann

We consider the question of efficient estimation in the tails of Gaussian copulas. Our special focus is estimating expectations over multi-dimensional constrained sets that have a small implied measure under the Gaussian copula. We propose…

Computation · Statistics 2016-07-06 Kalyani Nagaraj , Jie Xu , Raghu Pasupathy , Soumyadip Ghosh

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

We present a novel technique for tailoring Bayesian quadrature (BQ) to model selection. The state-of-the-art for comparing the evidence of multiple models relies on Monte Carlo methods, which converge slowly and are unreliable for…

Machine Learning · Computer Science 2019-03-04 Henry Chai , Jean-Francois Ton , Roman Garnett , Michael A. Osborne

Approximate Bayesian Computation (ABC) is a powerful method for carrying out Bayesian inference when the likelihood is computationally intractable. However, a drawback of ABC is that it is an approximate method that induces a systematic…

Methodology · Statistics 2015-09-29 Minh Ngoc Tran , Robert Kohn

Importance sampling is a common technique for Monte Carlo approximation, including Monte Carlo approximation of p-values. Here it is shown that a simple correction of the usual importance sampling p-values creates valid p-values, meaning…

Computation · Statistics 2011-04-12 Matthew T. Harrison

Multilevel Monte Carlo is a key tool for approximating integrals involving expensive scientific models. The idea is to use approximations of the integrand to construct an estimator with improved accuracy over classical Monte Carlo. We…

Methodology · Statistics 2023-03-15 Kaiyu Li , Daniel Giles , Toni Karvonen , Serge Guillas , François-Xavier Briol

Importance-weighting is a popular and well-researched technique for dealing with sample selection bias and covariate shift. It has desirable characteristics such as unbiasedness, consistency and low computational complexity. However,…

Machine Learning · Statistics 2019-03-12 Wouter M. Kouw , Marco Loog

We describe a simple Importance Sampling strategy for Monte Carlo simulations based on a least squares optimization procedure. With several numerical examples, we show that such Least Squares Importance Sampling (LSIS) provides efficiency…

Physics and Society · Physics 2008-12-10 Luca Capriotti

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

This paper addresses the issue of estimating the expectation of a real-valued random variable of the form $X = g(\mathbf{U})$ where $g$ is a deterministic function and $\mathbf{U}$ can be a random finite- or infinite-dimensional vector.…

Computational Engineering, Finance, and Science · Computer Science 2015-09-10 Clément Walter

Finite sample properties of random covariance-type matrices have been the subject of much research. In this paper we focus on the "lower tail" of such a matrix, and prove that it is subgaussian under a simple fourth moment assumption on the…

Probability · Mathematics 2013-12-11 Roberto Imbuzeiro Oliveira

We develop an efficient simulation algorithm for computing the tail probabilities of the infinite series $S = \sum_{n \geq 1} a_n X_n$ when random variables $X_n$ are heavy-tailed. As $S$ is the sum of infinitely many random variables, any…

Probability · Mathematics 2016-09-08 Henrik Hult , Sandeep Juneja , Karthyek Murthy

Estimating the expectations of functionals applied to sums of random variables (RVs) is a well-known problem encountered in many challenging applications. Generally, closed-form expressions of these quantities are out of reach. A naive…

Information Theory · Computer Science 2022-10-27 Eya Ben Amar , Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Raúl Tempone

Bayesian inference under a set of priors, called robust Bayesian analysis, allows for estimation of parameters within a model and quantification of epistemic uncertainty in quantities of interest by bounded (or imprecise) probability.…

Computation · Statistics 2022-07-15 Ivette Raices Cruz , Johan Lindström , Matthias C. M. Troffaes , Ullrika Sahlin

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically…

Computation · Statistics 2021-03-22 Matti Vihola , Jouni Helske , Jordan Franks

In this paper, we consider a classic problem concerning the high excursion probabilities of a Gaussian random field $f$ living on a compact set $T$. We develop efficient computational methods for the tail probabilities $P(\sup_T f(t) > b)$…

Probability · Mathematics 2013-10-01 Xiaoou Li , Jingchen Liu