English
Related papers

Related papers: Pareto Smoothed Importance Sampling

200 papers

This paper proposes a new importance sampling (IS) that is tailored to quasi-Monte Carlo (QMC) integration over $\mathbb{R}^s$. IS introduces a multiplicative adjustment to the integrand by compensating the sampling from the proposal…

Numerical Analysis · Mathematics 2025-09-19 Zexin Pan , Du Ouyang , Zhijian He

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

We consider importance sampling (IS) type weighted estimators based on Markov chain Monte Carlo (MCMC) targeting an approximate marginal of the target distribution. In the context of Bayesian latent variable models, the MCMC typically…

Computation · Statistics 2021-03-22 Matti Vihola , Jouni Helske , Jordan Franks

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

Regularized linear regression under the $\ell_1$ penalty, such as the Lasso, has been shown to be effective in variable selection and sparse modeling. The sampling distribution of an $\ell_1$-penalized estimator $\hat{\beta}$ is hard to…

Methodology · Statistics 2014-12-24 Qing Zhou

One of the main problems of importance sampling in Bayesian networks is representation of the importance function, which should ideally be as close as possible to the posterior joint distribution. Typically, we represent an importance…

Artificial Intelligence · Computer Science 2012-07-09 Changhe Yuan , Marek J. Druzdzel

In survey statistics, the usual technique for estimating a population total consists in summing appropriately weighted variable values for the units in the sample. Different weighting systems exit: sampling weights, GREG weights or…

Methodology · Statistics 2012-01-09 François Coquet , Éric Lesage

The detection of anisotropies with respect to a given direction in a vector field is a common problem in astronomy. Several methods have been proposed that rely on the distribution of the acute angles between the data and a reference…

Instrumentation and Methods for Astrophysics · Physics 2022-03-01 F. Dávila-Kurbán , M. Lares , D. Garcia Lambas

Achieving high efficiency in modern photorealistic rendering hinges on using Monte Carlo sampling distributions that closely approximate the illumination integral estimated for every pixel. Samples are typically generated from a set of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Joey Litalien , Miloš Hašan , Fujun Luan , Krishna Mullia , Iliyan Georgiev

Determining if two histograms are consistent, whether they have been drawn from the same underlying distribution or not, is a common problem in physics. Existing approaches are not only limited in power but also inapplicable to histograms…

Data Analysis, Statistics and Probability · Physics 2010-09-29 M. J. Betancourt

The reliability of a complex industrial system can rarely be assessed analytically. As system failure is often a rare event, crude Monte-Carlo methods are prohibitively expensive from a computational point of view. In order to reduce…

Computation · Statistics 2019-06-03 H. Chraibi , A. Dutfoy , T. Galtier , J. Garnier

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

Hierarchical time series are common in several applied fields. The forecasts for these time series are required to be coherent, that is, to satisfy the constraints given by the hierarchy. The most popular technique to enforce coherence is…

Machine Learning · Statistics 2023-10-13 Lorenzo Zambon , Dario Azzimonti , Giorgio Corani

We introduce a new class of heavy-tailed distributions for which any weighted average of independent and identically distributed random variables is larger than one such random variable in (usual) stochastic order. We show that many…

Probability · Mathematics 2025-06-18 Yuyu Chen , Seva Shneer

Monte Carlo methods are widely used importance sampling techniques for studying complex physical systems. Integrating these methods with deep learning has significantly improved efficiency and accuracy in high-dimensional problems and…

Disordered Systems and Neural Networks · Physics 2024-12-24 Yixiong Ren , Jianhui Zhou

This paper focuses on the study of an original combination of the Multilevel Monte Carlo method introduced by Giles [10] and the popular importance sampling technique. To compute the optimal choice of the parameter involved in the…

Probability · Mathematics 2017-09-05 Mohamed Ben Alaya , Kaouther Hajji , Ahmed Kebaier

A new multivariate distribution possessing arbitrarily parametrized and positively dependent univariate Pareto margins is introduced. Unlike the probability law of Asimit et al. (2010) [Asimit, V., Furman, E. and Vernic, R. (2010) On a…

Risk Management · Quantitative Finance 2016-07-19 Jianxi Su , Edward Furman