English
Related papers

Related papers: Nearly Consistent Finite Particle Estimates in Str…

200 papers

Prediction is a central task of statistics and machine learning, yet many inferential settings provide only partial information, typically in the form of moment constraints or estimating equations. We develop a finite, fully Bayesian…

Statistics Theory · Mathematics 2026-03-20 Nicholas G. Polson , Daniel Zantedeschi

Inference after model selection presents computational challenges when dealing with intractable conditional distributions. Markov chain Monte Carlo (MCMC) is a common method for sampling from these distributions, but its slow convergence…

Methodology · Statistics 2023-08-22 Sifan Liu

We present a new method for conducting Monte Carlo inference in graphical models which combines explicit search with generalized importance sampling. The idea is to reduce the variance of importance sampling by searching for significant…

Machine Learning · Computer Science 2013-01-18 Dale Schuurmans , Finnegan Southey

Bayesian variable selection requires sampling from a posterior distribution that combines discrete model indicators with continuously varying parameters, a challenge often addressed through reversible jump Markov chain Monte Carlo (RJMCMC).…

Methodology · Statistics 2026-05-01 Don van den Bergh , Merlise A. Clyde , Adrian E. Raftery , Maarten Marsman

In Part I (arXiv:1911.00619) of this article, we proposed an importance sampling algorithm to compute rare-event probabilities in forward uncertainty quantification problems. The algorithm, which we termed the "Bayesian Inverse Monte Carlo…

Computation · Statistics 2019-11-06 Siddhant Wahal , George Biros

In Bayesian inverse problems, one aims at characterizing the posterior distribution of a set of unknowns, given indirect measurements. For non-linear/non-Gaussian problems, analytic solutions are seldom available: Sequential Monte Carlo…

Methodology · Statistics 2022-12-26 Alessandro Viani , Adam M Johansen , Alberto Sorrentino

The Effective Sample Size (ESS) is an important measure of efficiency of Monte Carlo methods such as Markov Chain Monte Carlo (MCMC) and Importance Sampling (IS) techniques. In the IS context, an approximation $\widehat{ESS}$ of the…

Computation · Statistics 2016-09-27 L. Martino , V. Elvira , F. Louzada

The Bayesian estimation of the unknown parameters of state-space (dynamical) systems has received considerable attention over the past decade, with a handful of powerful algorithms being introduced. In this paper we tackle the theoretical…

Computation · Statistics 2017-02-13 Joaquin Miguez , Ines P. Mariño , Manuel A. Vazquez

We describe a simple method for making inference on a functional of a multivariate distribution. The method is based on a copula representation of the multivariate distribution and it is based on the properties of an Approximate Bayesian…

Methodology · Statistics 2017-07-18 Clara Grazian , Brunero Liseo

Starting with a set of weighted items, we want to create a generic sample of a certain size that we can later use to estimate the total weight of arbitrary subsets. For this purpose, we propose priority sampling which tested on Internet…

Data Structures and Algorithms · Computer Science 2007-05-23 Nick Duffield , Carsten Lund , Mikkel Thorup

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one…

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context, one typically…

Methodology · Statistics 2019-10-03 Johan Alenlöv , Arnaud Doucet , Fredrik Lindsten

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

We consider the problem of approximating the product of $n$ expectations with respect to a common probability distribution $\mu$. Such products routinely arise in statistics as values of the likelihood in latent variable models. Motivated…

Computation · Statistics 2017-09-05 Anthony Lee , Simone Tiberi , Giacomo Zanella

This paper proposes a new methodology to perform Bayesian inference for a class of multidimensional Cox processes in which the intensity function is piecewise constant. Poisson processes with piecewise constant intensity functions are…

Methodology · Statistics 2022-11-16 Flavio B. Gonçalves , Barbara C. C. Dias

Markov chain Monte Carlo (MCMC) provides a feasible method for inferring Hidden Markov models, however, it is often computationally prohibitive, especially constrained by the curse of dimensionality, as the Monte Carlo sampler traverses…

Artificial Intelligence · Computer Science 2023-09-13 Xiongming Dai , Gerald Baumgartner

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet