English
Related papers

Related papers: Estimation of Failure Probabilities via Local Subs…

200 papers

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Motivated by penalized likelihood maximization in complex models, we study optimization problems where neither the function to optimize nor its gradient have an explicit expression, but its gradient can be approximated by a Monte Carlo…

Computation · Statistics 2017-09-28 Gersende Fort , Edouard Ollier , Adeline Samson

In this article we consider Bayesian parameter inference associated to partially-observed stochastic processes that start from a set B0 and are stopped or killed at the first hitting time of a known set A. Such processes occur naturally…

Computation · Statistics 2012-01-19 Ajay Jasra , Nikolas Kantas

In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one…

Large scale Gaussian process (GP) regression is infeasible for larger data sets due to cubic scaling of flops and quadratic storage involved in working with covariance matrices. Remedies in recent literature focus on divide-and-conquer,…

Methodology · Statistics 2020-05-28 Adam M. Edwards , Robert B. Gramacy

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

Machine Learning · Statistics 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

The accurate predictions and principled uncertainty measures provided by GP regression incur O(n^3) cost which is prohibitive for modern-day large-scale applications. This has motivated extensive work on computationally efficient…

Machine Learning · Statistics 2023-12-29 Robert Allison , Anthony Stephenson , Samuel F , Edward Pyzer-Knapp

Evaluating the degree of partisan districting (Gerrymandering) in a statistical framework typically requires an ensemble of districting plans which are drawn from a prescribed probability distribution that adheres to a realistic and…

Computation · Statistics 2020-08-19 Gregory Herschlag , Jonathan C. Mattingly , Matthias Sachs , Evan Wyse

Embarrassingly parallel Markov Chain Monte Carlo (MCMC) exploits parallel computing to scale Bayesian inference to large datasets by using a two-step approach. First, MCMC is run in parallel on (sub)posteriors defined on data partitions.…

Machine Learning · Statistics 2022-03-31 Daniel Augusto de Souza , Diego Mesquita , Samuel Kaski , Luigi Acerbi

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context, one typically…

Methodology · Statistics 2019-10-03 Johan Alenlöv , Arnaud Doucet , Fredrik Lindsten

Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and…

Optimization and Control · Mathematics 2018-06-18 Jiangjiang Zhang , Jun Man , Guang Lin , Laosheng Wu , Lingzao Zeng

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

Sampling the parameters of high-dimensional Continuous Time Markov Chains (CTMC) is a challenging problem with important applications in many fields of applied statistics. In this work a recently proposed type of non-reversible…

Machine Learning · Statistics 2021-06-01 Tingting Zhao , Alexandre Bouchard-Côté

Quantifying uncertainties in physical or engineering systems often requires a large number of simulations of the underlying computer models that are computationally intensive. Emulators or surrogate models are often used to accelerate the…

Methodology · Statistics 2021-11-11 Junda Xiong , Xin Cai , Jinglai Li

Gaussian processes (GPs) are flexible, probabilistic, nonparametric models widely used in fields such as spatial statistics and machine learning. A drawback of Gaussian processes is their computational cost, with $O(N^3)$ time and $O(N^2)$…

Computation · Statistics 2026-05-20 Filippo Rambelli , Fabio Sigrist

Synthetic likelihood (SL) is a strategy for parameter inference when the likelihood function is analytically or computationally intractable. In SL, the likelihood function of the data is replaced by a multivariate Gaussian density over…

Methodology · Statistics 2022-02-21 Umberto Picchini , Umberto Simola , Jukka Corander

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

We propose a few-shot learning method for spatial regression. Although Gaussian processes (GPs) have been successfully used for spatial regression, they require many observations in the target task to achieve a high predictive performance.…

Machine Learning · Statistics 2020-10-12 Tomoharu Iwata , Yusuke Tanaka

Computing the probability of evidence even with known error bounds is NP-hard. In this paper we address this hard problem by settling on an easier problem. We propose an approximation which provides high confidence lower bounds on…

Artificial Intelligence · Computer Science 2012-06-26 Vibhav Gogate , Bozhena Bidyuk , Rina Dechter