English
Related papers

Related papers: Importance Sampling with the Integrated Nested Lap…

200 papers

The Bayesian approach to inverse problems provides a rigorous framework for the incorporation and quantification of uncertainties in measurements, parameters and models. We are interested in designing numerical methods which are robust…

Numerical Analysis · Mathematics 2020-06-29 Claudia Schillings , Björn Sprungk , Philipp Wacker

This work proposes a novel method through which local information about the target density can be used to construct an efficient importance sampler. The backbone of the proposed method is the Incremental Mixture Importance Sampling (IMIS)…

Computation · Statistics 2016-11-22 Matteo Fasiolo , Flávio Eler de Melo , Simon Maskell

A method for sequential inference of the fixed parameters of a dynamic latent Gaussian models is proposed and evaluated that is based on the iterated Laplace approximation. The method provides a useful trade-off between computational…

Methodology · Statistics 2015-09-29 Tiep Mai , Simon Wilson

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

Joint models for longitudinal and time-to-event data are increasingly used in health research to characterize the association between biomarker trajectories and the risk of clinical events. However, these models usually assume a linear…

Methodology · Statistics 2026-04-21 Denis Rustand , Håvard Rue , Lisa Le Gall , Karen Leffondre

Importance sampling (IS) and numerical integration methods are usually employed for approximating moments of complicated target distributions. In its basic procedure, the IS methodology randomly draws samples from a proposal distribution…

Computation · Statistics 2022-04-12 Víctor Elvira , Luca Martino , Pau Closas

Current implementations of multiresolution methods are limited in terms of possible types of responses and approaches to inference. We provide a multiresolution approach for spatial analysis of non-Gaussian responses using latent Gaussian…

Methodology · Statistics 2020-05-27 John Paige , Geir-Arne Fuglstad , Andrea Riebler , Jon Wakefield

Annealed Importance Sampling (AIS) is a popular algorithm used to estimates the intractable marginal likelihood of deep generative models. Although AIS is guaranteed to provide unbiased estimate for any set of hyperparameters, the common…

Machine Learning · Statistics 2022-10-11 Shirin Goshtasbpour , Fernando Perez-Cruz

Importance sampling is a popular technique in Bayesian inference: by reweighting samples drawn from a proposal distribution we are able to obtain samples and moment estimates from a Bayesian posterior over latent variables. Recent work,…

Computation · Statistics 2024-06-19 Sam Bowyer , Thomas Heap , Laurence Aitchison

Statistical applications often involve the calculation of intractable multidimensional integrals. The Laplace formula is widely used to approximate such integrals. However, in high-dimensional or small sample size problems, the shape of the…

Computation · Statistics 2016-12-30 Erlis Ruli , Nicola Sartori , Laura Ventura

The widespread adoption of large language models (LLMs) across industries has increased the demand for high-quality and customizable outputs. However, traditional alignment methods often require retraining large pretrained models, making it…

Computation and Language · Computer Science 2025-12-16 Yi Liu , Dianqing Liu , Mingye Zhu , Junbo Guo , Yongdong Zhang , Zhendong Mao

Accurately estimating the informativeness of individual samples in a dataset is an important objective in deep learning, as it can guide sample selection, which can improve model efficiency and accuracy by removing redundant or potentially…

Machine Learning · Computer Science 2025-05-22 Johannes Kaiser , Kristian Schwethelm , Daniel Rueckert , Georgios Kaissis

In this paper we address the problem of performing Bayesian inference for the parameters of a nonlinear multi-output model and the covariance matrix of the different output signals. We propose an adaptive importance sampling (AIS) scheme…

Computation · Statistics 2025-01-03 E. Curbelo , L. Martino , F. Llorente , D. Delgado-Gomez

We propose an adaptive importance sampling scheme for Gaussian approximations of intractable posteriors. Optimization-based approximations like variational inference can be too inaccurate while existing Monte Carlo methods can be too slow.…

Computation · Statistics 2025-02-04 Willem van den Boom , Andrea Cremaschi , Alexandre H. Thiery

Importance sampling is a popular method for efficient computation of various properties of a distribution such as probabilities, expectations, quantiles etc. The output of an importance sampling algorithm can be represented as a weighted…

Probability · Mathematics 2016-04-18 Henrik Hult , Pierre Nyquist

Aligning large language models (LLMs) to diverse human preferences is fundamentally challenging since criteria can often conflict with each other. Inference-time alignment methods have recently gained popularity as they allow LLMs to be…

Machine Learning · Statistics 2026-02-03 Shokichi Takakura , Akifumi Wachi , Rei Higuchi , Kohei Miyaguchi , Taiji Suzuki

Spatio-temporal Bayesian inference drives environmental and health sciences using latent Gaussian models. Integrated Nested Laplace Approximations (INLA) enable inference for these models at HPC scale but rely on derivative-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Afif Boudaoud , Lisa Gaedke-Merzhäuser , Alexandros Nikolaos Ziogas , Vincent Maillou , Alexandru Calotoiu , Marcin Copik , Håvard Rue , Mathieu Luisier , Torsten Hoefler

We investigate two options for performing Bayesian inference on spatial log-Gaussian Cox processes assuming a spatially continuous latent field: Markov chain Monte Carlo (MCMC) and the integrated nested Laplace approximation (INLA). We…

Computation · Statistics 2012-03-20 Benjamin M. Taylor , Peter J. Diggle

In calculating expected information gain in optimal Bayesian experimental design, the computation of the inner loop in the classical double-loop Monte Carlo requires a large number of samples and suffers from underflow if the number of…

Numerical Analysis · Mathematics 2018-04-04 Joakim Beck , Ben Mansour Dia , Luis FR Espath , Quan Long , Raul Tempone

Cure models in survival analysis deal with populations in which a part of the individuals cannot experience the event of interest. Mixture cure models consider the target population as a mixture of susceptible and non-susceptible…

Computation · Statistics 2018-06-26 Elena Lázaro , Carmen Armero , Virgilio Gómez-Rubio