English
Related papers

Related papers: Parallelized integrated nested Laplace approximati…

200 papers

We investigate two options for performing Bayesian inference on spatial log-Gaussian Cox processes assuming a spatially continuous latent field: Markov chain Monte Carlo (MCMC) and the integrated nested Laplace approximation (INLA). We…

Computation · Statistics 2012-03-20 Benjamin M. Taylor , Peter J. Diggle

Measurement error (ME) and missing values in covariates are often unavoidable in disciplines that deal with data, and both problems have separately received considerable attention during the past decades. However, while most researchers are…

Methodology · Statistics 2023-03-28 Emma Sofie Skarstein , Sara Martino , Stefanie Muff

Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Feng Zhou , Jun Zhu

The Bayesian paradigm has the potential to solve core issues of deep neural networks such as poor calibration and data inefficiency. Alas, scaling Bayesian inference to large weight spaces often requires restrictive approximations. In this…

Background: We aimed to design a Bayesian adaption trial through extensive simulations to determine values for key design parameters, demonstrate error rates, and establish the expected sample size. The complexity of the proposed outcome…

Bayesian hierarchical models are increasingly popular for realistic modelling and analysis of complex data. This trend is accompanied by the need for flexible, general, and computationally efficient methods for model criticism and conflict…

Methodology · Statistics 2017-11-02 Egil Ferkingstad , Leonhard Held , Håvard Rue

Robust time series analysis is an important subject in statistical modeling. Models based on Gaussian distribution are sensitive to outliers, which may imply in a significant degradation in estimation performance as well as in prediction…

Large neural networks trained on large datasets have become the dominant paradigm in machine learning. These systems rely on maximum likelihood point estimates of their parameters, precluding them from expressing model uncertainty. This may…

Machine Learning · Statistics 2024-05-01 Javier Antoran

Large-scale linear models are ubiquitous throughout machine learning, with contemporary application as surrogate models for neural network uncertainty quantification; that is, the linearised Laplace method. Alas, the computational cost…

This paper proposes a bootstrap-assisted procedure to conduct simultaneous inference for high dimensional sparse linear models based on the recent de-sparsifying Lasso estimator (van de Geer et al. 2014). Our procedure allows the dimension…

Statistics Theory · Mathematics 2016-03-07 Xianyang Zhang , Guang Cheng

Double hierarchical generalized linear models (DHGLM) are a family of models that are flexible enough as to model hierarchically the mean and scale parameters. In a Bayesian framework, fitting highly parameterized hierarchical models is…

Methodology · Statistics 2022-01-20 Mabel Morales-Otero , Virgilio Gómez-Rubio , Vicente Núñez-Antón

Deep neural networks (DNNs) often produce overconfident out-of-distribution predictions, motivating Bayesian uncertainty quantification. The Linearized Laplace Approximation (LLA) achieves this by linearizing the DNN and applying Laplace…

Machine Learning · Statistics 2026-02-04 Pedro Jiménez , Luis A. Ortega , Pablo Morales-Álvarez , Daniel Hernández-Lobato

Bayesian structural equation modelling (BSEM) offers many advantages such as principled uncertainty quantification, small-sample regularisation, and flexible model specification. However, the Markov chain Monte Carlo (MCMC) methods on which…

Computation · Statistics 2026-05-20 Haziq Jamil , Håvard Rue

Markov chain Monte Carlo (MCMC) methods remain the mainstay of Bayesian estimation of structural equation models (SEM), though they often incur a high computational cost. We present a bespoke approximate Bayesian approach to SEM, drawing on…

Methodology · Statistics 2026-05-20 Haziq Jamil , Håvard Rue

A method for sequential inference of the fixed parameters of a dynamic latent Gaussian models is proposed and evaluated that is based on the iterated Laplace approximation. The method provides a useful trade-off between computational…

Methodology · Statistics 2015-09-29 Tiep Mai , Simon Wilson

Current implementations of multiresolution methods are limited in terms of possible types of responses and approaches to inference. We provide a multiresolution approach for spatial analysis of non-Gaussian responses using latent Gaussian…

Methodology · Statistics 2020-05-27 John Paige , Geir-Arne Fuglstad , Andrea Riebler , Jon Wakefield

Machine learning models, and deep neural networks in particular, are increasingly deployed in risk-sensitive domains such as healthcare, environmental forecasting, and finance, where reliable quantification of predictive uncertainty is…

Machine Learning · Computer Science 2026-04-07 Asena Karolin Özdemir , Lars H. Heyen , Arvid Weyrauch , Achim Streit , Markus Götz , Charlotte Debus

Spatio-temporal Bayesian inference drives environmental and health sciences using latent Gaussian models. Integrated Nested Laplace Approximations (INLA) enable inference for these models at HPC scale but rely on derivative-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Afif Boudaoud , Lisa Gaedke-Merzhäuser , Alexandros Nikolaos Ziogas , Vincent Maillou , Alexandru Calotoiu , Marcin Copik , Håvard Rue , Mathieu Luisier , Torsten Hoefler

The multi-resolution approximation (MRA) of Gaussian processes was recently proposed to conduct likelihood-based inference for massive spatial data sets. An advantage of the methodology is that it can be parallelized. We implemented the MRA…

Computation · Statistics 2019-05-07 Huang Huang , Lewis R. Blake , Dorit M. Hammerling

The integrated nested Laplace approximation (INLA) is a well-known and popular technique for spatial modeling with a user-friendly interface in the R-INLA package. Unfortunately, only a certain class of latent Gaussian models are amenable…

Methodology · Statistics 2021-03-19 Aaron Osgood-Zimmerman , Jon Wakefield