English
Related papers

Related papers: A probabilistic diagnostic for Laplace approximati…

200 papers

Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides…

Machine Learning · Computer Science 2024-03-15 Andreas Besginow , Jan David Hüwel , Thomas Pawellek , Christian Beecks , Markus Lange-Hegermann

We consider Bayesian variable selection in sparse high-dimensional regression, where the number of covariates $p$ may be large relative to the samples size $n$, but at most a moderate number $q$ of covariates are active. Specifically, we…

Statistics Theory · Mathematics 2015-03-31 Rina Foygel Barber , Mathias Drton , Kean Ming Tan

The integrated nested Laplace approximation (INLA) method has become a popular approach for computationally efficient approximate Bayesian computation. In particular, by leveraging sparsity in random effect precision matrices, INLA is…

Methodology · Statistics 2024-07-02 Finn Lindgren , Fabian Bachl , Janine Illian , Man Ho Suen , Håvard Rue , Andrew E. Seaton

We consider the problem of estimating states and parameters in a model based on a system of coupled stochastic differential equations, based on noisy discrete-time data. Special attention is given to nonlinear dynamics and state-dependent…

Methodology · Statistics 2025-04-01 Uffe Høgsbro Thygesen , Kasper Kristensen

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

A method for sequential inference of the fixed parameters of a dynamic latent Gaussian models is proposed and evaluated that is based on the iterated Laplace approximation. The method provides a useful trade-off between computational…

Methodology · Statistics 2015-09-29 Tiep Mai , Simon Wilson

Bayesian estimation of a mixed quantum state can be approximated via maximum likelihood (MaxLike) estimation when the likelihood function is sharp around its maximum. Such approximations rely on asymptotic expansions of multi-dimensional…

Quantum Physics · Physics 2016-07-05 Pierre Six , Pierre Rouchon

The Laplace approximation provides a scalable and efficient means of quantifying weight-space uncertainty in deep neural networks, enabling the application of Bayesian tools such as predictive uncertainty and model selection via Occam's…

Machine Learning · Computer Science 2025-07-24 Tobias Weber , Bálint Mucsányi , Lenard Rommel , Thomas Christie , Lars Kasüschke , Marvin Pförtner , Philipp Hennig

This paper considers the problem of estimating probabilities of the form $\mathbb{P}(Y \leq w)$, for a given value of $w$, in the situation that a sample of i.i.d.\ observations $X_1, \ldots, X_n$ of $X$ is available, and where we…

Methodology · Statistics 2016-02-01 Arnoud V. den Boer , Michel Mandjes

The local volatility model is a widely used for pricing and hedging financial derivatives. While its main appeal is its capability of reproducing any given surface of observed option prices---it provides a perfect fit---the essential…

Computational Finance · Quantitative Finance 2019-01-24 Martin Tegnér , Stephen Roberts

An estimation method is proposed for a wide variety of discrete time stochastic processes that have an intractable likelihood function but are otherwise conveniently specified by an integral transform such as the characteristic function,…

Statistics Theory · Mathematics 2009-09-29 T. Merkouris

Misclassified variables used in regression models, either as a covariate or as the response, may lead to biased estimators and incorrect inference. Even though Bayesian models to adjust for misclassification error exist, it has not been…

Methodology · Statistics 2024-11-26 Emma Skarstein , Leonardo Soares Bastos , Håvard Rue , Stefanie Muff

Bayesian formulations of deep learning have been shown to have compelling theoretical properties and offer practical functional benefits, such as improved predictive uncertainty quantification and model selection. The Laplace approximation…

Machine Learning · Computer Science 2022-03-15 Erik Daxberger , Agustinus Kristiadi , Alexander Immer , Runa Eschenhagen , Matthias Bauer , Philipp Hennig

Partial penalized tests provide flexible approaches to testing linear hypotheses in high dimensional generalized linear models. However, because the estimators used in these tests are local minimizers of potentially non-convex…

Statistics Theory · Mathematics 2024-08-02 Tate Jacobson

Bayesian inference requires approximation methods to become computable, but for most of them it is impossible to quantify how close the approximation is to the true posterior. In this work, we present a theorem upper-bounding the KL…

Machine Learning · Statistics 2017-11-27 Guillaume P. Dehaene

Model selection is an important activity in modern data analysis and the conventional Bayesian approach to this problem involves calculation of marginal likelihoods for different models, together with diagnostics which examine specific…

Computation · Statistics 2008-10-31 David J. Nott , Robert J. Kohn , Mark Fielding

Approximate Bayesian inference for the class of latent Gaussian models can be achieved efficiently with integrated nested Laplace approximations (INLA). Based on recent reformulations in the INLA methodology, we propose a further extension…

Methodology · Statistics 2025-02-27 Shourya Dutta , Janet van Niekerk , Haavard Rue

This paper develops a comprehensive probabilistic setup to compute approximating functions in active subspaces. Constantine et al. proposed the active subspace method in (Constantine et al., 2014) to reduce the dimension of computational…

Probability · Mathematics 2019-04-09 Mario Teixeira Parente

Integrated Nested Laplace Approximations (INLA) has been a successful approximate Bayesian inference framework since its proposal by Rue et al. (2009). The increased computational efficiency and accuracy when compared with sampling-based…

Methodology · Statistics 2025-10-02 Janet van Niekerk , Elias Krainski , Denis Rustand , Haavard Rue