English
Related papers

Related papers: Bayesian inference with tmbstan for a state-space …

200 papers

Marginal-likelihood based model-selection, even though promising, is rarely used in deep learning due to estimation difficulties. Instead, most approaches rely on validation data, which may not be readily available. In this work, we present…

Machine Learning · Statistics 2021-06-16 Alexander Immer , Matthias Bauer , Vincent Fortuin , Gunnar Rätsch , Mohammad Emtiyaz Khan

In computational mechanics, multiple models are often present to describe a physical system. While Bayesian model selection is a helpful tool to compare these models using measurement data, it requires the computationally expensive…

Computation · Statistics 2025-04-14 Subhayan De , Reza Farzad , Patrick T. Brewick , Erik A. Johnson , Steven F. Wojtkiewicz

Bayesian inference with stochastic models is often difficult because their likelihood functions involve high-dimensional integrals. Approximate Bayesian Computation (ABC) avoids evaluating the likelihood function and instead infers model…

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

Bayesian neural network posterior distributions have a great number of modes that correspond to the same network function. The abundance of such modes can make it difficult for approximate inference methods to do their job. Recent work has…

Machine Learning · Statistics 2024-07-03 Tommy Rochussen

Optimal state estimation for linear discrete-time systems is considered. Motivated by the literature on differential privacy, the measurements are assumed to be corrupted by Laplace noise. The optimal least mean square error estimate of the…

Optimization and Control · Mathematics 2016-09-02 Farhad Farokhi , Jezdimir Milosevic , Henrik Sandberg

Generalized additive models (GAMs) are a well-established statistical tool for modeling complex nonlinear relationships between covariates and a response assumed to have a conditional distribution in the exponential family. In this article,…

Methodology · Statistics 2021-03-02 Oswaldo Gressani , Philippe Lambert

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

Machine Learning · Computer Science 2024-01-24 Sebastian W. Ober

Stochastic systems in biology often exhibit substantial variability within and between cells. This variability, as well as having dramatic functional consequences, provides information about the underlying details of the system's behaviour.…

Quantitative Methods · Quantitative Biology 2015-11-09 Iain G. Johnston

varstan is an \proglang{R} package for Bayesian analysis of time series models using \proglang{Stan}. The package offers a dynamic way to choose a model, define priors in a wide range of distributions, check model's fit, and forecast with…

Computation · Statistics 2020-05-22 Izhar Asael Alonzo Matamoros , Cristian Andres Cruz Torres

State-space mixed-frequency vector autoregressions are now widely used for nowcasting. Despite their popularity, estimating such models can be computationally intensive, especially for large systems with stochastic volatility. To tackle the…

Econometrics · Economics 2021-12-22 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

Bayesian neural networks often approximate the weight-posterior with a Gaussian distribution. However, practical posteriors are often, even locally, highly non-Gaussian, and empirical performance deteriorates. We propose a simple parametric…

Machine Learning · Statistics 2023-06-13 Federico Bergamin , Pablo Moreno-Muñoz , Søren Hauberg , Georgios Arvanitidis

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr

Bayesian inference tasks continue to pose a computational challenge. This especially holds for spatial-temporal modeling where high-dimensional latent parameter spaces are ubiquitous. The methodology of integrated nested Laplace…

Computation · Statistics 2023-03-28 Lisa Gaedke-Merzhäuser , Elias Krainski , Radim Janalik , Håvard Rue , Olaf Schenk

Scientific knowledge expands by observing the world, hypothesizing some theories about it, and testing them against collected data. When those theories take the form of statistical models, statistical analyses are involved in the process of…

Machine Learning · Statistics 2026-03-11 Arnaud Delaunoy

Scientists continue to develop increasingly complex mechanistic models to reflect their knowledge more realistically. Statistical inference using these models can be challenging since the corresponding likelihood function is often…

Computation · Statistics 2026-01-07 Joshua J Bon , David J Warne , David J Nott , Christopher Drovandi

The integrated nested Laplace approximation (INLA) is a well-known and popular technique for spatial modeling with a user-friendly interface in the R-INLA package. Unfortunately, only a certain class of latent Gaussian models are amenable…

Methodology · Statistics 2021-03-19 Aaron Osgood-Zimmerman , Jon Wakefield

We propose a fast and theoretically grounded method for Bayesian variable selection and model averaging in latent variable regression models. Our framework addresses three interrelated challenges: (i) intractable marginal likelihoods, (ii)…

Methodology · Statistics 2025-09-16 Gregor Zens , Mark F. J. Steel

Laplace approximations are popular techniques for endowing deep networks with epistemic uncertainty estimates as they can be applied without altering the predictions of the trained network, and they scale to large models and datasets. While…

Machine Learning · Computer Science 2024-11-01 Tristan Cinquin , Marvin Pförtner , Vincent Fortuin , Philipp Hennig , Robert Bamler

When dealing with datasets containing a billion instances or with simulations that require a supercomputer to execute, computational resources become part of the equation. We can improve the efficiency of learning and inference by…

Machine Learning · Computer Science 2014-03-06 Max Welling