English
Related papers

Related papers: Compositional simulation-based inference for time …

200 papers

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

Approximate Bayesian inference methods that scale to very large datasets are crucial in leveraging probabilistic models for real-world time series. Sparse Markovian Gaussian processes combine the use of inducing variables with efficient…

Machine Learning · Statistics 2021-06-10 William J. Wilkinson , Arno Solin , Vincent Adam

Recently, Stochastic Variational Inference (SVI) has been increasingly attractive thanks to its ability to find good posterior approximations of probabilistic models. It optimizes the variational objective with stochastic optimization,…

Machine Learning · Computer Science 2022-03-16 Minta Liu , Suliang Bu

We introduce a simulation-based, amortised Bayesian inference scheme to infer the parameters of random walks. Our approach learns the posterior distribution of the walks' parameters with a likelihood-free method. In the first step a graph…

Machine Learning · Computer Science 2022-12-07 Hippolyte Verdier , François Laurent , Alhassan Cassé , Christian Vestergaard , Jean-Baptiste Masson

We introduce scalable algorithms for online learning of neural network parameters and Bayesian sequential decision making. Unlike classical Bayesian neural networks, which induce predictive uncertainty through a posterior over model…

Machine Learning · Computer Science 2025-10-10 Gerardo Duran-Martin , Leandro Sánchez-Betancourt , Álvaro Cartea , Kevin Murphy

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

Simulation-based inference (SBI) provides amortized Bayesian parameter inference from simulator-generated data without requiring explicit likelihood evaluation. Its reliability can degrade under model misspecification, where real-world…

Machine Learning · Computer Science 2026-05-18 Joon Jang , Eunho Jeong , Kyu Sung Choi , Hyeonjin Kim

This paper presents a Markov chain Monte Carlo method to generate approximate posterior samples in retrospective multiple changepoint problems where the number of changes is not known in advance. The method uses conjugate models whereby the…

Computation · Statistics 2010-11-15 Jason Wyse , Nial Friel

Simulation-based inference (SBI) is transforming experimental sciences by enabling parameter estimation in complex non-linear models from simulated data. A persistent challenge, however, is model misspecification: simulators are only…

Machine Learning · Statistics 2025-10-20 Pierre-Louis Ruhlmann , Pedro L. C. Rodrigues , Michael Arbel , Florence Forbes

This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each individual learning…

Machine Learning · Computer Science 2014-06-13 Trevor Campbell , Jonathan P. How

Prediction algorithms, such as deep neural networks (DNNs), are used in many domain sciences to directly estimate internal parameters of interest in simulator-based models, especially in settings where the observations include images or…

Machine Learning · Statistics 2023-11-14 Luca Masserano , Tommaso Dorigo , Rafael Izbicki , Mikael Kuusela , Ann B. Lee

Bayesian optimal experimental design (BOED) seeks to maximize the expected information gain (EIG) of experiments. This requires a likelihood estimate, which in many settings is intractable. Simulation-based inference (SBI) provides powerful…

Machine Learning · Computer Science 2026-02-09 Samuel Klein , Willie Neiswanger , Daniel Ratner , Michael Kagan , Sean Gasiorowski

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

The cost of simulator evaluations is a key practical bottleneck for Simulation Based Inference (SBI). In hierarchical settings with shared global parameters and exchangeable site-level parameters and observations, this structure can be…

Machine Learning · Computer Science 2026-04-23 Giovanni Charles , Cosmo Santoni , Seth Flaxman , Elizaveta Semenova

Simulation-based inference (SBI) makes it possible to infer the parameters of a model from high-dimensional low-level features of the observed events. In this work we show how this method can be used to establish the presence of a weak…

High Energy Physics - Phenomenology · Physics 2024-07-31 Kierthika Chathirathas , Torben Ferber , Felix Kahlhoefer , Alessandro Morandini

Amortized Bayesian inference (ABI) with neural networks has emerged as a powerful simulation-based approach for estimating complex mechanistic models. However, extending ABI to hierarchical models, a cornerstone of modern Bayesian analysis,…

Quantitative Methods · Quantitative Biology 2026-04-08 Jonas Arruda , Vikas Pandey , Catherine Sherry , Margarida Barroso , Xavier Intes , Jan Hasenauer , Stefan T. Radev

Bayesian spatial modeling provides a flexible framework for whole-brain fMRI analysis by explicitly incorporating spatial dependencies, overcoming the limitations of traditional massive univariate approaches that lead to information waste.…

Methodology · Statistics 2025-11-18 Yuan Zhong , Gang Chen , Paul A. Taylor , Jian Kang

Bayesian statistical inference loses predictive optimality when generative models are misspecified. Working within an existing coherent loss-based generalisation of Bayesian inference, we show existing Modular/Cut-model inference is…

Methodology · Statistics 2026-05-18 Chris U. Carmona , Geoff K. Nicholls

The logistic specification has been used extensively in non-Bayesian statistics to model the dependence of discrete outcomes on the values of specified covariates. Because the likelihood function is globally weakly concave estimation by…

Computation · Statistics 2013-04-17 John Geweke , Garland Durham , Huaxin Xu

Simulation-based inference methods have been shown to be inaccurate in the data-poor regime, when training simulations are limited or expensive. Under these circumstances, the inference network is particularly prone to overfitting, and…