English
Related papers

Related papers: Mixed neural posterior estimation for simulators w…

200 papers

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Simulation-based inference (SBI) solves statistical inverse problems by repeatedly running a stochastic simulator and inferring posterior distributions from model-simulations. To improve simulation efficiency, several inference methods take…

Machine Learning · Statistics 2022-11-11 Michael Deistler , Pedro J Goncalves , Jakob H Macke

Federated Bayesian neural networks require fixing a prior on the model parameters together with a likelihood. Eliciting meaningful priors on the weight space of modern overparameterized models is notoriously difficult, and misspecification…

Machine Learning · Computer Science 2026-05-19 Boning Zhang , Matteo Zecchin , Mingzhao Guo , Dongzhu Liu , Osvaldo Simeone

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Neural PDE solvers offer a powerful tool for modeling complex dynamical systems, but often struggle with error accumulation over long time horizons and maintaining stability and physical consistency. We introduce a multiscale implicit…

Machine Learning · Computer Science 2025-06-06 Ruoxi Jiang , Xiao Zhang , Karan Jakhar , Peter Y. Lu , Pedram Hassanzadeh , Michael Maire , Rebecca Willett

The development of mechanistic models of physical systems is essential for understanding their behavior and formulating predictions that can be validated experimentally. Calibration of these models, especially for complex systems, requires…

Neural and Evolutionary Computing · Computer Science 2024-12-04 Jakob Huhle , Jakob Kaiser , Eric Müller , Johannes Schemmel

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

Embedding techniques have become essential components of large databases in the deep learning era. By encoding discrete entities, such as words, items, or graph nodes, into continuous vector spaces, embeddings facilitate more efficient…

Information Retrieval · Computer Science 2024-10-18 Shiwei Li , Zhuoqi Hu , Xing Tang , Haozhao Wang , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

A Neural Process (NP) estimates a stochastic process implicitly defined with neural networks given a stream of data, rather than pre-specifying priors already known, such as Gaussian processes. An ideal NP would learn everything from data…

Machine Learning · Computer Science 2023-04-20 Hyungi Lee , Eunggu Yun , Giung Nam , Edwin Fong , Juho Lee

Ensembles of deep neural networks demonstrate improved performance over single models. For enhancing the diversity of ensemble members while keeping their performance, particle-based inference methods offer a promising approach from a…

Machine Learning · Computer Science 2022-06-03 Shingo Yashima , Teppei Suzuki , Kohta Ishikawa , Ikuro Sato , Rei Kawakami

Background: In medical imaging, images are usually treated as deterministic, while their uncertainties are largely underexplored. Purpose: This work aims at using deep learning to efficiently estimate posterior distributions of imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-03-20 Xiaofeng Liu , Thibault Marin , Tiss Amal , Jonghye Woo , Georges El Fakhri , Jinsong Ouyang

We introduce Sequential Neural Posterior Score Estimation (SNPSE), a score-based method for Bayesian inference in simulator-based models. Our method, inspired by the remarkable success of score-based methods in generative modelling,…

Machine Learning · Statistics 2024-06-04 Louis Sharrock , Jack Simons , Song Liu , Mark Beaumont

There is a growing interest in studying sequential neural posterior estimation (SNPE) techniques due to their advantages for simulation-based models with intractable likelihoods. The methods aim to learn the posterior from adaptively…

Computation · Statistics 2025-10-16 Xiliang Yang , Yifei Xiong , Zhijian He

We report the application of implicit likelihood inference to the prediction of the macro-parameters of strong lensing systems with neural networks. This allows us to perform deep learning analysis of lensing systems within a well-defined…

Instrumentation and Methods for Astrophysics · Physics 2023-01-25 Ronan Legin , Yashar Hezaveh , Laurence Perreault-Levasseur , Benjamin Wandelt

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

One of the core problems in statistical models is the estimation of a posterior distribution. For topic models, the problem of posterior inference for individual texts is particularly important, especially when dealing with data streams,…

Machine Learning · Statistics 2016-08-18 Khoat Than , Tung Doan

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of…

Machine Learning · Computer Science 2022-11-28 Jonas Beck , Michael Deistler , Yves Bernaerts , Jakob Macke , Philipp Berens

In many domains, scientists build complex simulators of natural phenomena that encode their hypotheses about the underlying processes. These simulators can be deterministic or stochastic, fast or slow, constrained or unconstrained, and so…

Machine Learning · Statistics 2014-12-10 Edward Meeds , Michael Chiang , Mary Lee , Olivier Cinquin , John Lowengrub , Max Welling