English
Related papers

Related papers: Posterior SBC: Simulation-Based Calibration Checki…

200 papers

This paper presents recent methodological advances to perform simulation-based inference (SBI) of a general class of Bayesian hierarchical models (BHMs), while checking for model misspecification. Our approach is based on a two-step…

Methodology · Statistics 2022-11-03 Florent Leclercq

Stochastic simulation aims to compute output performance for complex models that lack analytical tractability. To ensure accurate prediction, the model needs to be calibrated and validated against real data. Conventional methods approach…

Methodology · Statistics 2021-05-28 Yuanlu Bai , Tucker Balch , Haoxian Chen , Danial Dervovic , Henry Lam , Svitlana Vyetrenko

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

Model checking is usually based on a comprehensive traversal of the state space. Causality-based model checking is a radically different approach that instead analyzes the cause-effect relationships in a program. We give an overview on a…

Logic in Computer Science · Computer Science 2017-10-11 Bernd Finkbeiner , Andrey Kupriyanov

Discovery of an accurate causal Bayesian network structure from observational data can be useful in many areas of science. Often the discoveries are made under uncertainty, which can be expressed as probabilities. To guide the use of such…

Artificial Intelligence · Computer Science 2017-12-27 Fattaneh Jabbari , Mahdi Pakdaman Naeini , Gregory F. Cooper

Scientists and engineers employ stochastic numerical simulators to model empirically observed phenomena. In contrast to purely statistical models, simulators express scientific principles that provide powerful inductive biases, improve…

From simulating galaxy formation to viral transmission in a pandemic, scientific models play a pivotal role in developing scientific theories and supporting government policy decisions that affect us all. Given these critical applications,…

Software Engineering · Computer Science 2023-07-03 Andrew G. Clark , Michael Foster , Benedikt Prifling , Neil Walkinshaw , Robert M. Hierons , Volker Schmidt , Robert D. Turner

Simulation-based inference (SBI) provides a powerful framework for inferring posterior distributions of stochastic simulators in a wide range of domains. In many settings, however, the posterior distribution is not the end goal itself --…

Machine Learning · Computer Science 2023-12-19 Mila Gorecki , Jakob H. Macke , Michael Deistler

Theoretical guarantees for causal inference using propensity scores are partly based on the scores behaving like conditional probabilities. However, scores between zero and one, especially when outputted by flexible statistical estimators,…

Methodology · Statistics 2024-11-12 Rom Gutman , Ehud Karavani , Yishai Shimoni

Most classification models work by first predicting a posterior probability distribution over all classes and then selecting that class with the largest estimated probability. In many settings however, the quality of posterior probability…

Computation and Language · Computer Science 2020-05-04 Taehee Jung , Dongyeop Kang , Hua Cheng , Lucas Mentch , Thomas Schaaf

Computational models are invaluable in capturing the complexities of real-world biological processes. Yet, the selection of appropriate algorithms for inference tasks, especially when dealing with real-world observational data, remains a…

Applications · Statistics 2024-10-01 Xiaoyu Wang , Ryan P. Kelly , Adrianne L. Jenner , David J. Warne , Christopher Drovandi

Model uncertainty is pervasive in real world analysis situations and is an often-neglected issue in applied statistics. However, standard approaches to the research process do not address the inherent uncertainty in model building and,…

Methodology · Statistics 2024-03-01 Mariana Nold , Florian Meinfelder , David Kaplan

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Variable selection for regression models plays a key role in the analysis of biomedical data. However, inference after selection is not covered by classical statistical frequentist theory which assumes a fixed set of covariates in the…

Methodology · Statistics 2021-07-21 Michael Kammer , Daniela Dunkler , Stefan Michiels , Georg Heinze

Bayesian simulation-based inference (SBI) methods are used in statistical models where simulation is feasible but the likelihood is intractable. Standard SBI methods can perform poorly in cases of model misspecification, and there has been…

Methodology · Statistics 2025-04-15 Wang Yuyan , Michael Evans , David J. Nott

In biomedical research, repeated measurements within each subject are often processed to remove artifacts and unwanted sources of variation. The resulting data are used to construct derived outcomes that act as proxies for scientific…

Methodology · Statistics 2026-02-03 Zihang Wang , Razieh Nabi , Benjamin B. Risk

It is common practice in statistical data analysis to perform data-driven variable selection and derive statistical inference from the resulting model. Such inference enjoys none of the guarantees that classical statistical theory provides…

Statistics Theory · Mathematics 2013-06-06 Richard Berk , Lawrence Brown , Andreas Buja , Kai Zhang , Linda Zhao

Scientists and engineers use simulators to model empirically observed phenomena. However, tuning the parameters of a simulator to ensure its outputs match observed data presents a significant challenge. Simulation-based inference (SBI)…

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Conservative inference is a major concern in simulation-based inference. It has been shown that commonly used algorithms can produce overconfident posterior approximations. Balancing has empirically proven to be an effective way to mitigate…

Machine Learning · Statistics 2023-04-24 Arnaud Delaunoy , Benjamin Kurt Miller , Patrick Forré , Christoph Weniger , Gilles Louppe