English
Related papers

Related papers: Calibrated Model Criticism Using Split Predictive …

200 papers

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

We propose a Similarity-Based Stratified Splitting (SBSS) technique, which uses both the output and input space information to split the data. The splits are generated using similarity functions among samples to place similar samples in…

Machine Learning · Computer Science 2020-10-14 Felipe Farias , Teresa Ludermir , Carmelo Bastos-Filho

This paper presents a distributed stochastic model predictive control (SMPC) approach for large-scale linear systems with private and common uncertainties in a plug-and-play framework. Using the so-called scenario approach, the centralized…

Optimization and Control · Mathematics 2019-01-09 V. Rostampour , T. Keviczky

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr

Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by…

Machine Learning · Computer Science 2019-11-05 Vladimir Vovk , Ivan Petej , Ilia Nouretdinov , Valery Manokhin , Alex Gammerman

Conformal Prediction (CP) is a distribution-free framework for constructing statistically rigorous prediction sets. While popular variants such as CD-split improve CP's efficiency, they often yield prediction sets composed of multiple…

Machine Learning · Statistics 2025-09-29 Mingyi Zheng , Hongyu Jiang , Yizhou Lu , Jiaye Teng

The partitioning problem is of central relevance for designing and implementing non-centralized Model Predictive Control (MPC) strategies for large-scale systems. These control approaches include decentralized MPC, distributed MPC,…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Alessandro Riccardi , Luca Laurenti , Bart De Schutter

Bayesian analyses combine information represented by different terms in a joint Bayesian model. When one or more of the terms is misspecified, it can be helpful to restrict the use of information from suspect model components to modify…

Methodology · Statistics 2022-06-27 Xuejun Yu , David J. Nott , Michael Stanley Smith

Predictive coding (PC) is an influential theory of information processing in the brain, providing a biologically plausible alternative to backpropagation. It is motivated in terms of Bayesian inference, as hidden states and parameters are…

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling…

Methodology · Statistics 2018-09-26 Xiaowu Dai , Peter Chien

We propose a multiple imputation method based on principal component analysis (PCA) to deal with incomplete continuous data. To reflect the uncertainty of the parameters from one imputation to the next, we use a Bayesian treatment of the…

Methodology · Statistics 2015-08-20 Vincent Audigier , François Husson , Julie Josse

Simulation-based calibration checking (SBC) refers to the validation of an inference algorithm and model implementation through repeated inference on data simulated from a generative model. In the original and commonly used approach, the…

Methodology · Statistics 2025-03-11 Teemu Säilynoja , Marvin Schmitt , Paul-Christian Bürkner , Aki Vehtari

Missing data are often dealt with multiple imputation. A crucial part of the multiple imputation process is selecting sensible models to generate plausible values for incomplete data. A method based on posterior predictive checking is…

Computation · Statistics 2026-05-14 Mingyang Cai , Stef van Buuren , Gerko Vink

Statistical Model Checking (SMC) is a trade-off between testing and formal verification. The core idea of the approach is to conduct some simulations of the system and verify if they satisfy some given property. In this paper we show that…

Software Engineering · Computer Science 2011-11-03 Peter Bulychev , Alexandre David , Kim Guldstrand Larsen , Marius Mikučionis , Axel Legay

Verifying the correctness of Bayesian computation is challenging. This is especially true for complex models that are common in practice, as these require sophisticated model implementations and algorithms. In this paper we introduce…

Methodology · Statistics 2020-10-22 Sean Talts , Michael Betancourt , Daniel Simpson , Aki Vehtari , Andrew Gelman

In the manufacturing industry, it is very important to keep machines and processes running smoothly and without unexpected problems. One of the most common tools used to check if everything is working properly is called Statistical Process…

Artificial Intelligence · Computer Science 2026-02-02 Mohammad Iqbal Rasul Seeam

We study the problem of semantic segmentation calibration. Lots of solutions have been proposed to approach model miscalibration of confidence in image classification. However, to date, confidence calibration research on semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dongdong Wang , Boqing Gong , Liqiang Wang

Stochastic model predictive control (SMPC) has been a promising solution to complex control problems under uncertain disturbances. However, traditional SMPC approaches either require exact knowledge of probabilistic distributions, or rely…

Optimization and Control · Mathematics 2020-01-03 Chao Shang , Fengqi You

We explore various estimators for the parameters of a pair-copula construction (PCC), among those the stepwise semiparametric (SSP) estimator, designed for this dependence structure. We present its asymptotic properties, as well as the…

Statistics Theory · Mathematics 2013-03-21 Ingrid Hobæk Haff

Admixture models are a ubiquitous approach to capture latent population structure in genetic samples. Despite the widespread application of admixture models, little thought has been devoted to the quality of the model fit or the accuracy of…

Methodology · Statistics 2015-11-12 David Mimno , David M Blei , Barbara E Engelhardt