English
Related papers

Related papers: Calibrated Model Criticism Using Split Predictive …

200 papers

Simulation-based calibration (SBC) is a method for validating inference algorithms and model implementations through repeated inference on data simulated from a generative model. For a model to be generative, one must specify proper priors.…

Methodology · Statistics 2025-05-26 Luna Fazio , Maximilian Scholz , Javier Enrique Aguilar , Paul-Christian Bürkner

In high-dimensional prediction problems, where the number of features may greatly exceed the number of training instances, fully Bayesian approach with a sparsifying prior is known to produce good results but is computationally challenging.…

Methodology · Statistics 2018-10-15 Juho Piironen , Aki Vehtari

In prediction problems, it is common to model the data-generating process and then use a model-based procedure, such as a Bayesian predictive distribution, to quantify uncertainty about the next observation. However, if the posited model is…

Methodology · Statistics 2021-07-06 Pei-Shien Wu , Ryan Martin

We address the Statistical Process Control (SPC) of high-dimensional, dynamic industrial processes from two complementary perspectives: manifold fitting and manifold learning, both of which assume data lies on an underlying nonlinear, lower…

Machine Learning · Statistics 2025-09-25 Burak I. Tas , Enrique del Castillo

To check the accuracy of Bayesian computations, it is common to use rank-based simulation-based calibration (SBC). However, SBC has drawbacks: The test statistic is somewhat ad-hoc, interactions are difficult to examine, multiple testing is…

Machine Learning · Statistics 2023-10-31 Yuling Yao , Justin Domke

Bayesian modelling enables us to accommodate complex forms of data and make a comprehensive inference, but the effect of partial misspecification of the model is a concern. One approach in this setting is to modularize the model, and…

Methodology · Statistics 2026-03-18 Yang Liu , Robert J. B. Goudie

Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In…

Machine Learning · Computer Science 2019-02-19 Vladimir Vovk , Ivan Petej , Paolo Toccaceli , Alex Gammerman

Autonomous systems with machine learning-based perception can exhibit unpredictable behaviors that are difficult to quantify, let alone verify. Such behaviors are convenient to capture in probabilistic models, but probabilistic model…

Logic in Computer Science · Computer Science 2022-03-17 Matthew Cleaveland , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

Typically, discrete choice modelers develop ever-more advanced models and estimation methods. Compared to the impressive progress in model development and estimation, model-checking techniques have lagged behind. Often, choice modelers use…

Applications · Statistics 2018-10-02 Timothy Brathwaite

Data-enabled predictive control (DeePC) is a recently proposed approach that combines system identification, estimation and control in a single optimization problem, for which only recorded input/output data of the examined system is…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Felix Fiedler , Sergio Lucia

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Split conformal prediction is a computationally efficient method for performing distribution-free predictive inference in regression. It involves, however, a one-time random split of the data, and the result depends on the particular split.…

Methodology · Statistics 2021-07-22 Aldo Solari , Vera Djordjilović

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

Machine Learning · Statistics 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis

Datasets are growing not just in size but in complexity, creating a demand for rich models and quantification of uncertainty. Bayesian methods are an excellent fit for this demand, but scaling Bayesian inference is a challenge. In response…

Machine Learning · Statistics 2016-03-23 Elaine Angelino , Matthew James Johnson , Ryan P. Adams

This paper introduces Smart Predict Then Control (SPC), a control aware refinement procedure for model based control. SPC refines a prediction oriented model by optimizing a surrogate objective that evaluates candidate models through the…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Jiachen Li , Shihao Li , Dongmei Chen

We develop a theoretical framework for sample splitting in A/B testing environments, where data for each test are partitioned into two splits to measure methodological performance when the true impacts of tests are unobserved. We show that…

Econometrics · Economics 2026-03-24 Ryan Kessler , James McQueen , Miikka Rokkanen

This paper presents a new supervised representation learning framework, namely structured probabilistic coding (SPC), to learn compact and informative representations from input related to the target task. SPC is an encoder-only…

Computation and Language · Computer Science 2024-05-03 Dou Hu , Lingwei Wei , Yaxin Liu , Wei Zhou , Songlin Hu

In recent years, the increasing interest in Stochastic model predictive control (SMPC) schemes has highlighted the limitation arising from their inherent computational demand, which has restricted their applicability to slow-dynamics and…

Systems and Control · Electrical Eng. & Systems 2020-05-22 Martina Mammarella , Teodoro Alamo , Fabrizio Dabbene , Matthias Lorenzen

Modern distributed systems include a class of applications in which non-functional requirements are important. In particular, these applications include multimedia facilities where real time constraints are crucial to their correct…

Multimedia · Computer Science 2007-05-23 Jeremy Bryans , Howard Bowman , John Derrick

This paper presents a sample-efficient data-driven method to design model predictive control (MPC) for cable-actuated soft robotics using Bayesian optimization. Instead of modeling the complex dynamics of the soft robots, the proposed…

Robotics · Computer Science 2022-10-18 Anuj Pal , Tianyi He , Wenpeng Wei