English
Related papers

Related papers: Approximate Models and Robust Decisions

200 papers

Linearly transforming stimulus representations of deep neural networks yields high-performing models of behavioral and neural responses to complex stimuli. But does the test accuracy of such predictions identify genuine representational…

Neurons and Cognition · Quantitative Biology 2026-01-05 Itamar Avitan , Tal Golan

Virtually any model we use in machine learning to make predictions does not perfectly represent reality. So, most of the learning happens under model misspecification. In this work, we present a novel analysis of the generalization…

Machine Learning · Computer Science 2020-10-23 Andres R. Masegosa

Modern imaging techniques heavily rely on Bayesian statistical models to address difficult image reconstruction and restoration tasks. This paper addresses the objective evaluation of such models in settings where ground truth is…

Image and Video Processing · Electrical Eng. & Systems 2026-05-29 Tom Sprunck , Marcelo Pereyra , Tobias Liaudat

We consider risk-sensitive Markov decision processes (MDPs), where the MDP model is influenced by a parameter which takes values in a compact metric space. We identify sufficient conditions under which small perturbations in the model…

Optimization and Control · Mathematics 2022-09-28 Shiping Shao , Abhishek Gupta , William B. Haskell

Data driven models of dynamical systems help planners and controllers to provide more precise and accurate motions. Most model learning algorithms will try to minimize a loss function between the observed data and the model's predictions.…

Artificial Intelligence · Computer Science 2021-02-12 Clark Zhang , Santiago Paternain , Alejandro Ribeiro

We study a linear contextual optimization problem where a decision maker has access to historical data and contextual features to learn a cost prediction model aimed at minimizing decision error. We adopt the predict-then-optimize framework…

Optimization and Control · Mathematics 2025-04-09 Omar Bennouna , Jiawei Zhang , Saurabh Amin , Asuman Ozdaglar

In this article, we investigate the robust optimal design problem for the prediction of response when the fitted regression models are only approximately specified, and observations might be missing completely at random. The intuitive idea…

Methodology · Statistics 2022-10-19 Rui Hu , Ion Bica , Zhichun Zhai

A common goal throughout science and engineering is to solve optimization problems constrained by computational models. However, in many cases a high-fidelity numerical emulation of systems cannot be optimized due to code complexity and…

Numerical Analysis · Mathematics 2023-05-31 Joseph Hart , Bart van Bloemen Waanders

Many existing methods for constructing optimal split-plot designs, such as D-optimal designs, only focus on minimizing the variances and covariances of the estimation for the fitted model. However, the underlying true model is usually…

Computation · Statistics 2016-08-02 Chang-Yun Lin

Prediction is critical for decision-making under uncertainty and lends validity to statistical inference. With targeted prediction, the goal is to optimize predictions for specific decision tasks of interest, which we represent via…

Methodology · Statistics 2021-02-18 Daniel R. Kowal

The problem of identifying the most discriminating features when performing supervised learning has been extensively investigated. In particular, several methods for variable selection in model-based classification have been proposed.…

Applications · Statistics 2020-12-16 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

The problem of linear predictions has been extensively studied for the past century under pretty generalized frameworks. Recent advances in the robust statistics literature allow us to analyze robust versions of classical linear models…

Machine Learning · Statistics 2022-03-15 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

Computer simulations have proven a valuable tool for understanding complex phenomena across the sciences. However, the utility of simulators for modelling and forecasting purposes is often restricted by low data quality, as well as…

Machine Learning · Statistics 2022-10-14 Daniel Ward , Patrick Cannon , Mark Beaumont , Matteo Fasiolo , Sebastian M Schmon

Now that Bayesian Networks (BNs) have become widely used, an appreciation is developing of just how critical an awareness of the sensitivity and robustness of certain target variables are to changes in the model. When time resources are…

Methodology · Statistics 2018-11-20 Sophia K. Wright , Jim Q. Smith

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

In the context of computer models, calibration is the process of estimating unknown simulator parameters from observational data. Calibration is variously referred to as model fitting, parameter estimation/inference, an inverse problem, and…

Methodology · Statistics 2023-10-16 Richard D. Wilkinson , Christopher W. Lanyon

Optimal policies in Markov decision processes (MDPs) are very sensitive to model misspecification. This raises serious concerns about deploying them in high-stake domains. Robust MDPs (RMDP) provide a promising framework to mitigate…

Machine Learning · Computer Science 2019-12-06 Reazul Hasan Russel , Bahram Behzadian , Marek Petrik

We adopt the statistical framework on robustness proposed by Watson and Holmes in 2016 and then tackle the practical challenges that hinder its applicability to network models. The goal is to evaluate how the quality of an inference for a…

Methodology · Statistics 2020-12-08 Marios Papamichalis , Simon Lunagomez , Patrick J. Wolfe

We give a method for proactively identifying small, plausible shifts in distribution which lead to large differences in model performance. These shifts are defined via parametric changes in the causal mechanisms of observed variables, where…

Machine Learning · Computer Science 2023-01-18 Nikolaj Thams , Michael Oberst , David Sontag

Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, the loss ignores misspecification, where models are imperfect. Parameter uncertainties from Bayesian…

Machine Learning · Statistics 2024-11-07 Thomas D Swinburne , Danny Perez