English
Related papers

Related papers: Robust Misspecified Models and Paradigm Shifts

200 papers

This article proposes a fundamental methodological shift in the modelling of policy interventions for sustainability transitions in order to account for complexity (e.g. self-reinforcing mechanism arising from multi-agent interactions) and…

Physics and Society · Physics 2016-03-23 J. -F. Mercure , H. Pollitt , A. M. Bassi , J. E Viñuales , N. R. Edwards

Linear regression is a frequently used tool in statistics, however, its validity and interpretability relies on strong model assumptions. While robust estimates of the coefficients' covariance extend the validity of hypothesis tests and…

Methodology · Statistics 2015-04-23 Werner Brannath , Martin Scharpenberg

Teaching an agent to perform new tasks using natural language can easily be hindered by ambiguities in interpretation. When a teacher provides an instruction to a learner about an object by referring to its features, the learner can…

Machine Learning · Computer Science 2023-09-28 Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

For machine learning models to be reliable and trustworthy, their decisions must be interpretable. As these models find increasing use in safety-critical applications, it is important that not just the model predictions but also their…

Machine Learning · Computer Science 2023-12-19 Sandesh Kamath , Sankalp Mittal , Amit Deshpande , Vineeth N Balasubramanian

Model multiplicity refers to the existence of multiple machine learning models that describe the data equally well but may produce different predictions on individual samples. In medicine, these models can admit conflicting predictions for…

Many model-based reinforcement learning (RL) methods follow a similar template: fit a model to previously observed data, and then use data from that model for RL or planning. However, models that achieve better training performance (e.g.,…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Alexander Khazatsky , Sergey Levine , Ruslan Salakhutdinov

This paper studies identification and estimation of a class of dynamic models in which the decision maker (DM) is uncertain about the data-generating process. The DM surrounds a benchmark model that he or she fears is misspecified by a set…

Econometrics · Economics 2019-01-30 Timothy M. Christensen

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Coen D. Needell , Wilma A. Bainbridge

Selective Prediction is the task of rejecting inputs a model would predict incorrectly on. This involves a trade-off between input space coverage (how many data points are accepted) and model utility (how good is the performance on accepted…

This paper is dedicated to a robust ordinal method for learning the preferences of a decision maker between subsets. The decision model, derived from Fishburn and LaValle (1996) and whose parameters we learn, is general enough to be…

Artificial Intelligence · Computer Science 2023-08-08 Hugo Gilbert , Mohamed Ouaguenouni , Meltem Ozturk , Olivier Spanjaard

Imitation learning practitioners have often noted that conditioning policies on previous actions leads to a dramatic divergence between "held out" error and performance of the learner in situ. Interactive approaches can provably address…

Machine Learning · Computer Science 2021-02-12 Jonathan Spencer , Sanjiban Choudhury , Arun Venkatraman , Brian Ziebart , J. Andrew Bagnell

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

Identifying uncertainty and taking mitigating actions is crucial for safe and trustworthy reinforcement learning agents, especially when deployed in high-risk environments. In this paper, risk sensitivity is promoted in a model-based…

Machine Learning · Computer Science 2021-11-10 Stefan Radic Webster , Peter Flach

The bias/variance tradeoff is fundamental to learning: increasing a model's complexity can improve its fit on training data, but potentially worsens performance on future samples. Remarkably, however, the human brain effortlessly handles a…

Neurons and Cognition · Quantitative Biology 2012-10-18 David Balduzzi

In the causal inference literature an estimator belonging to a class of semi-parametric estimators is called robust if it has desirable properties under the assumption that at least one of the working models is correctly specified. In this…

Statistics Theory · Mathematics 2018-06-26 Ingeborg Waernbaum , Laura Pazzagli

As large-scale training regimes have gained popularity, the use of pretrained models for downstream tasks has become common practice in machine learning. While pretraining has been shown to enhance the performance of models in practice, the…

Machine Learning · Computer Science 2023-10-10 Laura Fee Nern , Harsh Raj , Maurice Georgi , Yash Sharma

The ubiquity of machine learning based predictive models in modern society naturally leads people to ask how trustworthy those models are? In predictive modeling, it is quite common to induce a trade-off between accuracy and…

Machine Learning · Computer Science 2019-04-05 John Mitros , Brian Mac Namee

Active inference helps us simulate adaptive behavior and decision-making in biological and artificial agents. Building on our previous work exploring the relationship between active inference, well-being, resilience, and sustainability, we…

Artificial Intelligence · Computer Science 2024-06-13 Mahault Albarracin , Ines Hipolito , Maria Raffa , Paul Kinghorn

We study decision making in environments where the reward is only partially observed, but can be modeled as a function of an action and an observed context. This setting, known as contextual bandits, encompasses a wide variety of…

Machine Learning · Computer Science 2011-05-09 Miroslav Dudik , John Langford , Lihong Li