English
Related papers

Related papers: Observational Multiplicity

200 papers

We study the problem of planning under model uncertainty in an online meta-reinforcement learning (RL) setting where an agent is presented with a sequence of related tasks with limited interactions per task. The agent can use its experience…

Artificial Intelligence · Computer Science 2023-01-02 Khimya Khetarpal , Claire Vernade , Brendan O'Donoghue , Satinder Singh , Tom Zahavy

We study online prediction where regret of the algorithm is measured against a benchmark defined via evolving constraints. This framework captures online prediction on graphs, as well as other prediction problems with combinatorial…

Machine Learning · Computer Science 2015-06-15 Alexander Rakhlin , Karthik Sridharan

This study introduces an agent-based model to study how regret, uncertainty, and social norms interact to shape vaccination behavior during epidemics. The model integrates three behavioral mechanisms, anticipated regret, evolving norms, and…

Physics and Society · Physics 2025-11-18 Christos Charalambous

Multi-class classification methods that produce sets of probabilistic classifiers, such as ensemble learning methods, are able to model aleatoric and epistemic uncertainty. Aleatoric uncertainty is then typically quantified via the Bayes…

Machine Learning · Statistics 2023-04-20 Thomas Mortier , Viktor Bengs , Eyke Hüllermeier , Stijn Luca , Willem Waegeman

Machine learning tasks may admit multiple competing models that achieve similar performance yet produce conflicting outputs for individual samples -- a phenomenon known as predictive multiplicity. We demonstrate that fairness interventions…

Machine Learning · Computer Science 2023-06-19 Carol Xuan Long , Hsiang Hsu , Wael Alghamdi , Flavio P. Calmon

We consider a variation on the problem of prediction with expert advice, where new forecasters that were unknown until then may appear at each round. As often in prediction with expert advice, designing an algorithm that achieves…

Machine Learning · Statistics 2017-09-01 Jaouad Mourtada , Odalric-Ambrym Maillard

We propose a framework which generalizes "decision making with structured observations" by allowing robust (i.e. multivalued) models. In this framework, each model associates each decision with a convex set of probability distributions over…

Machine Learning · Computer Science 2025-06-27 Alexander Appel , Vanessa Kosoy

For decision making under uncertainty, min-max regret has been established as a popular methodology to find robust solutions. In this approach, we compare the performance of our solution against the best possible performance had we known…

Optimization and Control · Mathematics 2021-11-25 Marc Goerigk , Michael Hartisch

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Often, when modeling human decision-making behaviors in the context of human-robot teaming, the emotion aspect of human is ignored. Nevertheless, the influence of emotion, in some cases, is not only undeniable but beneficial. This work…

Artificial Intelligence · Computer Science 2019-10-02 Longsheng Jiang , Yue Wang

Prediction problems often admit competing models that perform almost equally well. This effect challenges key assumptions in machine learning when competing models assign conflicting predictions. In this paper, we define predictive…

Machine Learning · Computer Science 2020-09-17 Charles T. Marx , Flavio du Pin Calmon , Berk Ustun

In the classic expert problem, $\Phi$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $\phi \in \Phi$. A recent work by Lu et al., [2025] introduces an adaptive algorithm…

Machine Learning · Computer Science 2025-12-16 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We study probabilistic prediction games when the underlying model is misspecified, investigating the consequences of predicting using an incorrect parametric model. We show that for a broad class of loss functions and parametric families of…

Machine Learning · Statistics 2021-02-02 Annie Marsden , John Duchi , Gregory Valiant

In practical applications, data is used to make decisions in two steps: estimation and optimization. First, a machine learning model estimates parameters for a structural model relating decisions to outcomes. Second, a decision is chosen to…

Optimization and Control · Mathematics 2022-10-28 Samuel Tan , Peter I. Frazier

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh

We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick $m\geq 1$ experts from a pool of $K$ experts and the overall utility is a modular or submodular…

Machine Learning · Computer Science 2023-05-25 Omid Sadeghi , Maryam Fazel

This work studies external regret in sequential prediction games with both positive and negative payoffs. External regret measures the difference between the payoff obtained by the forecasting strategy and the payoff of the best action. In…

Statistics Theory · Mathematics 2007-06-13 Nicolo Cesa-Bianchi , Yishay Mansour , Gilles Stoltz

This paper proposes a theoretical analysis of recommendation systems in an online setting, where items are sequentially recommended to users over time. In each round, a user, randomly picked from a population of $m$ users, requests a…

Machine Learning · Statistics 2020-10-26 Kaito Ariu , Narae Ryu , Se-Young Yun , Alexandre Proutière

Machine learning (ML) is increasingly used in high-stakes settings, yet multiplicity - the existence of multiple good models - means that some predictions are essentially arbitrary. ML researchers and philosophers posit that multiplicity…

Computers and Society · Computer Science 2025-01-24 Anna P. Meyer , Yea-Seul Kim , Aws Albarghouthi , Loris D'Antoni

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2015-03-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell