English
Related papers

Related papers: The Model Selection Curse

200 papers

We determine the quality of randomized social choice mechanisms in a setting in which the agents have metric preferences: every agent has a cost for each alternative, and these costs form a metric. We assume that these costs are unknown to…

Artificial Intelligence · Computer Science 2016-09-27 Elliot Anshelevich , John Postl

In an emergency situation, the actors need an assistance allowing them to react swiftly and efficiently. In this prospect, we present in this paper a decision support system that aims to prepare actors in a crisis situation thanks to a…

Artificial Intelligence · Computer Science 2008-12-18 Fahem Kebair , Frédéric Serin

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

Modeling social interactions based on individual behavior has always been an area of interest, but prior literature generally presumes rational behavior. Thus, such models may miss out on capturing the effects of biases humans are…

Artificial Intelligence · Computer Science 2019-03-11 Nanda Kishore Sreenivas , Shrisha Rao

Large language models (LLMs) are trained on vast amounts of text from the internet, which contains both factual and misleading information about the world. While unintuitive from a classic view of LMs, recent work has shown that the truth…

Computation and Language · Computer Science 2024-02-07 Nitish Joshi , Javier Rando , Abulhair Saparov , Najoung Kim , He He

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

Artificial Intelligence · Computer Science 2013-01-30 Richard Dearden , Nir Friedman , David Andre

The model selection procedure is usually a single-criterion decision making in which we select the model that maximizes a specific metric in a specific set, such as the Validation set performance. We claim this is very naive and can perform…

Machine Learning · Computer Science 2022-07-15 Felipe Costa Farias , Teresa Bernarda Ludermir , Carmelo José Albanez Bastos-Filho

Agent-based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the…

Multiagent Systems · Computer Science 2022-01-21 Georg Jäger , Daniel Reisinger

The role model strategy is introduced as a method for designing an estimator by approaching the output of a superior estimator that has better input observations. This strategy is shown to yield the optimal Bayesian estimator when a Markov…

Information Theory · Computer Science 2008-09-09 Jossy Sayir

Recent literature highlights the advantages of implementing social rules via dynamic game forms. We characterize when truth-telling remains a dominant strategy in gradual mechanisms implementing strategy-proof social rules, where agents…

Theoretical Economics · Economics 2025-03-27 Wenqian Wang , Zhiwen Zheng

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a…

Artificial Intelligence · Computer Science 2018-06-21 Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , Supriyo Chakraborty

Agents that learn to select optimal actions represent a prominent focus of the sequential decision-making literature. In the face of a complex environment or constraints on time and resources, however, aiming to synthesize such an optimal…

Machine Learning · Computer Science 2021-06-23 Dilip Arumugam , Benjamin Van Roy

Agent Based Modelling (ABM) is a computational framework for simulating the behaviours and interactions of autonomous agents. As Agent Based Models are usually representative of complex systems, obtaining a likelihood function of the model…

Artificial Intelligence · Computer Science 2021-07-09 D. Townsend

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

We study the performance of different methods for processing information, incorporating narrative selection within an evolutionary model. All agents update their beliefs according to Bayes' Rule, but some strategically choose the narrative…

Theoretical Economics · Economics 2025-08-06 Federico Innocenti , Roberto Rozzi

An important use of machine learning is to learn what people value. What posts or photos should a user be shown? Which jobs or activities would a person find rewarding? In each case, observations of people's past choices can inform our…

Artificial Intelligence · Computer Science 2015-12-21 Owain Evans , Andreas Stuhlmueller , Noah D. Goodman

In this paper, the interplay between a class of nonlinear estimators and strategic sensors is studied in several participatory-sensing scenarios. It is shown that for the class of estimators, if the strategic sensors have access to…

Computer Science and Game Theory · Computer Science 2015-03-11 Farhad Farokhi , Iman Shames , Michael Cantoni

The task of learning to pick a single preferred example out a finite set of examples, an "optimal choice problem", is a supervised machine learning problem with complex, structured input. Problems of optimal choice emerge often in various…

Artificial Intelligence · Computer Science 2017-07-07 Marina Sapir

Self-Modeling is the process by which an agent, such as an animal or machine, learns to create a predictive model of its own dynamics. Once captured, this self-model can then allow the agent to plan and evaluate various potential behaviors…

Robotics · Computer Science 2022-09-07 Robert Kwiatkowski , Yuhang Hu , Boyuan Chen , Hod Lipson

Time-inconsistency is a characteristic of human behavior in which people plan for long-term benefits but take actions that differ from the plan due to conflicts with short-term benefits. Such time-inconsistent behavior is believed to be…

Computer Science and Game Theory · Computer Science 2025-01-15 Yasunori Akagi , Naoki Marumo , Takeshi Kurashima