English
Related papers

Related papers: The Model Selection Curse

200 papers

When a human receives a prediction or recommended course of action from an intelligent agent, what additional information, beyond the prediction or recommendation itself, does the human require from the agent to decide whether to trust or…

Human-Computer Interaction · Computer Science 2022-05-09 George J. Cancro , Shimei Pan , James Foulds

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović

From marketing to politics, exploitation of incomplete information through selective communication of arguments is ubiquitous. In this work, we focus on development of an argumentation-theoretic model for manipulable multi-agent…

Artificial Intelligence · Computer Science 2019-09-17 Ryuta Arisaka , Makoto Hagiwara , Takayuki Ito

We study a model of consensus decision making, in which a finite group of Bayesian agents has to choose between one of two courses of action. Each member of the group has a private and independent signal at his or her disposal, giving some…

Statistics Theory · Mathematics 2018-04-24 Elchanan Mossel , Omer Tamuz

We present our approach to the problem of how an agent, within an economic Multi-Agent System, can determine when it should behave strategically (i.e. learn and use models of other agents), and when it should act as a simple price-taker. We…

Multiagent Systems · Computer Science 2007-05-23 Jose M. Vidal , Edmund H. Durfee

An implicit expectation of asking users to rate agents, such as an AI decision-aid, is that they will use only relevant information -- ask them about an agent's benevolence, and they should consider whether or not it was kind. Behavioral…

Human-Computer Interaction · Computer Science 2023-07-28 Nikolos Gurney , David Pynadath , Ning Wang

We study truthful mechanisms for matching and related problems in a partial information setting, where the agents' true utilities are hidden, and the algorithm only has access to ordinal preference information. Our model is motivated by the…

Computer Science and Game Theory · Computer Science 2016-10-20 Elliot Anshelevich , Shreyas Sekar

To successfully navigate its environment, an agent must construct and maintain representations of the other agents that it encounters. Such representations are useful for many tasks, but they are not without cost. As a result, agents must…

Artificial Intelligence · Computer Science 2023-12-11 Max Taylor-Davies , Christopher G. Lucas

AI systems are often used to make or contribute to important decisions in a growing range of applications, including criminal justice, hiring, and medicine. Since these decisions impact human lives, it is important that the AI systems act…

Artificial Intelligence · Computer Science 2021-03-16 Duncan C McElfresh , Lok Chan , Kenzie Doyle , Walter Sinnott-Armstrong , Vincent Conitzer , Jana Schaich Borg , John P Dickerson

Motivated by online platforms such as job markets, we study an agent choosing from a list of candidates, each with a hidden quality that determines match value. The agent observes only a noisy ranking of the candidates plus a binary signal…

Computer Science and Game Theory · Computer Science 2026-02-26 Kate Donahue , Nicole Immorlica , Brendan Lucier

The rapidly growing field of network analytics requires data sets for use in evaluation. Real world data often lack truth and simulated data lack narrative fidelity or statistical generality. This paper presents a novel, mixed-membership,…

Social and Information Networks · Computer Science 2013-09-09 Garrett Bernstein , Kyle O'Brien

Algorithms are used to aid human decision makers by making predictions and recommending decisions. Currently, these algorithms are trained to optimize prediction accuracy. What if they were optimized to control final decisions? In this…

Artificial Intelligence · Computer Science 2023-03-27 Ruqing Xu , Sarah Dean

We study the problem of agent selection in causal strategic learning under multiple decision makers and address two key challenges that come with it. Firstly, while much of prior work focuses on studying a fixed pool of agents that remains…

Artificial Intelligence · Computer Science 2024-02-06 Kiet Q. H. Vo , Muneeb Aadil , Siu Lun Chau , Krikamol Muandet

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle

When consequential decisions are informed by algorithmic input, individuals may feel compelled to alter their behavior in order to gain a system's approval. Models of agent responsiveness, termed "strategic manipulation," analyze the…

Machine Learning · Computer Science 2019-05-13 Lily Hu , Nicole Immorlica , Jennifer Wortman Vaughan

Sequential learning models situations where agents predict a ground truth in sequence, by using their private, noisy measurements, and the predictions of agents who came earlier in the sequence. We study sequential learning in a social…

Social and Information Networks · Computer Science 2025-02-19 Filip Úradník , Amanda Wang , Jie Gao

Enhancing resilience in multi-agent systems in the face of selfish agents is an important problem that requires further characterisation. This work develops a truthful mechanism that avoids self-interested and strategic agents maliciously…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Tianyi Zhong , David Angeli

This paper develops a new approach for estimating an interpretable, relational model of a black-box autonomous agent that can plan and act. Our main contributions are a new paradigm for estimating such models using a minimal query interface…

Artificial Intelligence · Computer Science 2021-04-12 Pulkit Verma , Shashank Rao Marpally , Siddharth Srivastava

Deceptive agents are a challenge for the safety, trustworthiness, and cooperation of AI systems. We focus on the problem that agents might deceive in order to achieve their goals (for instance, in our experiments with language models, the…

Artificial Intelligence · Computer Science 2023-12-05 Francis Rhys Ward , Francesco Belardinelli , Francesca Toni , Tom Everitt

Agent-based simulation with a synthetic population can help us compare different treatment conditions while keeping everything else constant within the same population (i.e., as digital twins). Such population-scale simulations require…

Methodology · Statistics 2024-03-26 Abdulrahman A. Ahmed , M. Amin Rahimian , Mark S. Roberts