English
Related papers

Related papers: Strategic Evaluation: Subjects, Evaluators, and So…

200 papers

As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. However, various…

Computers and Society · Computer Science 2023-01-18 Samer B. Nashed , Justin Svegliato , Su Lin Blodgett

High performance machine learning models have become highly dependent on the availability of large quantity and quality of training data. To achieve this, various central agencies such as the government have suggested for different data…

Machine Learning · Computer Science 2019-11-27 Zhiliang Chen

We describe cases where real recommender systems were modified in the service of various human values such as diversity, fairness, well-being, time well spent, and factual accuracy. From this we identify the current practice of values…

Information Retrieval · Computer Science 2021-07-26 Jonathan Stray , Ivan Vendrov , Jeremy Nixon , Steven Adler , Dylan Hadfield-Menell

In strategic classification, the standard supervised learning setting is extended to support the notion of strategic user behavior in the form of costly feature manipulations made in response to a classifier. While standard learning…

Machine Learning · Computer Science 2025-11-05 Benyamin Trachtenberg , Nir Rosenfeld

People are known to judge artificial intelligence using a utilitarian moral philosophy and humans using a moral philosophy emphasizing perceived intentions. But why do people judge humans and machines differently? Psychology suggests that…

Computers and Society · Computer Science 2023-09-20 Jingling Zhang , Jane Conway , César A. Hidalgo

In this paper I present several algorithmic techniques for improving the decision process of multiple types of agents behaving in environments where their interests are in conflict. The interactions between the agents are modelled by using…

Computer Science and Game Theory · Computer Science 2009-08-04 Mugurel Ionut Andreica

Modern information access ecosystems consist of mixtures of systems, such as retrieval systems and large language models, and increasingly rely on marketplaces to mediate access to models, tools, and data, making competition between systems…

Information Retrieval · Computer Science 2026-04-17 To Eun Kim , Alireza Salemi , Hamed Zamani , Fernando Diaz

Online information ecosystems are now central to our everyday social interactions. Of the many opportunities and challenges this presents, the capacity for artificial agents to shape individual and collective human decision-making in such…

Populations and Evolution · Quantitative Biology 2023-12-07 Theodor Cimpeanu , Alexander J. Stewart

We study a multi-agent decision problem in population games, where agents select from multiple available strategies and continually revise their selections based on the payoffs associated with these strategies. Unlike conventional…

Multiagent Systems · Computer Science 2024-09-17 Shinkyu Park

A primary difficulty with unsupervised discovery of structure in large data sets is a lack of quantitative evaluation criteria. In this work, we propose and investigate several metrics for evaluating and comparing generative models of…

Machine Learning · Computer Science 2020-07-27 Daniel Jiwoong Im , Iljung Kwak , Kristin Branson

Motivated by applications such as college admission and insurance rate determination, we propose an evaluation problem where the inputs are controlled by strategic individuals who can modify their features at a cost. A learner can only…

Computer Science and Game Theory · Computer Science 2020-11-05 Nika Haghtalab , Nicole Immorlica , Brendan Lucier , Jack Z. Wang

Understanding citizens' values in participatory systems is crucial for citizen-centric policy-making. We envision a hybrid participatory system where participants make choices and provide motivations for those choices, and AI agents…

Artificial Intelligence · Computer Science 2025-02-12 Enrico Liscio , Luciano C. Siebert , Catholijn M. Jonker , Pradeep K. Murukannaiah

In this paper, we consider a general distributed system with multiple agents who select and then implement actions in the system. The system has an operator with a centralized objective. The agents, on the other hand, are selfinterested and…

Computer Science and Game Theory · Computer Science 2020-01-15 Donya Ghavidel , Pratyush Chakraborty , Enrique Baeyens , Vijay Gupta , Pramod P. Khargonekar

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau

Decision-making methods very often use the technique of comparing alternatives in pairs. In this approach, experts are asked to compare different options, and then a quantitative ranking is created from the results obtained. It is commonly…

Artificial Intelligence · Computer Science 2025-04-21 M. Strada , K. Kułakowski

Our aim is to design mechanisms that motivate all agents to reveal their predictions truthfully and promptly. For myopic agents, proper scoring rules induce truthfulness. However, as has been described in the literature, when agents take…

Computer Science and Game Theory · Computer Science 2019-12-05 Amir Ban

We present what we call the Interpretation Problem, whereby any rule in symbolic form is open to infinite interpretation in ways that we might disapprove of and argue that any attempt to build morality into machines is subject to it. We…

Artificial Intelligence · Computer Science 2023-02-08 Cosmin Badea , Gregory Artus

We study a problem where a group of agents has to decide how some fixed value should be shared among them. We are interested in settings where the share that each agent receives is based on how that agent is evaluated by other members of…

Computer Science and Game Theory · Computer Science 2013-06-04 Arthur Carvalho , Kate Larson

Modeling the strategic behavior of agents in a real-world multi-agent system using existing state-of-the-art computational game-theoretic tools can be a daunting task, especially when only the actions taken by the agents can be observed.…

Computer Science and Game Theory · Computer Science 2025-01-20 Boshen Wang , Luis E. Ortiz

Machine behavior that is based on learning algorithms can be significantly influenced by the exposure to data of different qualities. Up to now, those qualities are solely measured in technical terms, but not in ethical ones, despite the…

Computers and Society · Computer Science 2021-09-29 Thilo Hagendorff