English
Related papers

Related papers: Evaluating Agents using Social Choice Theory

200 papers

The increasing adoption of foundation models as agents across diverse domains necessitates a robust evaluation framework. Current methods, such as LLM-as-a-Judge, focus only on final outputs, overlooking the step-by-step reasoning that…

Most analyses of manipulation of voting schemes have adopted two assumptions that greatly diminish their practical import. First, it is usually assumed that the manipulators have full knowledge of the votes of the nonmanipulating agents.…

Computer Science and Game Theory · Computer Science 2012-10-19 Tyler Lu , Pingzhong Tang , Ariel D. Procaccia , Craig Boutilier

Crowdsourcing is a mechanism by means of which groups of people are able to execute a task by sharing ideas, efforts and resources. Thanks to the online technologies, crowdsourcing has become in the last decade an even more utilized process…

Physics and Society · Physics 2022-03-16 Daniele Vilone

This paper considers the ranking problem of candidates for a certain position based on ballot papers filled by voters. We suggest a ranking procedure of alternatives using cooperative game theory methods. For this, it is necessary to…

Computer Science and Game Theory · Computer Science 2022-09-09 Aleksei Kondratev , Vladimir Mazalov

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2013-08-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

We introduce a new framework to study the group dynamics and game-theoretic considerations when voters in a committee are allowed to trade votes. This model represents a significant step forward by considering vote-for-vote trades in a…

Theoretical Economics · Economics 2024-06-17 Matthew I. Jones

An important emerging application of coding agents is agent optimization: the iterative improvement of a target agent through edit-execute-evaluate cycles. Despite its relevance, the community lacks a systematic understanding of coding…

Artificial Intelligence · Computer Science 2026-05-12 Varun Ursekar , Apaar Shanker , Veronica Chatrath , Yuan Xue , Sam Denton

Valuation problems, such as feature interpretation, data valuation and model valuation for ensembles, become increasingly more important in many machine learning applications. Such problems are commonly solved by well-known game-theoretic…

Machine Learning · Computer Science 2022-05-13 Yatao Bian , Yu Rong , Tingyang Xu , Jiaxiang Wu , Andreas Krause , Junzhou Huang

An agent's assessment of its trust in another agent is commonly taken to be a measure of the reliability/predictability of the latter's actions. It is based on the trustor's past observations of the behaviour of the trustee and requires no…

Artificial Intelligence · Computer Science 2019-06-03 Kinzang Chhogyal , Abhaya Nayak , Aditya Ghose , Hoa Khanh Dam

Understanding the nature of strategic voting is the holy grail of social choice theory, where game-theory, social science and recently computational approaches are all applied in order to model the incentives and behavior of voters. In a…

Multiagent Systems · Computer Science 2014-11-19 Reshef Meir

When evaluating the efficacy of social programs and medical treatments using randomized experiments, the estimated overall average causal effect alone is often of limited value and the researchers must investigate when the treatments do and…

Applications · Statistics 2013-05-27 Kosuke Imai , Marc Ratkovic

In economic theory, an agent chooses from available alternatives -- modeled as a set. In decisions in the field or in the lab, however, agents do not have access to the set of alternatives at once. Instead, alternatives are represented by…

Computer Science and Game Theory · Computer Science 2021-11-09 Paulo Oliva , Philipp Zahn

Within the ViSE (Voting in Stochastic Environment) model, we study social dynamics determined by collective decisions in a society with an elite. The model allows the analysis of the influence of participants' social attitudes, such as the…

Physics and Society · Physics 2019-11-04 Yana Tsodikova , Pavel Chebotarev , Anton Loginov , Zoya Lezina

There is a long tradition of fruitful interaction between logic and social choice theory. In recent years, much of this interaction has focused on computer-aided methods such as SAT solving and interactive theorem proving. In this paper, we…

Logic in Computer Science · Computer Science 2021-10-19 Wesley H. Holliday , Chase Norman , Eric Pacuit

An important problem in computational social choice theory is the complexity of undesirable behavior among agents, such as control, manipulation, and bribery in election systems. These kinds of voting strategies are often tempting at the…

Artificial Intelligence · Computer Science 2012-04-20 Andrew Lin

In this paper, we study some multiagent variants of the knapsack problem. Fluschnik et al. [AAAI 2019] considered the model in which every agent assigns some utility to every item. They studied three preference aggregation rules for finding…

Computer Science and Game Theory · Computer Science 2022-08-05 Sushmita Gupta , Pallavi Jain , Sanjay Seetharaman

We initiate a novel direction in randomized social choice by proposing a new definition of agent utility for randomized outcomes. Each agent has a preference over all outcomes and a {\em quantile} parameter. Given a {\em lottery} over the…

Computer Science and Game Theory · Computer Science 2026-03-03 Ioannis Caragiannis , Fabian Frank , Sanjukta Roy

When humans are subject to an algorithmic decision system, they can strategically adjust their behavior accordingly (``game'' the system). While a growing line of literature on strategic classification has used game-theoretic modeling to…

Machine Learning · Computer Science 2024-10-28 Raman Ebrahimi , Kristen Vaccaro , Parinaz Naghizadeh

We study a problem where a group of agents has to decide how some fixed value should be shared among them. We are interested in settings where the share that each agent receives is based on how that agent is evaluated by other members of…

Computer Science and Game Theory · Computer Science 2013-06-04 Arthur Carvalho , Kate Larson

Recent large-scale Vision Language Action (VLA) models have shown superior performance in robotic manipulation tasks guided by natural language. However, current VLA models suffer from two drawbacks: (i) generation of massive tokens leading…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Juyi Lin , Amir Taherin , Arash Akbari , Arman Akbari , Lei Lu , Guangyu Chen , Taskin Padir , Xiaomeng Yang , Weiwei Chen , Yiqian Li , Xue Lin , David Kaeli , Pu Zhao , Yanzhi Wang