English
Related papers

Related papers: Welfare Diplomacy: Benchmarking Language Model Coo…

200 papers

Coordination is often critical to forming prosocial behaviors -- behaviors that increase the overall sum of rewards received by all agents in a multi-agent game. However, state of the art reinforcement learning algorithms often suffer from…

Multiagent Systems · Computer Science 2021-05-17 Woodrow Z. Wang , Mark Beliaev , Erdem Bıyık , Daniel A. Lazar , Ramtin Pedarsani , Dorsa Sadigh

While traditional game models often simplify interactions among agents as static, real-world social relationships are inherently dynamic, influenced by both immediate payoffs and alternative information. Motivated by this fact, we introduce…

Social and Information Networks · Computer Science 2024-11-25 Hongyu Yue , Xiaojin Xiong , Minyu Feng , Attila Szolnoki

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

We explore the idea of aligning an AI assistant by inverting a model of users' (unknown) preferences from observed interactions. To validate our proposal, we run proof-of-concept simulations in the economic ultimatum game, formalizing user…

Computation and Language · Computer Science 2023-12-05 Jan-Philipp Fränken , Sam Kwok , Peixuan Ye , Kanishk Gandhi , Dilip Arumugam , Jared Moore , Alex Tamkin , Tobias Gerstenberg , Noah D. Goodman

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

In scenarios where a single player cannot control other players, cooperative AI is a recent technology that takes advantage of deep learning to assess whether cooperation might occur. One main difficulty of this approach is that it requires…

Multiagent Systems · Computer Science 2023-04-03 Xavier Marjou , Arnaud Braud , Gaël Fromentoux

Social dilemmas present a significant challenge in multi-agent cooperation because individuals are incentivised to behave in ways that undermine socially optimal outcomes. Consequently, self-interested agents often avoid collective…

Computer Science and Game Theory · Computer Science 2024-08-02 Richard Willis , Yali Du , Joel Z Leibo , Michael Luck

Scoring systems, as a type of predictive model, have significant advantages in interpretability and transparency and facilitate quick decision-making. As such, scoring systems have been extensively used in a wide variety of industries such…

Machine Learning · Computer Science 2022-11-23 Yi Yang , Ying Wu , Mei Li , Xiangyu Chang , Yong Tan

The justice system has increasingly employed AI techniques to enhance efficiency, yet limitations remain in improving the quality of decision-making, particularly regarding transparency and explainability needed to uphold public trust in…

Artificial Intelligence · Computer Science 2024-12-30 Cong Jiang , Xiaolei Yang

Existing simulations designed for cultural and interpersonal skill training rely on pre-defined responses with a menu option selection interface. Using a multiple-choice interface and restricting trainees' responses may limit the trainees'…

Computers and Society · Computer Science 2021-10-19 Sodiq Adewole , Erfaneh Gharavi , Benjamin Shpringer , Martin Bolger , Vaibhav Sharma , Sung Ming Yang , Donald E. Brown

Reinforcement learning has been shown to be an effective strategy for automatically training policies for challenging control problems. Focusing on non-cooperative multi-agent systems, we propose a novel reinforcement learning framework for…

Computer Science and Game Theory · Computer Science 2022-06-08 Kishor Jothimurugan , Suguman Bansal , Osbert Bastani , Rajeev Alur

Recent advances in large language models (LLMs) have spurred growing interest in using LLM-integrated agents for social simulation, often under the implicit assumption that realistic population dynamics will emerge once role-specified…

Multiagent Systems · Computer Science 2026-05-08 Yiming Li , Dacheng Tao

Prominent large language models have exhibited human-level performance in many domains, even enabling the derived agents to simulate human and social interactions. While practical works have substantiated the practicability of grounding…

Computation and Language · Computer Science 2024-04-09 Chenxu Wang , Bin Dai , Huaping Liu , Baoyuan Wang

Contract bridge, a cooperative game characterized by imperfect information and multi-agent dynamics, poses significant challenges and serves as a critical benchmark in artificial intelligence (AI) research. Success in this domain requires…

Artificial Intelligence · Computer Science 2024-06-18 Haruka Kita , Sotetsu Koyamada , Yotaro Yamaguchi , Shin Ishii

Despite rapid technological progress, effective human-machine cooperation remains a significant challenge. Humans tend to cooperate less with machines than with fellow humans, a phenomenon known as the machine penalty. Here, we show that…

Human-Computer Interaction · Computer Science 2025-05-29 Zhen Wang , Ruiqi Song , Chen Shen , Shiya Yin , Zhao Song , Balaraju Battu , Lei Shi , Danyang Jia , Talal Rahwan , Shuyue Hu

The boardgame Diplomacy is a challenging setting for communicative and cooperative artificial intelligence. The most prominent communicative Diplomacy AI, Cicero, has excellent strategic abilities, exceeding human players. However, the best…

AI is increasingly used to scale collective decision-making, but far less attention has been paid to how such systems can support procedural legitimacy, particularly the conditions shaping losers' consent: whether participants who do not…

Human-Computer Interaction · Computer Science 2026-04-08 Suyash Fulay , Prerna Ravi , Emily Kubin , Shrestha Mohanty , Michiel Bakker , Deb Roy

Large Language Models (LLMs) have enabled Multi-Agent Systems (MASs) where agents interact through natural language to solve complex tasks or simulate multi-party dialogues. Recent work on LLM-based MASs has mainly focused on architecture…

Computation and Language · Computer Science 2026-01-09 Yuxiao Ye , Yiming Zhang , Yiran Ma , Huiyuan Xie , Huining Zhu , Zhiyuan Liu

Multi-agent systems built from teams of large language models (LLMs) are increasingly deployed for collaborative scientific reasoning and problem-solving. These systems require agents to coordinate under shared constraints, such as GPUs or…

Computation and Language · Computer Science 2026-05-08 Shivani Kumar , Adarsh Bharathwaj , David Jurgens

The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have significantly reshaped…

Artificial Intelligence · Computer Science 2024-07-31 Chunjiang Mu , Hao Guo , Yang Chen , Chen Shen , Shuyue Hu , Zhen Wang