English
Related papers

Related papers: Beyond Survival: Evaluating LLMs in Social Deducti…

200 papers

The growing popularity of social deduction games has created an increasing need for intelligent frameworks where humans can collaborate with AI agents, particularly in post-pandemic contexts with heightened psychological and social…

Computation and Language · Computer Science 2025-08-12 Qihui Fan , Wenbo Li , Enfu Nan , Yixiao Chen , Lei Lu , Pu Zhao , Yanzhi Wang

This paper introduces Werewolf Arena, a novel framework for evaluating large language models (LLMs) through the lens of the classic social deduction game, Werewolf. In Werewolf Arena, LLMs compete against each other, navigating the game's…

Computation and Language · Computer Science 2024-07-22 Suma Bailis , Jane Friedhoff , Feiyang Chen

Deception is a fundamental challenge for multi-agent reasoning: effective systems must strategically conceal information while detecting misleading behavior in others. Yet most evaluations reduce deception to static classification, ignoring…

Multiagent Systems · Computer Science 2025-12-11 Mrinal Agarwal , Saad Rana , Theo Sundoro , Hermela Berhe , Spencer Kim , Vasu Sharma , Sean O'Brien , Kevin Zhu

This paper presents an innovative framework that integrates Large Language Models (LLMs) with an external Thinker module to enhance the reasoning capabilities of LLM-based agents. Unlike augmenting LLMs with prompt engineering, Thinker…

Artificial Intelligence · Computer Science 2024-04-01 Shuang Wu , Liwen Zhu , Tao Yang , Shiwei Xu , Qiang Fu , Yang Wei , Haobo Fu

Agents built with large language models (LLMs) have shown great potential across a wide range of domains. However, in complex decision-making tasks, pure LLM-based agents tend to exhibit intrinsic bias in their choice of actions, which is…

Artificial Intelligence · Computer Science 2025-05-30 Zelai Xu , Chao Yu , Fei Fang , Yu Wang , Yi Wu

Recent advancements in natural language processing, particularly with large language models (LLMs) like GPT-4, have significantly enhanced dialogue systems, enabling them to generate more natural and fluent conversations. Despite these…

Computation and Language · Computer Science 2024-09-05 Zhiyang Qi , Michimasa Inaba

Communication games, which we refer to as incomplete information games that heavily depend on natural language communication, hold significant research value in fields such as economics, social science, and artificial intelligence. In this…

Computation and Language · Computer Science 2024-05-14 Yuzhuang Xu , Shuo Wang , Peng Li , Fuwen Luo , Xiaolong Wang , Weidong Liu , Yang Liu

Large Language Models (LLMs) have advanced the capability of game agents in social deduction games (SDGs). These games rely heavily on conversation-driven interactions and require agents to infer, make decisions, and express based on such…

Artificial Intelligence · Computer Science 2025-01-14 Zheng Zhang , Yihuai Lan , Yangsen Chen , Lei Wang , Xiang Wang , Hao Wang

With the rapid development of LLM-based agents, increasing attention has been given to their social interaction and strategic reasoning capabilities. However, existing Werewolf-based benchmarking platforms suffer from overly simplified game…

Artificial Intelligence · Computer Science 2025-06-17 Xinyuan Xia , Yuanyi Song , Haomin Ma , Jinyu Cai

Werewolf is an incomplete information game, which has several challenges when creating a computer agent as a player given the lack of understanding of the situation and individuality of utterance (e.g., computer agents are not capable of…

Computation and Language · Computer Science 2024-09-04 Takehiro Sato , Shintaro Ozaki , Daisaku Yokoyama

Large language models (LLMs) have exhibited memorable strategic behaviors in social deductive games. However, the significance of opinion leadership exhibited by LLM-based agents has been largely overlooked, which is crucial for practical…

Computation and Language · Computer Science 2024-08-30 Silin Du , Xiaowei Zhang

Persuasion modeling is a key building block for conversational agents. Existing works in this direction are limited to analyzing textual dialogue corpus. We argue that visual signals also play an important role in understanding human…

Machine Learning · Computer Science 2022-12-19 Bolin Lai , Hongxin Zhang , Miao Liu , Aryan Pariani , Fiona Ryan , Wenqi Jia , Shirley Anugrah Hayati , James M. Rehg , Diyi Yang

The Werewolf game is a social deduction game based on free natural language communication, in which players try to deceive others in order to survive. An important feature of this game is that a large portion of the conversations are false…

Artificial Intelligence · Computer Science 2023-02-22 Hisaichi Shibata , Soichiro Miki , Yuta Nakamura

The Werewolf Game is a communication game where players' reasoning and discussion skills are essential. In this study, we present a Werewolf AI agent developed for the AIWolfDial 2024 shared task, co-hosted with the 17th INLG. In recent…

Large Language Model (LLM) agents have demonstrated impressive capabilities in social deduction games (SDGs) like Werewolf, where strategic reasoning and social deception are essential. However, current approaches remain limited to textual…

Artificial Intelligence · Computer Science 2025-09-16 Zheng Zhang , Nuoqian Xiao , Qi Chai , Deheng Ye , Hao Wang

Large language models (LLMs) are increasingly deployed to support human decision-making. This use of LLMs has concerning implications, especially when their prescriptions affect the welfare of others. To gauge how LLMs make social…

Computers and Society · Computer Science 2026-01-16 Saptarshi Pal , Abhishek Mallela , Christian Hilbe , Lenz Pracher , Chiyu Wei , Feng Fu , Santiago Schnell , Martin A Nowak

Large language models (LLMs) are increasingly used for tasks that require complex reasoning. Most benchmarks focus on final outcomes but overlook the intermediate reasoning steps - such as planning, revision, and decision making under…

Artificial Intelligence · Computer Science 2025-06-16 Xiaopeng Yuan , Xingjian Zhang , Ke Xu , Yifan Xu , Lijun Yu , Jindong Wang , Yushun Dong , Haohan Wang

This paper focuses on the emergence of communication to support cooperation in environments modeled as social deduction games (SDG), that are games where players communicate freely to deduce each others' hidden intentions. We first state…

Multiagent Systems · Computer Science 2021-11-09 Nicolo' Brandizzi , Davide Grossi , Luca Iocchi

As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments…

Computation and Language · Computer Science 2024-06-11 Jinhao Duan , Renming Zhang , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Elias Stengel-Eskin , Mohit Bansal , Tianlong Chen , Kaidi Xu

Recent studies have investigated whether large language models (LLMs) can support obscured communication, which is characterized by core aspects such as inferring subtext and evading suspicions. To conduct the investigation, researchers…

Artificial Intelligence · Computer Science 2025-10-08 Byungjun Kim , Dayeon Seo , Minju Kim , Bugeun Kim
‹ Prev 1 2 3 10 Next ›