English
Related papers

Related papers: Approximating Human Strategic Reasoning with LLM-E…

200 papers

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

We introduce WellPlay, a reasoning dataset for multi-agent conversational inference in Murder Mystery Games (MMGs). WellPlay comprises 1,482 inferential questions across 12 games, spanning objectives, reasoning, and relationship…

Computation and Language · Computer Science 2025-05-21 Qinglin Zhu , Runcong Zhao , Bin Liang , Jinhua Du , Lin Gui , Yulan He

Large Language Models (LLMs) have enabled Multi-Agent Systems (MASs) where agents interact through natural language to solve complex tasks or simulate multi-party dialogues. Recent work on LLM-based MASs has mainly focused on architecture…

Computation and Language · Computer Science 2026-01-09 Yuxiao Ye , Yiming Zhang , Yiran Ma , Huiyuan Xie , Huining Zhu , Zhiyuan Liu

Game-playing ability serves as an indicator for evaluating the strategic reasoning capability of large language models (LLMs). While most existing studies rely on utility performance metrics, which are not robust enough due to variations in…

Artificial Intelligence · Computer Science 2025-08-19 Hongtao Liu , Zhicheng Du , Zihe Wang , Weiran Shen

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

Computation and Language · Computer Science 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen

Classical game-theoretic models typically assume rational agents, complete information, and common knowledge of payoffs - assumptions that are often violated in real-world MAS characterized by uncertainty, misaligned perceptions, and nested…

Artificial Intelligence · Computer Science 2026-02-16 Vince Trencsenyi , Agnieszka Mensfelt , Kostas Stathis

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

Artificial Intelligence · Computer Science 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

Large language models have demonstrated remarkable few-shot performance on many natural language understanding tasks. Despite several demonstrations of using large language models in complex, strategic scenarios, there lacks a comprehensive…

Computation and Language · Computer Science 2024-07-23 Anthony Costarelli , Mat Allen , Roman Hauksson , Grace Sodunke , Suhas Hariharan , Carlson Cheng , Wenjie Li , Joshua Clymer , Arjun Yadav

As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments…

Computation and Language · Computer Science 2024-06-11 Jinhao Duan , Renming Zhang , James Diffenderfer , Bhavya Kailkhura , Lichao Sun , Elias Stengel-Eskin , Mohit Bansal , Tianlong Chen , Kaidi Xu

This paper introduces a novel framework for modeling interacting humans in a multi-stage game. This "iterated semi network-form game" framework has the following desirable characteristics: (1) Bounded rational players, (2) strategic players…

Multiagent Systems · Computer Science 2012-07-05 Ritchie Lee , David H. Wolpert , James Bono , Scott Backhaus , Russell Bent , Brendan Tracey

Humans are capable of attributing latent mental contents such as beliefs or intentions to others. The social skill is critical in daily life for reasoning about the potential consequences of others' behaviors so as to plan ahead. It is…

Machine Learning · Computer Science 2019-03-04 Ying Wen , Yaodong Yang , Rui Luo , Jun Wang , Wei Pan

The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environments. As reasoning in highly reactive environments, we identify the setting in which a knowledge-based agent, with given goals, is deployed in an environment subject…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Pacenza

Large Language Models (LLMs) have demonstrated notable capabilities across various tasks, showcasing complex problem-solving abilities. Understanding and executing complex rules, along with multi-step planning, are fundamental to logical…

Artificial Intelligence · Computer Science 2024-10-15 Jiayi Gui , Yiming Liu , Jiale Cheng , Xiaotao Gu , Xiao Liu , Hongning Wang , Yuxiao Dong , Jie Tang , Minlie Huang

Though limited in real-world decision making, most multi-agent reinforcement learning (MARL) models assume perfectly rational agents -- a property hardly met due to individual's cognitive limitation and/or the tractability of the decision…

Artificial Intelligence · Computer Science 2020-01-22 Ying Wen , Yaodong Yang , Rui Luo , Jun Wang

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

Computation and Language · Computer Science 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

Large language models (LLMs) are increasingly used as judges to evaluate agent performance, particularly in non-verifiable settings where judgments rely on agent trajectories including chain-of-thought (CoT) reasoning. This paradigm…

Artificial Intelligence · Computer Science 2026-01-23 Muhammad Khalifa , Lajanugen Logeswaran , Jaekyeom Kim , Sungryull Sohn , Yunxiang Zhang , Moontae Lee , Hao Peng , Lu Wang , Honglak Lee

Game balancing is a longstanding challenge requiring repeated playtesting, expert intuition, and extensive manual tuning. We introduce RuleSmith, the first framework that achieves automated game balancing by leveraging the reasoning…

Machine Learning · Computer Science 2026-02-09 Ziyao Zeng , Chen Liu , Tianyu Liu , Hao Wang , Xiatao Sun , Fengyu Yang , Xiaofeng Liu , Zhiwen Fan

Remarkable performance of large language models (LLMs) in a variety of tasks brings forth many opportunities as well as challenges of utilizing them in production settings. Towards practical adoption of LLMs, multi-agent systems hold great…

Computation and Language · Computer Science 2024-02-05 Pouya Pezeshkpour , Eser Kandogan , Nikita Bhutani , Sajjadur Rahman , Tom Mitchell , Estevam Hruschka