中文
相关论文

相关论文: AMONGAGENTS: Evaluating Large Language Models in t…

200 篇论文

We introduce a large scale crowdsourced text adventure game as a research platform for studying grounded dialogue. In it, agents can perceive, emote, and act whilst conducting dialogue with other agents. Models and humans can both act as…

Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning. While previous studies have extensively examined biases related to protected attributes such…

人工智能 · 计算机科学 2025-06-03 Min Choi , Keonwoo Kim , Sungwon Chae , Sangyeob Baek

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

人工智能 · 计算机科学 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

The rise of Large Language Models (LLMs) has affected various disciplines that got beyond mere text generation. Going beyond their textual nature, this project proposal aims to investigate the interaction between LLMs and non-verbal…

计算与语言 · 计算机科学 2024-02-01 Philipp Wicke

This pilot study explores the application of language models (LMs) to model game event sequences, treating them as a customized natural language. We investigate a popular mobile game, transforming raw event data into textual sequences and…

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

计算与语言 · 计算机科学 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Large language models (LLMs) are increasingly deployed to support human decision-making. This use of LLMs has concerning implications, especially when their prescriptions affect the welfare of others. To gauge how LLMs make social…

计算机与社会 · 计算机科学 2026-01-16 Saptarshi Pal , Abhishek Mallela , Christian Hilbe , Lenz Pracher , Chiyu Wei , Feng Fu , Santiago Schnell , Martin A Nowak

To some, the advent of artificial intelligence (AI) promises better decision-making and increased military effectiveness while reducing the influence of human error and emotions. However, there is still debate about how AI systems,…

计算机与社会 · 计算机科学 2024-10-04 Max Lamparth , Anthony Corso , Jacob Ganz , Oriana Skylar Mastro , Jacquelyn Schneider , Harold Trinkunas

This survey explores the burgeoning field of role-playing with language models, focusing on their development from early persona-based models to advanced character-driven simulations facilitated by Large Language Models (LLMs). Initially…

人工智能 · 计算机科学 2025-01-13 Nuo Chen , Yan Wang , Yang Deng , Jia Li

Large language model (LLM) agents have shown remarkable progress in social deduction games (SDGs). However, existing approaches primarily focus on information processing and strategy selection, overlooking the significance of persuasive…

人工智能 · 计算机科学 2026-04-15 Zhang Zheng , Deheng Ye , Peilin Zhao , Hao Wang

As Large Language Model (LLM)-based agents increasingly engage with human society, how well do we understand their prosocial behaviors? We (1) investigate how LLM agents' prosocial behaviors can be induced by different personas and…

计算与语言 · 计算机科学 2025-11-19 Ji Ma

As Large Language Models (LLMs) are increasingly deployed in social and strategic scenarios, it becomes critical to understand where and why their behavior diverges from that of humans. While behavioral game theory (BGT) provides a…

人工智能 · 计算机科学 2026-02-12 Caroline Wang , Daniel Kasenberg , Kim Stachenfeld , Pablo Samuel Castro

Interactive Fiction games (IF games) are where players interact through natural language commands. While recent advances in Artificial Intelligence agents have reignited interest in IF games as a domain for studying decision-making,…

计算与语言 · 计算机科学 2025-05-20 Jinming Zhang , Yunfei Long

Reliable simulation of human behavior is essential for explaining, predicting, and intervening in our society. Recent advances in large language models (LLMs) have shown promise in emulating human behaviors, interactions, and…

计算与语言 · 计算机科学 2025-10-27 Ning Bian , Xianpei Han , Hongyu Lin , Baolei Wu , Jun Wang

Ideal or real - that is the question.In this work, we explore whether principles from game theory can be effectively applied to the evaluation of large language models (LLMs). This inquiry is motivated by the growing inadequacy of…

计算与语言 · 计算机科学 2026-04-07 Gao Yang , Yuhang Liu , Siyu Miao , Xinyue Liang , Zhengyang Liu , Heyan Huang

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

计算与语言 · 计算机科学 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

Large language models (LLMs) are effective at answering questions that are clearly asked. However, when faced with ambiguous queries they can act unpredictably and produce incorrect outputs. This underscores the need for the development of…

计算与语言 · 计算机科学 2024-02-22 Yizhe Zhang , Jiarui Lu , Navdeep Jaitly

This paper introduces TurnaboutLLM, a novel framework and dataset for evaluating the deductive reasoning abilities of Large Language Models (LLMs) by leveraging the interactive gameplay of detective games Ace Attorney and Danganronpa. The…

计算与语言 · 计算机科学 2025-09-23 Yuan Yuan , Muyu He , Muhammad Adil Shahid , Jiani Huang , Ziyang Li , Li Zhang

Within the domain of Massively Multiplayer Online (MMO) economy research, Agent-Based Modeling (ABM) has emerged as a robust tool for analyzing game economics, evolving from rule-based agents to decision-making agents enhanced by…