中文
相关论文

相关论文: Mind the Gap: The Divergence Between Human and LLM…

200 篇论文

Previous work adopts large language models (LLMs) as evaluators to evaluate natural language process (NLP) tasks. However, certain shortcomings, e.g., fairness, scope, and accuracy, persist for current LLM evaluators. To analyze whether…

计算与语言 · 计算机科学 2025-01-22 Qintong Li , Leyang Cui , Lingpeng Kong , Wei Bi

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

计算机科学与博弈论 · 计算机科学 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Large language models (LLMs) like GPT are often conceptualized as passive predictors, simulators, or even stochastic parrots. We instead conceptualize LLMs by drawing on the theory of active inference originating in cognitive science and…

计算与语言 · 计算机科学 2023-11-20 Jan Kulveit , Clem von Stengel , Roman Leventov

One of the most common complaints about large language models (LLMs) is their prompt sensitivity -- that is, the fact that their ability to perform a task or provide a correct answer to a question can depend unpredictably on the way the…

The ability of Large Language Models (LLMs) to mimic human behavior triggered a plethora of computational social science research, assuming that empirical studies of humans can be conducted with AI agents instead. Since there have been…

计算与语言 · 计算机科学 2025-10-21 Simon Münker , Nils Schwager , Achim Rettinger

Abstract concepts - justice, theory, availability - have no single perceivable referent; in the human brain, their meaning emerges from a web of experiences, affect, and social context. Do large language models (LLMs) ground abstract…

计算与语言 · 计算机科学 2026-05-12 Odysseas S. Chlapanis , Orfeas Menis Mastromichalakis , Christos H. Papadimitriou

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

人工智能 · 计算机科学 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

计算与语言 · 计算机科学 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

Although large language models (LLMs) have become more capable and accurate across many tasks, some fundamental sources of unreliability remain in their behavior. One key limitation is their inconsistency at reporting the same information…

计算与语言 · 计算机科学 2025-09-03 Juan Diego Rodriguez , Wenxuan Ding , Katrin Erk , Greg Durrett

This study proposes a framework that employs personality prompting with Large Language Models to generate verbal and nonverbal behaviors for virtual agents based on personality traits. Focusing on extraversion, we evaluated the system in…

人机交互 · 计算机科学 2025-09-01 Bin Han , Deuksin Kwon , Spencer Lin , Kaleen Shrestha , Jonathan Gratch

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

社会与信息网络 · 计算机科学 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

As Natural Language Processing (NLP) systems are increasingly employed in intricate social environments, a pressing query emerges: Can these NLP systems mirror human-esque collaborative intelligence, in a multi-agent society consisting of…

计算与语言 · 计算机科学 2024-05-28 Jintian Zhang , Xin Xu , Ningyu Zhang , Ruibo Liu , Bryan Hooi , Shumin Deng

The cognitive essence of humans is deeply intertwined with the concept of animacy, which plays an essential role in shaping their memory, vision, and multi-layered language understanding. Although animacy appears in language via nuanced…

计算与语言 · 计算机科学 2024-08-13 Leonardo Ranaldi , Giulia Pucci , Fabio Massimo Zanzotto

Modeling coordination among generative agents in complex multi-round decision-making presents a core challenge for AI and operations management. Although behavioral experiments have revealed cognitive biases behind supply chain…

多智能体系统 · 计算机科学 2026-04-21 Jiuyun Jiang , Yuecheng Hong , Bo Yang , Jin Yang , Guangxin Jiang , Xiaomeng Guo , Guang Xiao

Large language models (LLMs) have been shown to acquire sequence-level planning abilities during training, yet their planning behavior exhibited at inference time often appears short-sighted and inconsistent with these capabilities. We…

人工智能 · 计算机科学 2026-02-04 Haijiang Yan , Jian-Qiao Zhu , Adam Sanborn

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

人工智能 · 计算机科学 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Working memory, or the ability to hold and manipulate information in the mind, is a critical component of human intelligence and executive functioning. It is correlated with performance on various cognitive tasks, including measures of…

Large language models (LLMs) are increasingly used to simulate human responses in behavioral research, yet it remains unclear when LLM-generated data support the same experimental inferences as human data. We evaluate this by directly…

人机交互 · 计算机科学 2026-04-20 Adnan Hoq , Tim Weninger

The cognitive mechanism by which Large Language Models (LLMs) solve mathematical problems remains a widely debated and unresolved issue. Currently, there is little interpretable experimental evidence that connects LLMs' problem-solving with…

人工智能 · 计算机科学 2025-09-23 Wei Xie , Shuoyoucheng Ma , Zhenhua Wang , Enze Wang , Kai Chen , Xiaobing Sun , Baosheng Wang

The rapid rise of large language models (LLMs) has shifted artificial intelligence (AI) research toward agentic systems, motivating the use of weaker and more flexible notions of agency. However, this shift raises key questions about the…

人工智能 · 计算机科学 2025-10-27 Vince Trencsenyi , Agnieszka Mensfelt , Kostas Stathis