English
Related papers

Related papers: Limits of Theory of Mind Modelling in Dialogue-Bas…

200 papers

Understanding how humans attribute beliefs, goals, and intentions to others, known as theory of mind (ToM), is critical in the context of human-computer interaction. Despite various metrics used to assess ToM, the interplay between…

Human-Computer Interaction · Computer Science 2025-11-11 Thuy Ngoc Nguyen , Jeffrey Flagg , Cleotilde Gonzalez

Effective multi-agent collaboration requires agents to infer the rationale behind others' actions, a capability rooted in Theory-of-Mind (ToM). While recent Large Language Models (LLMs) excel at logical inference, their ability to infer…

Artificial Intelligence · Computer Science 2025-10-07 Fangzhou Liang , Tianshi Zheng , Chunkit Chan , Yauwai Yim , Yangqiu Song

Theory of Mind (ToM) - the ability to attribute beliefs and intents to others - is fundamental for social intelligence, yet Vision-Language Model (VLM) evaluations remain largely Western-centric. In this work, we introduce CulturalToM-VQA,…

Computation and Language · Computer Science 2026-01-08 Zabir Al Nazi , GM Shahariar , Md. Abrar Hossain , Wei Peng

Theory of mind (ToM) evaluations currently focus on testing models using passive narratives that inherently lack interactivity. We introduce FANToM, a new benchmark designed to stress-test ToM within information-asymmetric conversational…

Computation and Language · Computer Science 2023-11-01 Hyunwoo Kim , Melanie Sclar , Xuhui Zhou , Ronan Le Bras , Gunhee Kim , Yejin Choi , Maarten Sap

Developmental psychologists have argued about when cognitive capacities such as language understanding or theory of mind emerge. These debates often hinge on the concept of "task demands" -- the auxiliary challenges associated with…

Computation and Language · Computer Science 2024-07-31 Jennifer Hu , Michael C. Frank

This paper examines the extent to which large language models (LLMs) have developed higher-order theory of mind (ToM); the human ability to reason about multiple mental and emotional states in a recursive manner (e.g. I think that you…

In this paper, we formalise and implement an agent model for cooperation under imperfect information. It is based on Theory of Mind (the cognitive ability to understand the mental state of others) and abductive reasoning (the inference…

Multiagent Systems · Computer Science 2024-02-12 Nieves Montes , Nardine Osman , Carles Sierra

"Thinking is for Doing." Humans can infer other people's mental states from observations--an ability called Theory-of-Mind (ToM)--and subsequently act pragmatically on those inferences. Existing question answering benchmarks such as ToMi…

Theory of Mind (ToM)-the cognitive ability to reason about mental states of ourselves and others, is the foundation of social interaction. Although ToM comes naturally to humans, it poses a significant challenge to even the most advanced…

Computation and Language · Computer Science 2024-07-02 Guiyang Hou , Wenqi Zhang , Yongliang Shen , Linjuan Wu , Weiming Lu

Existing Theory of Mind (ToM) benchmarks diverge from real-world scenarios in three aspects: 1) they assess a limited range of mental states such as beliefs, 2) false beliefs are not comprehensively explored, and 3) the diverse personality…

Computation and Language · Computer Science 2025-01-16 Kazutoshi Shinoda , Nobukatsu Hojo , Kyosuke Nishida , Saki Mizuno , Keita Suzuki , Ryo Masumura , Hiroaki Sugiyama , Kuniko Saito

Large Language Model (LLM)-based agents have significantly impacted Task-Oriented Dialog Systems (TODS) but continue to face notable performance challenges, especially in zero-shot scenarios. While prior work has noted this performance gap,…

Computation and Language · Computer Science 2025-06-17 Avinash Baidya , Kamalika Das , Xiang Gao

When cooperating with a human, a robot should not only care about its environment and task but also develop an understanding of the partner's reasoning. To support its human partner in complex tasks, the robot can share information that it…

Robotics · Computer Science 2021-09-06 Moritz C. Buehler , Jürgen Adamy , Thomas H. Weisswange

Task-Oriented Dialogue (TOD) systems have become crucial components in interactive artificial intelligence applications. While recent advances have capitalized on pre-trained language models (PLMs), they exhibit limitations regarding…

Computation and Language · Computer Science 2023-12-11 Sungryull Sohn , Yiwei Lyu , Anthony Liu , Lajanugen Logeswaran , Dong-Ki Kim , Dongsub Shim , Honglak Lee

Safety fine-tuning in Large Language Models (LLMs) seeks to suppress potentially harmful forms of mind-attribution such as models asserting their own consciousness or claiming to experience emotions. We investigate whether suppressing…

Computation and Language · Computer Science 2026-04-01 Junsol Kim , Winnie Street , Roberta Rocca , Daine M. Korngiebel , Adam Waytz , James Evans , Geoff Keeling

Collective intelligence plays a central role in many fields, from economics and evolutionary theory to neural networks and eusocial insects, and is also core to work on emergence and self-organisation in complex-systems theory. However, in…

Multiagent Systems · Computer Science 2025-07-09 Michael S. Harré , Catherine Drysdale , Jaime Ruiz-Serra

As Large Language Models (LLMs) gain agentic abilities, they will have to navigate complex multi-agent scenarios, interacting with human users and other agents in cooperative and competitive settings. This will require new reasoning skills,…

Artificial Intelligence · Computer Science 2025-06-26 Andrei Lupu , Timon Willi , Jakob Foerster

As LLM-based agents are increasingly interacting in multi-party settings, they need to properly handle information asymmetry, i.e., knowing when and to whom to disclose information is appropriate. Yet, existing benchmarks fail to measure…

Multiagent Systems · Computer Science 2026-05-05 Yashwanth YS , Ruichen Wang , Shihua Zeng , Xuhui Zhou , Koichi Onoue , Vasudha Varadarajan , Maarten Sap

As a foundational component of cognitive intelligence, theory of mind (ToM) can make AI more closely resemble human thought processes, thereby enhancing their interaction and collaboration with human. In particular, it can significantly…

Multimedia · Computer Science 2024-02-13 Yuanyuan Mao , Xin Lin , Qin Ni , Liang He

Our ability to interpret others' mental states through nonverbal cues (NVCs) is fundamental to our survival and social cohesion. While existing Theory of Mind (ToM) benchmarks have primarily focused on false-belief tasks and reasoning with…

Computation and Language · Computer Science 2026-05-18 Seungbeen Lee , Jinhong Jeong , Donghyun Kim , Yejin Son , Youngjae Yu

Theory-of-mind (ToM), a human ability to infer the intentions and thoughts of others, is an essential part of empathetic experiences. We provide here the framework for using NLP models to measure ToM expressed in written texts. For this…

Computation and Language · Computer Science 2021-08-27 Yoon Kyung Lee , Inju Lee , Jae Eun Park , Yoonwon Jung , Jiwon Kim , Sowon Hahn