English
Related papers

Related papers: Think Twice: Perspective-Taking Improves Large Lan…

200 papers

As Large Language Models (LLMs) become increasingly integrated into our everyday lives, understanding their ability to comprehend human mental states becomes critical for ensuring effective interactions. However, despite the recent attempts…

Computation and Language · Computer Science 2023-12-06 Kanishk Gandhi , Jan-Philipp Fränken , Tobias Gerstenberg , Noah D. Goodman

Datasets used for emotion recognition tasks typically contain overt cues that can be used in predicting the emotions expressed in a text. However, one challenge is that texts sometimes contain covert contextual cues that are rich in…

Computation and Language · Computer Science 2025-06-03 Gerard Christopher Yeo , Kokil Jaidka

This paper examines the extent to which large language models (LLMs) have developed higher-order theory of mind (ToM); the human ability to reason about multiple mental and emotional states in a recursive manner (e.g. I think that you…

Humans continuously infer the states, goals, and behaviors of others by perceiving their surroundings in dynamic, real-world social interactions. However, most Theory of Mind (ToM) benchmarks only evaluate static, text-based scenarios,…

Computation and Language · Computer Science 2025-12-16 Xianzhe Fan , Xuhui Zhou , Chuanyang Jin , Kolby Nottingham , Hao Zhu , Maarten Sap

Theory of Mind (ToM) -- the ability to understand that others can have differing knowledge and goals -- enables agents to reason about others' beliefs while planning their own actions. We present a novel approach to multi-agent cooperation…

Artificial Intelligence · Computer Science 2025-09-05 Riddhi J. Pitliya , Ozan Çatal , Toon Van de Maele , Corrado Pezzato , Tim Verbelen

Unlike current state-of-the-art language models, young children actively acquire language through interactions with their surrounding environment and caretakers. One mechanism that has been argued to be critical to language learning is the…

Computation and Language · Computer Science 2023-03-03 Andy Liu , Hao Zhu , Emmy Liu , Yonatan Bisk , Graham Neubig

Theory of Mind (ToM) is the ability to attribute mental states to others, the basis of human cognition. At present, there has been growing interest in the AI with cognitive abilities, for example in healthcare and the motoring industry.…

Artificial Intelligence · Computer Science 2023-03-22 Yuanyuan Mao , Shuang Liu , Pengshuai Zhao , Qin Ni , Xin Lin , Liang He

We introduce DialToM, an annotated Theory of Mind (ToM) benchmark built from naturalistic human-human dialogues using a multiple-choice evaluation framework. Concurrent with recent work showing a gap between explicit mental-state inference…

Computation and Language · Computer Science 2026-05-29 Neemesh Yadav , Palakorn Achananuparp , Jing Jiang , Ee-Peng Lim

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

Multiagent Systems · Computer Science 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng

Theory of Mind (ToM) reasoning with Large Language Models (LLMs) requires inferring how people's implicit, evolving beliefs shape what they seek and how they act under uncertainty -- especially in high-stakes settings such as disaster…

Artificial Intelligence · Computer Science 2026-03-23 Ruxiao Chen , Xilei Zhao , Thomas J. Cova , Frank A. Drews , Susu Xu

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

As large language models evolve, there is growing anticipation that they will emulate human-like Theory of Mind (ToM) to assist with routine tasks. However, existing methods for evaluating machine ToM focus primarily on unimodal models and…

Artificial Intelligence · Computer Science 2025-06-18 Xinyang Li , Siqi Liu , Bochao Zou , Jiansheng Chen , Huimin Ma

Theory of mind (ToM) evaluations currently focus on testing models using passive narratives that inherently lack interactivity. We introduce FANToM, a new benchmark designed to stress-test ToM within information-asymmetric conversational…

Computation and Language · Computer Science 2023-11-01 Hyunwoo Kim , Melanie Sclar , Xuhui Zhou , Ronan Le Bras , Gunhee Kim , Yejin Choi , Maarten Sap

Large language models (LLMs) are increasingly tested for a "Theory of Mind" (ToM) - the ability to attribute mental states to oneself and others. Yet most evaluations stop at explicit belief attribution in classical toy stories or stylized…

Computation and Language · Computer Science 2026-03-03 Yuling Gu , Oyvind Tafjord , Hyunwoo Kim , Jared Moore , Ronan Le Bras , Peter Clark , Yejin Choi

Natural language interaction with agentic Artificial Intelligence (AI), driven by Large Language Models (LLMs), is expected to remain a dominant paradigm in the near future. While humans instinctively align their communication with mental…

Computation and Language · Computer Science 2025-05-21 Mehdi Jafari , Devin Yuncheng Hua , Hao Xue , Flora Salim

Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities…

Robotics · Computer Science 2024-01-18 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Theory of Mind (ToM) can be used to assess the capabilities of Large Language Models (LLMs) in complex scenarios where social reasoning is required. While the research community has proposed many ToM benchmarks, their hardness varies…

Artificial Intelligence · Computer Science 2024-10-10 X. Angelo Huang , Emanuele La Malfa , Samuele Marro , Andrea Asperti , Anthony Cohn , Michael Wooldridge

Theory-of-Mind (ToM) ability possessed by Large Language Models (LLMs) has been shown to be limited. Most existing methods for improving ToM in LLMs adopt zero-shot prompting, and they face challenges including poor performance in complex…

Computation and Language · Computer Science 2024-09-23 Zizheng Lin , Chunkit Chan , Yangqiu Song , Xin Liu

Large language models (LLMs) excel in many tasks in 2023, but they still face challenges in complex reasoning. Theory-of-mind (ToM) tasks, which require understanding agents' beliefs, goals, and mental states, are essential for common-sense…

Artificial Intelligence · Computer Science 2023-04-27 Shima Rahimi Moghaddam , Christopher J. Honey

Large Language Models (LLMs) have generated considerable interest and debate regarding their potential emergence of Theory of Mind (ToM). Several recent inquiries reveal a lack of robust ToM in these models and pose a pressing demand to…

Computation and Language · Computer Science 2024-12-30 Ziqiao Ma , Jacob Sansom , Run Peng , Joyce Chai