English
Related papers

Related papers: Does ChatGPT have Theory of Mind?

200 papers

Theory-of-mind (ToM), a human ability to infer the intentions and thoughts of others, is an essential part of empathetic experiences. We provide here the framework for using NLP models to measure ToM expressed in written texts. For this…

Computation and Language · Computer Science 2021-08-27 Yoon Kyung Lee , Inju Lee , Jae Eun Park , Yoonwon Jung , Jiwon Kim , Sowon Hahn

Theory-of-Mind (ToM) is a core human cognitive capacity for attributing mental states to self and others. Wimmer and Perner demonstrated that humans progress from first- to higher-order ToM within a short span, completing this development…

Artificial Intelligence · Computer Science 2025-10-01 Yiming Wang , Rui Wang

The adaptation to users' preferences and the ability to infer and interpret humans' beliefs and intents, which is known as the Theory of Mind (ToM), are two crucial aspects for achieving effective human-robot collaboration. Despite its…

Robotics · Computer Science 2025-11-05 Antonio Andriella , Giovanni Falcone , Silvia Rossi

Large language models (LLMs) have shown strong performance across natural language reasoning tasks, yet their reasoning processes remain brittle and difficult to interpret. Prompting techniques like Chain-of-Thought (CoT) enhance…

Computation and Language · Computer Science 2025-08-01 Samir Abdaljalil , Hasan Kurban , Khalid Qaraqe , Erchin Serpedin

While Large Language Models (LLMs) have demonstrated impressive accomplishments in both reasoning and planning, their abilities in multi-agent collaborations remains largely unexplored. This study evaluates LLM-based agents in a multi-agent…

Computation and Language · Computer Science 2024-06-28 Huao Li , Yu Quan Chong , Simon Stepputtis , Joseph Campbell , Dana Hughes , Michael Lewis , Katia Sycara

Discrepancies between an agent's actual knowledge and what a person thinks the agent knows can hinder interactions. If an agent could detect such discrepancies, it could provide feedback to account for them and improve current and future…

Human-Computer Interaction · Computer Science 2026-05-14 Patrick Callaghan , Reid Simmons , Henny Admoni

We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-of-Thought or Tree of Thoughts (ToT). The key idea and primary advantage…

As Large Language Models (LLMs) increasingly participate in human-AI interactions, evaluating their Theory of Mind (ToM) capabilities - particularly their ability to track dynamic mental states - becomes crucial. While existing benchmarks…

Computation and Language · Computer Science 2025-06-10 Yang Xiao , Jiashuo Wang , Qiancheng Xu , Changhe Song , Chunpu Xu , Yi Cheng , Wenjie Li , Pengfei Liu

This study explored how large language models (LLMs) perform in two areas related to art: writing critiques of artworks and reasoning about mental states (Theory of Mind, or ToM) in art-related situations. For the critique generation part,…

Computation and Language · Computer Science 2025-09-16 Takaya Arita , Wenxian Zheng , Reiji Suzuki , Fuminori Akiba

We introduce StorySim, a programmable framework for synthetically generating stories to evaluate the theory of mind (ToM) and world modeling (WM) capabilities of large language models (LLMs). Unlike prior benchmarks that may suffer from…

Computation and Language · Computer Science 2026-04-28 Nathaniel Getachew , Abulhair Saparov

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi

An ideal integration of autonomous agents in a human world implies that they are able to collaborate on human terms. In particular, theory of mind plays an important role in maintaining common ground during human collaboration and…

Artificial Intelligence · Computer Science 2023-05-22 Cristian-Paul Bara , Sky CH-Wang , Joyce Chai

A Large Language Model (LLM) is an artificial intelligence system that has been trained on vast amounts of natural language data, enabling it to generate human-like responses to written or spoken language input. GPT-3.5 is an example of an…

Artificial Intelligence · Computer Science 2023-05-09 Gaurav Suri , Lily R. Slater , Ali Ziaee , Morgan Nguyen

As the performance of larger, newer Large Language Models continues to improve for strategic Theory of Mind (ToM) tasks, the demand for these state-of-the-art models increases commensurately. However, their deployment is costly both in…

Computation and Language · Computer Science 2024-11-01 Nunzio Lore , Sepehr Ilami , Babak Heydari

Persuasive dialogue requires reasoning about others' latent mental states, a capability known as Theory of Mind (ToM). However, due to reliance on simple prompting strategies and insufficient ToM knowledge, existing LLMs often fail to…

Artificial Intelligence · Computer Science 2026-05-22 Minghui Ma , Bin Guo , Runze Yang , Mengqi Chen , Yan Liu , Jingqi Liu , Yahan Pei , Xuehao Ma , Qiuyun Zhang , Zhiwen Yu

The use of LLMs in natural language reasoning has shown mixed results, sometimes rivaling or even surpassing human performance in simpler classification tasks while struggling with social-cognitive reasoning, a domain where humans naturally…

Computation and Language · Computer Science 2024-10-23 Fiona Anting Tan , Gerard Christopher Yeo , Kokil Jaidka , Fanyou Wu , Weijie Xu , Vinija Jain , Aman Chadha , Yang Liu , See-Kiong Ng

Good teachers always tailor their explanations to the learners. Cognitive scientists model this process under the rationality principle: teachers try to maximise the learner's utility while minimising teaching costs. To this end, human…

Machine Learning · Computer Science 2023-10-02 Clémence Grislain , Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

Typically, when evaluating Theory of Mind, we consider the beliefs of others to be binary: held or not held. But what if someone is unsure about their own beliefs? How can we quantify this uncertainty? We propose a new suite of tasks,…

Computation and Language · Computer Science 2024-09-24 Anthony Sicilia , Malihe Alikhani

Theory of Mind (ToM) reasoning with Large Language Models (LLMs) requires inferring how people's implicit, evolving beliefs shape what they seek and how they act under uncertainty -- especially in high-stakes settings such as disaster…

Artificial Intelligence · Computer Science 2026-03-23 Ruxiao Chen , Xilei Zhao , Thomas J. Cova , Frank A. Drews , Susu Xu

Despite rapid progress in multimodal large language models (MLLMs), their capability for deep emotional understanding remains limited. We argue that genuine affective intelligence requires explicit modeling of Theory of Mind (ToM), the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Meng Luo , Bobo Li , Shanqing Xu , Shize Zhang , Qiuchan Chen , Menglu Han , Wenhao Chen , Yanxiang Huang , Hao Fei , Mong-Li Lee , Wynne Hsu