English
Related papers

Related papers: Multi-ToM: Evaluating Multilingual Theory of Mind …

200 papers

Theory of Mind (ToM) is central to social cognition and human-AI interaction, and Large Language Models (LLMs) have been used to help understand and represent ToM. However, most evaluations treat ToM as a static judgment at a single moment,…

Artificial Intelligence · Computer Science 2026-03-17 Thuy Ngoc Nguyen , Duy Nhat Phan , Cleotilde Gonzalez

Datasets used for emotion recognition tasks typically contain overt cues that can be used in predicting the emotions expressed in a text. However, one challenge is that texts sometimes contain covert contextual cues that are rich in…

Computation and Language · Computer Science 2025-06-03 Gerard Christopher Yeo , Kokil Jaidka

Being able to predict the mental states of others is a key factor to effective social interaction. It is also crucial for distributed multi-agent systems, where agents are required to communicate and cooperate. In this paper, we introduce…

Multiagent Systems · Computer Science 2022-04-26 Yuanfei Wang , Fangwei Zhong , Jing Xu , Yizhou Wang

The last couple of years have witnessed emerging research that appropriates Theory-of-Mind (ToM) tasks designed for humans to benchmark LLM's ToM capabilities as an indication of LLM's social intelligence. However, this approach has a…

Human-Computer Interaction · Computer Science 2025-04-16 Qiaosi Wang , Xuhui Zhou , Maarten Sap , Jodi Forlizzi , Hong Shen

Theory of Mind (ToM)-the cognitive ability to reason about mental states of ourselves and others, is the foundation of social interaction. Although ToM comes naturally to humans, it poses a significant challenge to even the most advanced…

Computation and Language · Computer Science 2024-07-02 Guiyang Hou , Wenqi Zhang , Yongliang Shen , Linjuan Wu , Weiming Lu

This paper investigates whether LMs recruit shared computational mechanisms for general Theory of Mind (ToM) and language-specific pragmatic reasoning in order to contribute to the general question of whether LMs may be said to have…

Computation and Language · Computer Science 2026-04-28 Polina Tsvilodub , Jan-Felix Klumpp , Amir Mohammadpour , Jennifer Hu , Michael Franke

This paper examines the extent to which large language models (LLMs) have developed higher-order theory of mind (ToM); the human ability to reason about multiple mental and emotional states in a recursive manner (e.g. I think that you…

Social reasoning necessitates the capacity of theory of mind (ToM), the ability to contextualise and attribute mental states to others without having access to their internal cognitive structure. Recent machine learning approaches to ToM…

Artificial Intelligence · Computer Science 2023-01-18 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Human social interactions depend on the ability to infer others' unspoken intentions, emotions, and beliefs-a cognitive skill grounded in the psychological concept of Theory of Mind (ToM). While large language models (LLMs) excel in…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

Improving the Theory of Mind (ToM) capability of Large Language Models (LLMs) is crucial for effective social interactions between these AI models and humans. However, the existing benchmarks often measure ToM capability improvement through…

Artificial Intelligence · Computer Science 2026-05-18 Nanxu Gong , Zixin Chen , Haotian Li , Zishu Zhao , Jianxun Lian , Huamin Qu , Yanjie Fu , Xing Xie

We introduce StorySim, a programmable framework for synthetically generating stories to evaluate the theory of mind (ToM) and world modeling (WM) capabilities of large language models (LLMs). Unlike prior benchmarks that may suffer from…

Computation and Language · Computer Science 2026-04-28 Nathaniel Getachew , Abulhair Saparov

When researchers claim AI systems possess ToM or mental models, they are fundamentally discussing behavioral predictions and bias corrections rather than genuine mental states. This position paper argues that the current discourse conflates…

Human-Computer Interaction · Computer Science 2025-10-06 Xiaoyun Yin , Elmira Zahmat Doost , Shiwen Zhou , Garima Arya Yadav , Jamie C. Gorman

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

Theory-of-Mind (ToM), the ability to infer others' perceptions and mental states, is fundamental to human interaction but remains challenging for Large Language Models (LLMs). While existing ToM reasoning methods show promise with reasoning…

Computation and Language · Computer Science 2025-06-03 Hainiu Xu , Siya Qi , Jiazheng Li , Yuxiang Zhou , Jinhua Du , Caroline Catmur , Yulan He

As the capabilities of large language models (LLMs) continue to advance, the importance of rigorous safety evaluation is becoming increasingly evident. Recent concerns within the realm of safety assessment have highlighted instances in…

Computation and Language · Computer Science 2025-07-03 Tatsuhiro Aoshima , Mitsuaki Akiyama

Theory of Mind (ToM) significantly impacts human collaboration and communication as a crucial capability to understand others. When AI agents with ToM capability collaborate with humans, Mutual Theory of Mind (MToM) arises in such human-AI…

Human-Computer Interaction · Computer Science 2024-09-16 Shao Zhang , Xihuai Wang , Wenhao Zhang , Yongshan Chen , Landi Gao , Dakuo Wang , Weinan Zhang , Xinbing Wang , Ying Wen

Theory of Mind (ToM) in Large Language Models (LLMs) refers to the model's ability to infer the mental states of others, with failures in this ability often manifesting as systemic implicit biases. Assessing this challenge is difficult, as…

Computation and Language · Computer Science 2026-01-19 Yanlin Li , Hao Liu , Huimin Liu , Kun Wang , Yinwei Wei , Yupeng Hu

Theory of Mind (ToM) can be used to assess the capabilities of Large Language Models (LLMs) in complex scenarios where social reasoning is required. While the research community has proposed many ToM benchmarks, their hardness varies…

Artificial Intelligence · Computer Science 2024-10-10 X. Angelo Huang , Emanuele La Malfa , Samuele Marro , Andrea Asperti , Anthony Cohn , Michael Wooldridge

The ability to interpret the mental state of another agent based on its behavior, also called Theory of Mind (ToM), is crucial for humans in any kind of social interaction. Artificial systems, such as intelligent assistants, would also…

Artificial Intelligence · Computer Science 2019-09-24 Jan Pöppel , Stefan Kopp

Theory of Mind (ToM) -- the ability to understand that others can have differing knowledge and goals -- enables agents to reason about others' beliefs while planning their own actions. We present a novel approach to multi-agent cooperation…

Artificial Intelligence · Computer Science 2025-09-05 Riddhi J. Pitliya , Ozan Çatal , Toon Van de Maele , Corrado Pezzato , Tim Verbelen