English
Related papers

Related papers: Probing the Robustness of Theory of Mind in Large …

200 papers

Whether Large Language Models (LLMs) truly possess human-like Theory of Mind (ToM) capabilities has garnered increasing attention. However, existing benchmarks remain largely restricted to narrow paradigms like false belief tasks, failing…

Artificial Intelligence · Computer Science 2026-01-23 Haibo Tong , Zeyang Yue , Feifei Zhao , Erliang Lin , Lu Jia , Ruolin Chen , Yinqian Sun , Qian Zhang , Yi Zeng

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

Evaluating the theory of mind (ToM) capabilities of language models (LMs) has recently received a great deal of attention. However, many existing benchmarks rely on synthetic data, which risks misaligning the resulting experiments with…

Computation and Language · Computer Science 2024-06-11 Adil Soubki , John Murzaku , Arash Yousefi Jordehi , Peter Zeng , Magdalena Markowska , Seyed Abolghasem Mirroshandel , Owen Rambow

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

Recent work on dialogue-based collaborative plan acquisition (CPA) has suggested that Theory of Mind (ToM) modelling can improve missing knowledge prediction in settings with asymmetric skill-sets and knowledge. Although ToM was claimed to…

Artificial Intelligence · Computer Science 2024-05-30 Matteo Bortoletto , Constantin Ruhdorfer , Adnen Abdessaied , Lei Shi , Andreas Bulling

Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to…

Artificial Intelligence · Computer Science 2023-11-20 Alex Wilf , Sihyun Shawn Lee , Paul Pu Liang , Louis-Philippe Morency

We propose a hybrid approach to machine Theory of Mind (ToM) that uses large language models (LLMs) as a mechanism for generating hypotheses and likelihood functions with a Bayesian inverse planning model that computes posterior…

Artificial Intelligence · Computer Science 2025-07-08 Rebekah A. Gelpí , Eric Xue , William A. Cunningham

Theory of Mind (ToM) is a critical component of intelligence but its assessment remains the subject of heated debates. Prior research applied human ToM assessments to natural language processing models using either human-created…

Computation and Language · Computer Science 2023-11-08 Damien Sileo , Antoine Lernould

Theory of Mind (ToM) is central to social cognition and human-AI interaction, and Large Language Models (LLMs) have been used to help understand and represent ToM. However, most evaluations treat ToM as a static judgment at a single moment,…

Artificial Intelligence · Computer Science 2026-03-17 Thuy Ngoc Nguyen , Duy Nhat Phan , Cleotilde Gonzalez

Theory-of-Mind (ToM) enables humans to infer mental states-such as beliefs, desires, and intentions-forming the foundation of social cognition. However, existing computational ToM methods rely on structured workflows with ToM-specific…

Artificial Intelligence · Computer Science 2026-05-12 Chunhui Zhang , Zhongyu Ouyang , Kwonjoon Lee , Nakul Agarwal , Sean Dae Houlihan , Soroush Vosoughi , Shao-Yuan Lo

Theory of Mind (ToM), the ability to attribute mental states to others, is a hallmark of social intelligence. While large language models (LLMs) demonstrate promising performance on standard ToM benchmarks, we observe that they often fail…

Computation and Language · Computer Science 2026-04-14 Mengfan Li , Xuanhua Shi , Yang Deng

A growing body of work attempts to evaluate the theory of mind (ToM) abilities of humans and large language models (LLMs) using static, non-interactive question-and-answer benchmarks. However, theoretical work in the field suggests that…

Computation and Language · Computer Science 2026-02-20 Jared Moore , Rasmus Overmark , Ned Cooper , Beba Cibralic , Nick Haber , Cameron R. Jones

Theory of Mind (ToM) is the ability to attribute mental states to others, the basis of human cognition. At present, there has been growing interest in the AI with cognitive abilities, for example in healthcare and the motoring industry.…

Artificial Intelligence · Computer Science 2023-03-22 Yuanyuan Mao , Shuang Liu , Pengshuai Zhao , Qin Ni , Xin Lin , Liang He

Improving the Theory of Mind (ToM) capability of Large Language Models (LLMs) is crucial for effective social interactions between these AI models and humans. However, the existing benchmarks often measure ToM capability improvement through…

Artificial Intelligence · Computer Science 2026-05-18 Nanxu Gong , Zixin Chen , Haotian Li , Zishu Zhao , Jianxun Lian , Huamin Qu , Yanjie Fu , Xing Xie

While recent studies explore Large Language Models' (LLMs) performance on Theory of Mind (ToM) reasoning tasks, research on ToM abilities that require more nuanced social context is limited, such as white lies. We introduce TactfulToM, a…

Computation and Language · Computer Science 2025-09-26 Yiwei Liu , Emma Jane Pretty , Jiahao Huang , Saku Sugawara

Theory of Mind (ToM) refers to the ability to reason about others' mental states, and higher-order ToM involves considering that others also possess their own ToM. Equipping large language model (LLM)-driven agents with ToM has long been…

Artificial Intelligence · Computer Science 2026-03-18 Chunjiang Mu , Ya Zeng , Qiaosheng Zhang , Kun Shao , Chen Chu , Hao Guo , Danyang Jia , Zhen Wang , Shuyue Hu

Intuitive psychology is a pillar of common-sense reasoning. The replication of this reasoning in machine intelligence is an important stepping-stone on the way to human-like artificial intelligence. Several recent tasks and benchmarks for…

Artificial Intelligence · Computer Science 2023-03-15 Tomer Ullman

Social reasoning necessitates the capacity of theory of mind (ToM), the ability to contextualise and attribute mental states to others without having access to their internal cognitive structure. Recent machine learning approaches to ToM…

Artificial Intelligence · Computer Science 2023-01-18 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Natural language interaction with agentic Artificial Intelligence (AI), driven by Large Language Models (LLMs), is expected to remain a dominant paradigm in the near future. While humans instinctively align their communication with mental…

Computation and Language · Computer Science 2025-05-21 Mehdi Jafari , Devin Yuncheng Hua , Hao Xue , Flora Salim

As the capabilities of large language models (LLMs) continue to advance, the importance of rigorous safety evaluation is becoming increasingly evident. Recent concerns within the realm of safety assessment have highlighted instances in…

Computation and Language · Computer Science 2025-07-03 Tatsuhiro Aoshima , Mitsuaki Akiyama