English
Related papers

Related papers: Beyond Words: Evaluating and Bridging Epistemic Di…

200 papers

Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities…

Robotics · Computer Science 2024-01-18 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Theory of Mind (ToM)-the ability to reason about the mental states of oneself and others-is a cornerstone of human social intelligence. As Large Language Models (LLMs) become ubiquitous in real-world applications, validating their capacity…

Computation and Language · Computer Science 2026-03-13 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Cheston Tan

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

Do large language models (LLMs) have theory of mind? A plethora of papers and benchmarks have been introduced to evaluate if current models have been able to develop this key ability of social intelligence. However, all rely on limited…

Machine Learning · Computer Science 2024-12-18 Melanie Sclar , Jane Yu , Maryam Fazel-Zarandi , Yulia Tsvetkov , Yonatan Bisk , Yejin Choi , Asli Celikyilmaz

Theory of Mind (ToM) capabilities in LLMs have recently become a central object of investigation. Cognitive science distinguishes between two steps required for ToM tasks: 1) determine whether to invoke ToM, which includes the appropriate…

Artificial Intelligence · Computer Science 2025-06-03 Eitan Wagner , Nitay Alon , Joseph M. Barnby , Omri Abend

Theory of Mind (ToM) refers to an agent's ability to model the internal states of others. Contributing to the debate whether large language models (LLMs) exhibit genuine ToM capabilities, our study investigates their ToM robustness using…

Computation and Language · Computer Science 2026-02-26 Christian Nickel , Laura Schrewe , Florian Mai , Lucie Flek

Natural language interaction with agentic Artificial Intelligence (AI), driven by Large Language Models (LLMs), is expected to remain a dominant paradigm in the near future. While humans instinctively align their communication with mental…

Computation and Language · Computer Science 2025-05-21 Mehdi Jafari , Devin Yuncheng Hua , Hao Xue , Flora Salim

Theory of Mind (ToM) is central to social cognition and human-AI interaction, and Large Language Models (LLMs) have been used to help understand and represent ToM. However, most evaluations treat ToM as a static judgment at a single moment,…

Artificial Intelligence · Computer Science 2026-03-17 Thuy Ngoc Nguyen , Duy Nhat Phan , Cleotilde Gonzalez

Theory of Mind (ToM), the ability to attribute mental states to others, is a hallmark of social intelligence. While large language models (LLMs) demonstrate promising performance on standard ToM benchmarks, we observe that they often fail…

Computation and Language · Computer Science 2026-04-14 Mengfan Li , Xuanhua Shi , Yang Deng

Whether Large Language Models (LLMs) truly possess human-like Theory of Mind (ToM) capabilities has garnered increasing attention. However, existing benchmarks remain largely restricted to narrow paradigms like false belief tasks, failing…

Artificial Intelligence · Computer Science 2026-01-23 Haibo Tong , Zeyang Yue , Feifei Zhao , Erliang Lin , Lu Jia , Ruolin Chen , Yinqian Sun , Qian Zhang , Yi Zeng

Recent studies have increasingly demonstrated that large language models (LLMs) possess significant theory of mind (ToM) capabilities, showing the potential for simulating the tracking of mental states in generative agents. In this study,…

Computation and Language · Computer Science 2025-01-28 Bo Yang , Jiaxian Guo , Yusuke Iwasawa , Yutaka Matsuo

As Large Language Models (LLMs) increasingly participate in human-AI interactions, evaluating their Theory of Mind (ToM) capabilities - particularly their ability to track dynamic mental states - becomes crucial. While existing benchmarks…

Computation and Language · Computer Science 2025-06-10 Yang Xiao , Jiashuo Wang , Qiancheng Xu , Changhe Song , Chunpu Xu , Yi Cheng , Wenjie Li , Pengfei Liu

While humans naturally develop theory of mind (ToM), the capability to understand other people's mental states and beliefs, state-of-the-art large language models (LLMs) underperform on simple ToM benchmarks. We posit that we can extend our…

Computation and Language · Computer Science 2024-11-08 Chani Jung , Dongkwan Kim , Jiho Jin , Jiseon Kim , Yeon Seonwoo , Yejin Choi , Alice Oh , Hyunwoo Kim

Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that…

Computation and Language · Computer Science 2026-04-14 EunJeong Hwang , Yuwei Yin , Giuseppe Carenini , Peter West , Vered Shwartz

Do Large Language Models (LLMs) possess a Theory of Mind (ToM)? Research into this question has focused on evaluating LLMs against benchmarks and found success across a range of social tasks. However, these evaluations do not test for the…

Artificial Intelligence · Computer Science 2026-02-27 John Muchovej , Amanda Royka , Shane Lee , Julian Jara-Ettinger

Datasets used for emotion recognition tasks typically contain overt cues that can be used in predicting the emotions expressed in a text. However, one challenge is that texts sometimes contain covert contextual cues that are rich in…

Computation and Language · Computer Science 2025-06-03 Gerard Christopher Yeo , Kokil Jaidka

Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although recent progress in Large Reasoning Models (LRMs) has boosted…

Artificial Intelligence · Computer Science 2026-03-05 Nanxu Gong , Haotian Li , Sixun Dong , Jianxun Lian , Yanjie Fu , Xing Xie

Recent evidence suggests Large Language Models (LLMs) display Theory of Mind (ToM) abilities. Most ToM experiments place participants in a spectatorial role, wherein they predict and interpret other agents' behavior. However, human ToM also…

Computation and Language · Computer Science 2025-07-23 Jared Moore , Ned Cooper , Rasmus Overmark , Beba Cibralic , Nick Haber , Cameron R. Jones

While recent studies explore Large Language Models' (LLMs) performance on Theory of Mind (ToM) reasoning tasks, research on ToM abilities that require more nuanced social context is limited, such as white lies. We introduce TactfulToM, a…

Computation and Language · Computer Science 2025-09-26 Yiwei Liu , Emma Jane Pretty , Jiahao Huang , Saku Sugawara

We propose a hybrid approach to machine Theory of Mind (ToM) that uses large language models (LLMs) as a mechanism for generating hypotheses and likelihood functions with a Bayesian inverse planning model that computes posterior…

Artificial Intelligence · Computer Science 2025-07-08 Rebekah A. Gelpí , Eric Xue , William A. Cunningham