English
Related papers

Related papers: Clever Hans or Neural Theory of Mind? Stress Testi…

200 papers

Neural Theory-of-Mind (N-ToM), machine's ability to understand and keep track of the mental states of others, is pivotal in developing socially intelligent agents. However, prevalent N-ToM benchmarks have several shortcomings, including the…

Artificial Intelligence · Computer Science 2024-06-04 Hainiu Xu , Runcong Zhao , Lixing Zhu , Jinhua Du , Yulan He

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

As Large Language Models (LLMs) become increasingly integrated into our everyday lives, understanding their ability to comprehend human mental states becomes critical for ensuring effective interactions. However, despite the recent attempts…

Computation and Language · Computer Science 2023-12-06 Kanishk Gandhi , Jan-Philipp Fränken , Tobias Gerstenberg , Noah D. Goodman

Do Large Language Models (LLMs) possess a Theory of Mind (ToM)? Research into this question has focused on evaluating LLMs against benchmarks and found success across a range of social tasks. However, these evaluations do not test for the…

Artificial Intelligence · Computer Science 2026-02-27 John Muchovej , Amanda Royka , Shane Lee , Julian Jara-Ettinger

In recent years, evaluating the Theory of Mind (ToM) capabilities of large language models (LLMs) has received significant attention within the research community. As the field rapidly evolves, navigating the diverse approaches and…

Computation and Language · Computer Science 2025-02-14 Karahan Sarıtaş , Kıvanç Tezören , Yavuz Durmazkeser

The question of whether large language models (LLMs) possess Theory of Mind (ToM) -- often defined as the ability to reason about others' mental states -- has sparked significant scientific and public interest. However, the evidence as to…

Artificial Intelligence · Computer Science 2025-03-03 Jennifer Hu , Felix Sosa , Tomer Ullman

Social intelligence and Theory of Mind (ToM), i.e., the ability to reason about the different mental states, intents, and reactions of all people involved, allow humans to effectively navigate and understand everyday social interactions. As…

Computation and Language · Computer Science 2023-04-04 Maarten Sap , Ronan LeBras , Daniel Fried , Yejin Choi

Theory of Mind (ToM) is the ability to reason about one's own and others' mental states. ToM plays a critical role in the development of intelligence, language understanding, and cognitive processes. While previous work has primarily…

Computation and Language · Computer Science 2023-10-26 Yinghui He , Yufan Wu , Yilin Jia , Rada Mihalcea , Yulong Chen , Naihao Deng

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

With the release of ChatGPT and other large language models (LLMs) the discussion about the intelligence, possibilities, and risks, of current and future models have seen large attention. This discussion included much debated scenarios…

Artificial Intelligence · Computer Science 2024-07-31 Nils Körber , Silvan Wehrli , Christopher Irrgang

Theory of Mind (ToM) refers to the cognitive ability to infer and attribute mental states to oneself and others. As large language models (LLMs) are increasingly evaluated for social and cognitive capabilities, it remains unclear to what…

Computation and Language · Computer Science 2024-11-26 Jayanta Sadhu , Ayan Antik Khan , Noshin Nawal , Sanju Basak , Abhik Bhattacharjee , Rifat Shahriyar

Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in LLMs are largely limited to English, neglecting the linguistic diversity that shapes human cognition.…

Whether Large Language Models (LLMs) truly possess human-like Theory of Mind (ToM) capabilities has garnered increasing attention. However, existing benchmarks remain largely restricted to narrow paradigms like false belief tasks, failing…

Artificial Intelligence · Computer Science 2026-01-23 Haibo Tong , Zeyang Yue , Feifei Zhao , Erliang Lin , Lu Jia , Ruolin Chen , Yinqian Sun , Qian Zhang , Yi Zeng

With the success of ChatGPT and other similarly sized SotA LLMs, claims of emergent human like social reasoning capabilities, especially Theory of Mind (ToM), in these models have appeared in the scientific literature. On the one hand those…

Computation and Language · Computer Science 2024-10-10 Christian Nickel , Laura Schrewe , Lucie Flek

To what degree should we ascribe cognitive capacities to Large Language Models (LLMs), such as the ability to reason about intentions and beliefs known as Theory of Mind (ToM)? Here we add to this emerging debate by (i) testing 11 base- and…

Computation and Language · Computer Science 2023-11-01 Max J. van Duijn , Bram M. A. van Dijk , Tom Kouwenhoven , Werner de Valk , Marco R. Spruit , Peter van der Putten

Do large language models (LLMs) have theory of mind? A plethora of papers and benchmarks have been introduced to evaluate if current models have been able to develop this key ability of social intelligence. However, all rely on limited…

Machine Learning · Computer Science 2024-12-18 Melanie Sclar , Jane Yu , Maryam Fazel-Zarandi , Yulia Tsvetkov , Yonatan Bisk , Yejin Choi , Asli Celikyilmaz

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

Computation and Language · Computer Science 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

Theory of Mind (ToM)-the ability to reason about the mental states of oneself and others-is a cornerstone of human social intelligence. As Large Language Models (LLMs) become increasingly integrated into daily life, understanding their…

Computation and Language · Computer Science 2025-08-26 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Cheston Tan

Theory of Mind (ToM) refers to an agent's ability to model the internal states of others. Contributing to the debate whether large language models (LLMs) exhibit genuine ToM capabilities, our study investigates their ToM robustness using…

Computation and Language · Computer Science 2026-02-26 Christian Nickel , Laura Schrewe , Florian Mai , Lucie Flek

Theory of Mind (ToM) is the cognitive capability to perceive and ascribe mental states to oneself and others. Recent research has sparked a debate over whether large language models (LLMs) exhibit a form of ToM. However, existing ToM…

Computation and Language · Computer Science 2024-12-10 Zhuang Chen , Jincenzi Wu , Jinfeng Zhou , Bosi Wen , Guanqun Bi , Gongyao Jiang , Yaru Cao , Mengting Hu , Yunghwei Lai , Zexuan Xiong , Minlie Huang
‹ Prev 1 2 3 10 Next ›