English
Related papers

Related papers: FANToM: A Benchmark for Stress-testing Machine The…

200 papers

Theory of Mind (ToM), the ability to attribute mental states to others and predict their behaviour, is fundamental to social intelligence. In this paper, we survey studies evaluating behavioural and representational ToM in Large Language…

Computation and Language · Computer Science 2025-02-11 Hieu Minh "Jord" Nguyen

Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks…

Computation and Language · Computer Science 2024-06-11 Maryam Amirizaniani , Elias Martin , Maryna Sivachenko , Afra Mashhadi , Chirag Shah

Large language models (LLMs) are transforming human-computer interaction and conceptions of artificial intelligence (AI) with their impressive capacities for conversing and reasoning in natural language. There is growing interest in whether…

Human-Computer Interaction · Computer Science 2024-05-15 Winnie Street

Theory of Mind (ToM) refers to the ability of individuals to attribute mental states to others. While Large Language Models (LLMs) have shown some promise with ToM ability, they still struggle with complex ToM reasoning. Our approach…

Computation and Language · Computer Science 2024-06-27 Weizhi Tang , Vaishak Belle

With the success of ChatGPT and other similarly sized SotA LLMs, claims of emergent human like social reasoning capabilities, especially Theory of Mind (ToM), in these models have appeared in the scientific literature. On the one hand those…

Computation and Language · Computer Science 2024-10-10 Christian Nickel , Laura Schrewe , Lucie Flek

Theory of Mind (ToM), the ability to understand people's mental states, is an essential ingredient for developing machines with human-level social intelligence. Recent machine learning models, particularly large language models, seem to…

Artificial Intelligence · Computer Science 2024-06-18 Chuanyang Jin , Yutong Wu , Jing Cao , Jiannan Xiang , Yen-Ling Kuo , Zhiting Hu , Tomer Ullman , Antonio Torralba , Joshua B. Tenenbaum , Tianmin Shu

Humans continuously infer the states, goals, and behaviors of others by perceiving their surroundings in dynamic, real-world social interactions. However, most Theory of Mind (ToM) benchmarks only evaluate static, text-based scenarios,…

Computation and Language · Computer Science 2025-12-16 Xianzhe Fan , Xuhui Zhou , Chuanyang Jin , Kolby Nottingham , Hao Zhu , Maarten Sap

Theory of Mind (ToM) can be used to assess the capabilities of Large Language Models (LLMs) in complex scenarios where social reasoning is required. While the research community has proposed many ToM benchmarks, their hardness varies…

Artificial Intelligence · Computer Science 2024-10-10 X. Angelo Huang , Emanuele La Malfa , Samuele Marro , Andrea Asperti , Anthony Cohn , Michael Wooldridge

Large language models (LLMs) are increasingly tested for a "Theory of Mind" (ToM) - the ability to attribute mental states to oneself and others. Yet most evaluations stop at explicit belief attribution in classical toy stories or stylized…

Computation and Language · Computer Science 2026-03-03 Yuling Gu , Oyvind Tafjord , Hyunwoo Kim , Jared Moore , Ronan Le Bras , Peter Clark , Yejin Choi

Topic models are a popular approach for extracting semantic information from large document collections. However, recent studies suggest that the topics generated by these models often do not align well with human intentions. Although…

Information Retrieval · Computer Science 2025-02-10 Mayank Nagda , Phil Ostheimer , Sophie Fellenz

When researchers claim AI systems possess ToM or mental models, they are fundamentally discussing behavioral predictions and bias corrections rather than genuine mental states. This position paper argues that the current discourse conflates…

Human-Computer Interaction · Computer Science 2025-10-06 Xiaoyun Yin , Elmira Zahmat Doost , Shiwen Zhou , Garima Arya Yadav , Jamie C. Gorman

Theory of Mind (ToM)$\unicode{x2014}$the ability to reason about the mental states of other people$\unicode{x2014}$is a key element of our social intelligence. Yet, despite their ever more impressive performance, large-scale neural language…

Computation and Language · Computer Science 2023-06-02 Melanie Sclar , Sachin Kumar , Peter West , Alane Suhr , Yejin Choi , Yulia Tsvetkov

This paper examines the extent to which large language models (LLMs) have developed higher-order theory of mind (ToM); the human ability to reason about multiple mental and emotional states in a recursive manner (e.g. I think that you…

Job interview simulation with a virtual agents aims at improving people's social skills and supporting professional inclusion. In such simulators, the virtual agent must be capable of representing and reasoning about the user's mental state…

Artificial Intelligence · Computer Science 2014-02-21 Marwen Belkaid , Nicolas Sabouret

Large Language Models have shown exceptional generative abilities in various natural language and generation tasks. However, possible anthropomorphization and leniency towards failure cases have propelled discussions on emergent abilities…

Robotics · Computer Science 2024-01-18 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Eleven Large Language Models (LLMs) were assessed using a custom-made battery of false-belief tasks, considered a gold standard in testing Theory of Mind (ToM) in humans. The battery included 640 prompts spread across 40 diverse tasks, each…

Computation and Language · Computer Science 2024-11-06 Michal Kosinski

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

We propose a hybrid approach to machine Theory of Mind (ToM) that uses large language models (LLMs) as a mechanism for generating hypotheses and likelihood functions with a Bayesian inverse planning model that computes posterior…

Artificial Intelligence · Computer Science 2025-07-08 Rebekah A. Gelpí , Eric Xue , William A. Cunningham

Large Language Models (LLMs) have shown potential in simulating human behaviors and performing theory-of-mind (ToM) reasoning, a crucial skill for complex social interactions. In this study, we investigate the role of ToM reasoning in…

Computation and Language · Computer Science 2025-06-02 Neemesh Yadav , Palakorn Achananuparp , Jing Jiang , Ee-Peng Lim