English
Related papers

Related papers: Multi-ToM: Evaluating Multilingual Theory of Mind …

200 papers

Theory of mind (ToM) evaluations currently focus on testing models using passive narratives that inherently lack interactivity. We introduce FANToM, a new benchmark designed to stress-test ToM within information-asymmetric conversational…

Computation and Language · Computer Science 2023-11-01 Hyunwoo Kim , Melanie Sclar , Xuhui Zhou , Ronan Le Bras , Gunhee Kim , Yejin Choi , Maarten Sap

Existing dynamic Theory of Mind (ToM) benchmarks mostly place language models in a passive role: the model reads a sequence of connected scenarios and reports what people believe, feel, intend, and do as these states change. In real social…

Artificial Intelligence · Computer Science 2026-01-28 Zhichao Liang , Satoshi Nakamura

Theory of Mind (ToM) reasoning with Large Language Models (LLMs) requires inferring how people's implicit, evolving beliefs shape what they seek and how they act under uncertainty -- especially in high-stakes settings such as disaster…

Artificial Intelligence · Computer Science 2026-03-23 Ruxiao Chen , Xilei Zhao , Thomas J. Cova , Frank A. Drews , Susu Xu

Existing Theory of Mind (ToM) benchmarks diverge from real-world scenarios in three aspects: 1) they assess a limited range of mental states such as beliefs, 2) false beliefs are not comprehensively explored, and 3) the diverse personality…

Computation and Language · Computer Science 2025-01-16 Kazutoshi Shinoda , Nobukatsu Hojo , Kyosuke Nishida , Saki Mizuno , Keita Suzuki , Ryo Masumura , Hiroaki Sugiyama , Kuniko Saito

We propose MToMnet - a Theory of Mind (ToM) neural network for predicting beliefs and their dynamics during human social interactions from multimodal input. ToM is key for effective nonverbal human communication and collaboration, yet,…

Artificial Intelligence · Computer Science 2024-08-29 Matteo Bortoletto , Constantin Ruhdorfer , Lei Shi , Andreas Bulling

The social science of large language models (LLMs) examines how these systems evoke mind attributions, interact with one another, and transform human activity and institutions. We conducted a systematic review of 270 studies, combining text…

Artificial Intelligence · Computer Science 2025-10-28 Xiao Jia , Zhanzhan Zhao

Originating in psychology, $\textit{Theory of Mind}$ (ToM) has attracted significant attention across multiple research communities, especially logic, economics, and robotics. Most psychological work does not aim at formalizing those…

Artificial Intelligence · Computer Science 2025-12-01 Fengming Zhu , Yuxin Pan , Xiaomeng Zhu , Fangzhen Lin

Large language models (LLMs) have shown significant multilingual capabilities. However, the mechanisms underlying the development of these capabilities during pre-training are not well understood. In this paper, we use code LLMs as an…

Computation and Language · Computer Science 2025-03-04 Jiawei Chen , Wentao Chen , Jing Su , Jingjing Xu , Hongyu Lin , Mengjie Ren , Yaojie Lu , Xianpei Han , Le Sun

In this work, we study whether multilingual language models (MultiLMs) can transfer logical reasoning abilities to other languages when they are fine-tuned for reasoning in a different language. We evaluate the cross-lingual reasoning…

Computation and Language · Computer Science 2023-10-25 Negar Foroutan , Mohammadreza Banaei , Karl Aberer , Antoine Bosselut

Theory of mind (ToM) refers to humans' ability to understand and infer the desires, beliefs, and intentions of others. The acquisition of ToM plays a key role in humans' social cognition and interpersonal relations. Though indispensable for…

Computation and Language · Computer Science 2024-05-21 Jincenzi Wu , Zhuang Chen , Jiawen Deng , Sahand Sabour , Helen Meng , Minlie Huang

Large language models (LLMs) have shown success in handling simple games with imperfect information and enabling multi-agent coordination, but their ability to facilitate practical collaboration against other agents in complex, imperfect…

Computation and Language · Computer Science 2024-08-06 Yauwai Yim , Chunkit Chan , Tianyu Shi , Zheye Deng , Wei Fan , Tianshi Zheng , Yangqiu Song

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Cognitive abilities, such as Theory of Mind (ToM), play a vital role in facilitating cooperation in human social interactions. However, our study reveals that agents with higher ToM abilities may not necessarily exhibit better cooperative…

Multiagent Systems · Computer Science 2025-05-15 Jiaqi Shao , Tianjun Yuan , Tao Lin , Bing Luo

Despite growing interest in Theory of Mind (ToM) tasks for evaluating language models (LMs), little is known about how LMs internally represent mental states of self and others. Understanding these internal mechanisms is critical - not only…

Computation and Language · Computer Science 2025-05-20 Matteo Bortoletto , Constantin Ruhdorfer , Lei Shi , Andreas Bulling

We present a new explainable AI (XAI) framework aimed at increasing justified human trust and reliance in the AI machine through explanations. We pose explanation as an iterative communication process, i.e. dialog, between the machine and…

Artificial Intelligence · Computer Science 2019-09-17 Arjun R. Akula , Changsong Liu , Sari Saba-Sadiya , Hongjing Lu , Sinisa Todorovic , Joyce Y. Chai , Song-Chun Zhu

Vision Language Models (VLMs) have demonstrated strong reasoning capabilities in Visual Question Answering (VQA) tasks; however, their ability to perform Theory of Mind (ToM) tasks, such as inferring human intentions, beliefs, and mental…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ximing Wen , Mallika Mainali , Anik Sen

Human understanding of text depends on general semantic concepts of words rather than their superficial forms. To what extent does our human intuition transfer to language models? In this work, we study the degree to which current…

Computation and Language · Computer Science 2025-11-20 Crystina Zhang , Jing Lu , Vinh Q. Tran , Tal Schuster , Donald Metzler , Jimmy Lin

Large Language Models (LLMs) are increasingly being integrated into various medical fields, including mental health support systems. However, there is a gap in research regarding the effectiveness of LLMs in non-English mental health…

Computation and Language · Computer Science 2026-02-10 Konstantinos Skianis , John Pavlopoulos , A. Seza Doğruöz

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

Theory of Mind (ToM), the ability to attribute beliefs, intentions, or mental states to others, is a crucial feature of human social interaction. In complex environments, where the human sensory system reaches its limits, behaviour is…

Neural and Evolutionary Computing · Computer Science 2024-07-26 Francesca Bianco , Silvia Rigato , Maria Laura Filippetti , Dimitri Ognibene