English
Related papers

Related papers: MuMA-ToM: Multi-modal Multi-Agent Theory of Mind

200 papers

Theory of Mind (ToM), the ability to understand people's mental states, is an essential ingredient for developing machines with human-level social intelligence. Recent machine learning models, particularly large language models, seem to…

Artificial Intelligence · Computer Science 2024-06-18 Chuanyang Jin , Yutong Wu , Jing Cao , Jiannan Xiang , Yen-Ling Kuo , Zhiting Hu , Tomer Ullman , Antonio Torralba , Joshua B. Tenenbaum , Tianmin Shu

Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that…

Computation and Language · Computer Science 2026-04-14 EunJeong Hwang , Yuwei Yin , Giuseppe Carenini , Peter West , Vered Shwartz

Theory of Mind (ToM) -- the ability to understand that others can have differing knowledge and goals -- enables agents to reason about others' beliefs while planning their own actions. We present a novel approach to multi-agent cooperation…

Artificial Intelligence · Computer Science 2025-09-05 Riddhi J. Pitliya , Ozan Çatal , Toon Van de Maele , Corrado Pezzato , Tim Verbelen

Human social interactions depend on the ability to infer others' unspoken intentions, emotions, and beliefs-a cognitive skill grounded in the psychological concept of Theory of Mind (ToM). While large language models (LLMs) excel in…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

New developments are enabling AI systems to perceive, recognize, and respond with social cues based on inferences made from humans' explicit or implicit behavioral and verbal cues. These AI systems, equipped with an equivalent of human's…

Human-Computer Interaction · Computer Science 2024-05-28 Qiaosi Wang , Ashok K. Goel

Theory of Mind (ToM) refers to the ability to reason about others' mental states, and higher-order ToM involves considering that others also possess their own ToM. Equipping large language model (LLM)-driven agents with ToM has long been…

Artificial Intelligence · Computer Science 2026-03-18 Chunjiang Mu , Ya Zeng , Qiaosheng Zhang , Kun Shao , Chen Chu , Hao Guo , Danyang Jia , Zhen Wang , Shuyue Hu

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

Multiagent Systems · Computer Science 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng

Being able to predict the mental states of others is a key factor to effective social interaction. It is also crucial for distributed multi-agent systems, where agents are required to communicate and cooperate. In this paper, we introduce…

Multiagent Systems · Computer Science 2022-04-26 Yuanfei Wang , Fangwei Zhong , Jing Xu , Yizhou Wang

Humans continuously infer the states, goals, and behaviors of others by perceiving their surroundings in dynamic, real-world social interactions. However, most Theory of Mind (ToM) benchmarks only evaluate static, text-based scenarios,…

Computation and Language · Computer Science 2025-12-16 Xianzhe Fan , Xuhui Zhou , Chuanyang Jin , Kolby Nottingham , Hao Zhu , Maarten Sap

Theory of Mind (ToM) significantly impacts human collaboration and communication as a crucial capability to understand others. When AI agents with ToM capability collaborate with humans, Mutual Theory of Mind (MToM) arises in such human-AI…

Human-Computer Interaction · Computer Science 2024-09-16 Shao Zhang , Xihuai Wang , Wenhao Zhang , Yongshan Chen , Landi Gao , Dakuo Wang , Weinan Zhang , Xinbing Wang , Ying Wen

Theory of Mind (ToM) refers to the cognitive ability to infer and attribute mental states to oneself and others. As large language models (LLMs) are increasingly evaluated for social and cognitive capabilities, it remains unclear to what…

Computation and Language · Computer Science 2024-11-26 Jayanta Sadhu , Ayan Antik Khan , Noshin Nawal , Sanju Basak , Abhik Bhattacharjee , Rifat Shahriyar

Social reasoning necessitates the capacity of theory of mind (ToM), the ability to contextualise and attribute mental states to others without having access to their internal cognitive structure. Recent machine learning approaches to ToM…

Artificial Intelligence · Computer Science 2023-01-18 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Job interview simulation with a virtual agents aims at improving people's social skills and supporting professional inclusion. In such simulators, the virtual agent must be capable of representing and reasoning about the user's mental state…

Artificial Intelligence · Computer Science 2014-02-21 Marwen Belkaid , Nicolas Sabouret

Most existing Theory of Mind (ToM) benchmarks for foundation models rely on variations of the Sally-Anne test, offering only a very limited perspective on ToM and neglecting the complexity of human social interactions. To address this gap,…

Computation and Language · Computer Science 2025-09-17 Matteo Bortoletto , Constantin Ruhdorfer , Andreas Bulling

The ability to interpret the mental state of another agent based on its behavior, also called Theory of Mind (ToM), is crucial for humans in any kind of social interaction. Artificial systems, such as intelligent assistants, would also…

Artificial Intelligence · Computer Science 2019-09-24 Jan Pöppel , Stefan Kopp

Currently, in the study of multiagent systems, the intentions of agents are usually ignored. Nonetheless, as pointed out by Theory of Mind (ToM), people regularly reason about other's mental states, including beliefs, goals, and intentions,…

Multiagent Systems · Computer Science 2021-10-04 Luyao Yuan , Zipeng Fu , Linqi Zhou , Kexin Yang , Song-Chun Zhu

A major challenge in cognitive science and AI has been to understand how autonomous agents might acquire and predict behavioral and mental states of other agents in the course of complex social interactions. How does such an agent model the…

Multiagent Systems · Computer Science 2019-06-03 Ismael T. Freire , Xerxes D. Arsiwalla , Jordi-Ysard Puigbò , Paul Verschure

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

The search for effective collaboration between humans and computer systems is one of the biggest challenges in Artificial Intelligence. One of the more effective mechanisms that humans use to coordinate with one another is theory of mind…

Human-Computer Interaction · Computer Science 2025-03-24 Ramira van der Meulen , Rineke Verbrugge , Max van Duijn

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam
‹ Prev 1 2 3 10 Next ›