English
Related papers

Related papers: Theory of Mind for Explainable Human-Robot Interac…

200 papers

Theory of Mind is the ability to attribute mental states (beliefs, intents, knowledge, perspectives, etc.) to others and recognize that these mental states may differ from one's own. Theory of Mind is critical to effective communication and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Arjun Chandrasekaran , Deshraj Yadav , Prithvijit Chattopadhyay , Viraj Prabhu , Devi Parikh

Explainable artificial intelligence (XAI) can help foster trust in and acceptance of intelligent and autonomous systems. Moreover, understanding the motivation for an agent's behavior results in better and more successful collaborations…

Robotics · Computer Science 2020-10-12 Tom Weber , Stefan Wermter

Theory of Mind (ToM) significantly impacts human collaboration and communication as a crucial capability to understand others. When AI agents with ToM capability collaborate with humans, Mutual Theory of Mind (MToM) arises in such human-AI…

Human-Computer Interaction · Computer Science 2024-09-16 Shao Zhang , Xihuai Wang , Wenhao Zhang , Yongshan Chen , Landi Gao , Dakuo Wang , Weinan Zhang , Xinbing Wang , Ying Wen

Social reasoning necessitates the capacity of theory of mind (ToM), the ability to contextualise and attribute mental states to others without having access to their internal cognitive structure. Recent machine learning approaches to ToM…

Artificial Intelligence · Computer Science 2023-01-18 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Theory of Mind (ToM) refers to the ability to infer others' mental states, such as beliefs, desires, and intentions. Current vision-language embodied agents lack ToM-based decision-making, and existing benchmarks focus solely on human…

Artificial Intelligence · Computer Science 2026-02-25 Ruoxuan Zhang , Qiyun Zheng , Zhiyu Zhou , Ziqi Liao , Siyu Wu , Jian-Yu Jiang-Lin , Bin Wen , Hongxia Xie , Jianlong Fu , Wen-Huang Cheng

In complex environments, where the human sensory system reaches its limits, our behaviour is strongly driven by our beliefs about the state of the world around us. Accessing others' beliefs, intentions, or mental states in general, could…

Robotics · Computer Science 2022-10-19 Francesca Bianco , Dimitri Ognibene

Human collaborators can effectively communicate with their partners to finish a common task by inferring each other's mental states (e.g., goals, beliefs, and desires). Such mind-aware communication minimizes the discrepancy among…

Artificial Intelligence · Computer Science 2020-07-28 Xiaofeng Gao , Ran Gong , Yizhou Zhao , Shu Wang , Tianmin Shu , Song-Chun Zhu

A major challenge in cognitive science and AI has been to understand how autonomous agents might acquire and predict behavioral and mental states of other agents in the course of complex social interactions. How does such an agent model the…

Multiagent Systems · Computer Science 2019-06-03 Ismael T. Freire , Xerxes D. Arsiwalla , Jordi-Ysard Puigbò , Paul Verschure

In this paper, we propose a novel personalized decision support system that combines Theory of Mind (ToM) modeling and explainable Reinforcement Learning (XRL) to provide effective and interpretable interventions. Our method leverages DRL…

Machine Learning · Computer Science 2023-12-15 Huao Li , Yao Fan , Keyang Zheng , Michael Lewis , Katia Sycara

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

The rapid growth of e-commerce increases the need for larger warehouses and their automation, thus using robots as assistants to human workers becomes a priority. In order to operate efficiently and safely, robot assistants or the…

Robotics · Computer Science 2018-04-06 Tomislav Petković , Ivan Marković , Ivan Petrović

Understanding people's social interactions in complex real-world scenarios often relies on intricate mental reasoning. To truly understand how and why people interact with one another, we must infer the underlying mental states that give…

Artificial Intelligence · Computer Science 2025-01-24 Haojun Shi , Suyu Ye , Xinyu Fang , Chuanyang Jin , Leyla Isik , Yen-Ling Kuo , Tianmin Shu

Reaching a consensus on the team plans is vital to human-AI coordination. Although previous studies provide approaches through communications in various ways, it could still be hard to coordinate when the AI has no explainable plan to…

Human-Computer Interaction · Computer Science 2024-05-06 Chenxu Wang , Zilong Chen , Angelo Cangelosi , Huaping Liu

A first step to reach Theory of Mind (ToM) abilities (attribution of beliefs to others) in synthetic agents through sensorimotor interactions, would be to tag sensory data with agent typology and action intentions: autonomous agent X moved…

Artificial Intelligence · Computer Science 2017-11-23 M. Sánchez-Fibla , C. Moulin-Frier , X. Arsiwalla , P. Verschure

Theory of Mind (ToM) refers to the ability to reason about others' mental states, and higher-order ToM involves considering that others also possess their own ToM. Equipping large language model (LLM)-driven agents with ToM has long been…

Artificial Intelligence · Computer Science 2026-03-18 Chunjiang Mu , Ya Zeng , Qiaosheng Zhang , Kun Shao , Chen Chu , Hao Guo , Danyang Jia , Zhen Wang , Shuyue Hu

Large language models (LLMs) are transforming human-computer interaction and conceptions of artificial intelligence (AI) with their impressive capacities for conversing and reasoning in natural language. There is growing interest in whether…

Human-Computer Interaction · Computer Science 2024-05-15 Winnie Street

Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks…

Computation and Language · Computer Science 2024-06-11 Maryam Amirizaniani , Elias Martin , Maryna Sivachenko , Afra Mashhadi , Chirag Shah

The ability to interpret the mental state of another agent based on its behavior, also called Theory of Mind (ToM), is crucial for humans in any kind of social interaction. Artificial systems, such as intelligent assistants, would also…

Artificial Intelligence · Computer Science 2019-09-24 Jan Pöppel , Stefan Kopp

Social intelligence manifests the capability, often referred to as the Theory of Mind (ToM), to discern others' behavioral intentions, beliefs, and other mental states. ToM is especially important in multi-agent and human-machine…

Multiagent Systems · Computer Science 2023-11-09 Zhuoya Zhao , Feifei Zhao , Shiwen Wang , Yinqian Sun , Yi Zeng