English
Related papers

Related papers: MindCraft: Theory of Mind Modeling for Situated Di…

200 papers

Real-time human-artificial intelligence (AI) collaboration is crucial yet challenging, especially when AI agents must adapt to diverse and unseen human behaviors in dynamic scenarios. Existing large language model (LLM) agents often fail to…

Machine Learning · Computer Science 2025-07-21 Xiyun Li , Yining Ding , Yuhua Jiang , Yunlong Zhao , Runpeng Xie , Shuang Xu , Yuanhua Ni , Yiqin Yang , Bo Xu

This paper describes our research on AI agents embodied in visual, virtual or physical forms, enabling them to interact with both users and their environments. These agents, which include virtual avatars, wearable devices, and robots, are…

In complex environments, where the human sensory system reaches its limits, our behaviour is strongly driven by our beliefs about the state of the world around us. Accessing others' beliefs, intentions, or mental states in general, could…

Robotics · Computer Science 2022-10-19 Francesca Bianco , Dimitri Ognibene

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

Human collaborators can effectively communicate with their partners to finish a common task by inferring each other's mental states (e.g., goals, beliefs, and desires). Such mind-aware communication minimizes the discrepancy among…

Artificial Intelligence · Computer Science 2020-07-28 Xiaofeng Gao , Ran Gong , Yizhou Zhao , Shu Wang , Tianmin Shu , Song-Chun Zhu

Theory of Mind (ToM) is the ability to attribute mental states to others, the basis of human cognition. At present, there has been growing interest in the AI with cognitive abilities, for example in healthcare and the motoring industry.…

Artificial Intelligence · Computer Science 2023-03-22 Yuanyuan Mao , Shuang Liu , Pengshuai Zhao , Qin Ni , Xin Lin , Liang He

Game theory has been one of the most successful quantitative concepts to describe social interactions, their strategical aspects, and outcomes. Among the payoff matrix quantifying the result of a social interaction, the interaction…

Physics and Society · Physics 2017-11-22 Wenjian Yu , Dirk Helbing

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

The search for effective collaboration between humans and computer systems is one of the biggest challenges in Artificial Intelligence. One of the more effective mechanisms that humans use to coordinate with one another is theory of mind…

Human-Computer Interaction · Computer Science 2025-03-24 Ramira van der Meulen , Rineke Verbrugge , Max van Duijn

Theory of Mind is an essential ability of humans to infer the mental states of others. Here we provide a coherent summary of the potential, current progress, and problems of deep learning approaches to Theory of Mind. We highlight that many…

Machine Learning · Computer Science 2023-02-14 Jaan Aru , Aqeel Labash , Oriol Corcoll , Raul Vicente

Theory of Mind (ToM), the ability to attribute beliefs, intentions, or mental states to others, is a crucial feature of human social interaction. In complex environments, where the human sensory system reaches its limits, behaviour is…

Neural and Evolutionary Computing · Computer Science 2024-07-26 Francesca Bianco , Silvia Rigato , Maria Laura Filippetti , Dimitri Ognibene

Humans with an average level of social cognition can infer the beliefs of others based solely on the nonverbal communication signals (e.g. gaze, gesture, pose and contextual information) exhibited during social interactions. This social…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Jiafei Duan , Samson Yu , Nicholas Tan , Li Yi , Cheston Tan

New developments are enabling AI systems to perceive, recognize, and respond with social cues based on inferences made from humans' explicit or implicit behavioral and verbal cues. These AI systems, equipped with an equivalent of human's…

Human-Computer Interaction · Computer Science 2024-05-28 Qiaosi Wang , Ashok K. Goel

This work seeks to study the beneficial properties that an autonomous agent can obtain by implementing a cognitive architecture similar to the one of conscious beings. Along this document, a conscious model of autonomous agent based in a…

Artificial Intelligence · Computer Science 2020-12-02 Eduardo C. Garrido-Merchán , Martin Molina , Francisco M. Mendoza

We investigate estimating a human's world belief state using a robot's observations in a dynamic, 3D, and partially observable environment. The methods are grounded in mental model theory, which posits that human decision making, contextual…

Robotics · Computer Science 2026-04-14 Jack Kolb , Aditya Garg , Nikolai Warner , Karen M. Feigh

Theory of Mind is commonly defined as the ability to attribute mental states (e.g., beliefs, goals) to oneself, and to others. A large body of previous work - from the social sciences to artificial intelligence - has observed that Theory of…

Artificial Intelligence · Computer Science 2020-05-07 Maayan Shvo , Toryn Q. Klassen , Sheila A. McIlraith

Theory of Mind (ToM) refers to the ability to reason about others' mental states, and higher-order ToM involves considering that others also possess their own ToM. Equipping large language model (LLM)-driven agents with ToM has long been…

Artificial Intelligence · Computer Science 2026-03-18 Chunjiang Mu , Ya Zeng , Qiaosheng Zhang , Kun Shao , Chen Chu , Hao Guo , Danyang Jia , Zhen Wang , Shuyue Hu

Collective intelligence plays a central role in many fields, from economics and evolutionary theory to neural networks and eusocial insects, and is also core to work on emergence and self-organisation in complex-systems theory. However, in…

Multiagent Systems · Computer Science 2025-07-09 Michael S. Harré , Catherine Drysdale , Jaime Ruiz-Serra

Improving our understanding of how humans perceive AI teammates is an important foundation for our general understanding of human-AI teams. Extending relevant work from cognitive science, we propose a framework based on item response theory…

Machine Learning · Computer Science 2023-05-17 Markelle Kelly , Aakriti Kumar , Padhraic Smyth , Mark Steyvers

The maturation of cognition, from introspection to understanding others, has long been a hallmark of human development. This position paper posits that for AI systems to truly emulate or approach human-like interactions, especially within…

Multiagent Systems · Computer Science 2023-12-19 Jasmine A. Berry