English
Related papers

Related papers: EnactToM: An Evolving Benchmark for Functional The…

200 papers

The adaptation to users' preferences and the ability to infer and interpret humans' beliefs and intents, which is known as the Theory of Mind (ToM), are two crucial aspects for achieving effective human-robot collaboration. Despite its…

Robotics · Computer Science 2025-11-05 Antonio Andriella , Giovanni Falcone , Silvia Rossi

We introduce EgoToM, a new video question-answering benchmark that extends Theory-of-Mind (ToM) evaluation to egocentric domains. Using a causal ToM model, we generate multi-choice video QA instances for the Ego4D dataset to benchmark the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Yuxuan Li , Vijay Veerabadran , Michael L. Iuzzolino , Brett D. Roads , Asli Celikyilmaz , Karl Ridgeway

The last couple of years have witnessed emerging research that appropriates Theory-of-Mind (ToM) tasks designed for humans to benchmark LLM's ToM capabilities as an indication of LLM's social intelligence. However, this approach has a…

Human-Computer Interaction · Computer Science 2025-04-16 Qiaosi Wang , Xuhui Zhou , Maarten Sap , Jodi Forlizzi , Hong Shen

As Large Language Models (LLMs) increasingly participate in human-AI interactions, evaluating their Theory of Mind (ToM) capabilities - particularly their ability to track dynamic mental states - becomes crucial. While existing benchmarks…

Computation and Language · Computer Science 2025-06-10 Yang Xiao , Jiashuo Wang , Qiancheng Xu , Changhe Song , Chunpu Xu , Yi Cheng , Wenjie Li , Pengfei Liu

Recent advances in Artificial Intelligence have produced agents that can beat human world champions at games like Go, Starcraft, and Dota2. However, most of these models do not seem to play in a human-like manner: People infer others'…

Artificial Intelligence · Computer Science 2020-08-03 Terence X. Lim , Sidney Tio , Desmond C. Ong

Reaching a consensus on the team plans is vital to human-AI coordination. Although previous studies provide approaches through communications in various ways, it could still be hard to coordinate when the AI has no explainable plan to…

Human-Computer Interaction · Computer Science 2024-05-06 Chenxu Wang , Zilong Chen , Angelo Cangelosi , Huaping Liu

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of…

Robotics · Computer Science 2026-01-07 Biyuan Liu , Daigang Xu , Lei Jiang , Wenjun Guo , Ping Chen

Whether Large Language Models (LLMs) truly possess human-like Theory of Mind (ToM) capabilities has garnered increasing attention. However, existing benchmarks remain largely restricted to narrow paradigms like false belief tasks, failing…

Artificial Intelligence · Computer Science 2026-01-23 Haibo Tong , Zeyang Yue , Feifei Zhao , Erliang Lin , Lu Jia , Ruolin Chen , Yinqian Sun , Qian Zhang , Yi Zeng

Theory of Mind (ToM) refers to the ability to reason about others' mental states, and higher-order ToM involves considering that others also possess their own ToM. Equipping large language model (LLM)-driven agents with ToM has long been…

Artificial Intelligence · Computer Science 2026-03-18 Chunjiang Mu , Ya Zeng , Qiaosheng Zhang , Kun Shao , Chen Chu , Hao Guo , Danyang Jia , Zhen Wang , Shuyue Hu

Theory of Mind (ToM) is the cognitive capability to perceive and ascribe mental states to oneself and others. Recent research has sparked a debate over whether large language models (LLMs) exhibit a form of ToM. However, existing ToM…

Computation and Language · Computer Science 2024-12-10 Zhuang Chen , Jincenzi Wu , Jinfeng Zhou , Bosi Wen , Guanqun Bi , Gongyao Jiang , Yaru Cao , Mengting Hu , Yunghwei Lai , Zexuan Xiong , Minlie Huang

Theory-of-Mind (ToM), the ability to infer others' perceptions and mental states, is fundamental to human interaction but remains challenging for Large Language Models (LLMs). While existing ToM reasoning methods show promise with reasoning…

Computation and Language · Computer Science 2025-06-03 Hainiu Xu , Siya Qi , Jiazheng Li , Yuxiang Zhou , Jinhua Du , Caroline Catmur , Yulan He

Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that…

Computation and Language · Computer Science 2026-04-14 EunJeong Hwang , Yuwei Yin , Giuseppe Carenini , Peter West , Vered Shwartz

Successful human-agent teaming relies on an agent being able to understand instructions given by a (human) principal. In many cases, an instruction may be incomplete or ambiguous. In such cases, the agent must infer the unspoken intentions…

Computation and Language · Computer Science 2026-04-20 Fardin Saad , Pradeep K. Murukannaiah , Munindar P. Singh

Theory of Mind (ToM) capabilities in LLMs have recently become a central object of investigation. Cognitive science distinguishes between two steps required for ToM tasks: 1) determine whether to invoke ToM, which includes the appropriate…

Artificial Intelligence · Computer Science 2025-06-03 Eitan Wagner , Nitay Alon , Joseph M. Barnby , Omri Abend

Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. We implemented the principles of the Projective Consciousness Model into artificial agents embodied as virtual…

Neurons and Cognition · Quantitative Biology 2025-11-26 David Rudrauf , Grégoire Sergeant-Perthuis , Yvain Tisserand , Teerawat Monnor , Olivier Belli

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Most existing Theory of Mind (ToM) benchmarks for foundation models rely on variations of the Sally-Anne test, offering only a very limited perspective on ToM and neglecting the complexity of human social interactions. To address this gap,…

Computation and Language · Computer Science 2025-09-17 Matteo Bortoletto , Constantin Ruhdorfer , Andreas Bulling

The search for effective collaboration between humans and computer systems is one of the biggest challenges in Artificial Intelligence. One of the more effective mechanisms that humans use to coordinate with one another is theory of mind…

Human-Computer Interaction · Computer Science 2025-03-24 Ramira van der Meulen , Rineke Verbrugge , Max van Duijn

While Large Language Models (LLMs) have demonstrated impressive accomplishments in both reasoning and planning, their abilities in multi-agent collaborations remains largely unexplored. This study evaluates LLM-based agents in a multi-agent…

Computation and Language · Computer Science 2024-06-28 Huao Li , Yu Quan Chong , Simon Stepputtis , Joseph Campbell , Dana Hughes , Michael Lewis , Katia Sycara

Theory of Mind (ToM) is a fundamental cognitive architecture that endows humans with the ability to attribute mental states to others. Humans infer the desires, beliefs, and intentions of others by observing their behavior and, in turn,…

Robotics · Computer Science 2023-11-09 Chuang Yu , Baris Serhan , Angelo Cangelosi