English
Related papers

Related papers: UserHarness: Harnessing User Minds for Stronger Ag…

200 papers

Theory of Mind (ToM) is the ability to attribute mental states to others, the basis of human cognition. At present, there has been growing interest in the AI with cognitive abilities, for example in healthcare and the motoring industry.…

Artificial Intelligence · Computer Science 2023-03-22 Yuanyuan Mao , Shuang Liu , Pengshuai Zhao , Qin Ni , Xin Lin , Liang He

Theory of Mind (ToM) -- the ability to infer what others are thinking (e.g., intentions) from observable cues -- is traditionally considered fundamental to human social interactions. This has sparked growing efforts in building and…

Human-Computer Interaction · Computer Science 2026-02-13 Qiaosi Wang , Jini Kim , Avanita Sharma , Alicia , Lee , Jodi Forlizzi , Hong Shen

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Successful human-agent teaming relies on an agent being able to understand instructions given by a (human) principal. In many cases, an instruction may be incomplete or ambiguous. In such cases, the agent must infer the unspoken intentions…

Computation and Language · Computer Science 2026-04-20 Fardin Saad , Pradeep K. Murukannaiah , Munindar P. Singh

In complex environments, where the human sensory system reaches its limits, our behaviour is strongly driven by our beliefs about the state of the world around us. Accessing others' beliefs, intentions, or mental states in general, could…

Robotics · Computer Science 2022-10-19 Francesca Bianco , Dimitri Ognibene

Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks…

Computation and Language · Computer Science 2024-06-11 Maryam Amirizaniani , Elias Martin , Maryna Sivachenko , Afra Mashhadi , Chirag Shah

We present a new explainable AI (XAI) framework aimed at increasing justified human trust and reliance in the AI machine through explanations. We pose explanation as an iterative communication process, i.e. dialog, between the machine and…

Artificial Intelligence · Computer Science 2019-09-17 Arjun R. Akula , Changsong Liu , Sari Saba-Sadiya , Hongjing Lu , Sinisa Todorovic , Joyce Y. Chai , Song-Chun Zhu

Theory-of-Mind (ToM) enables humans to infer mental states-such as beliefs, desires, and intentions-forming the foundation of social cognition. However, existing computational ToM methods rely on structured workflows with ToM-specific…

Artificial Intelligence · Computer Science 2026-05-12 Chunhui Zhang , Zhongyu Ouyang , Kwonjoon Lee , Nakul Agarwal , Sean Dae Houlihan , Soroush Vosoughi , Shao-Yuan Lo

Recent evidence suggests Large Language Models (LLMs) display Theory of Mind (ToM) abilities. Most ToM experiments place participants in a spectatorial role, wherein they predict and interpret other agents' behavior. However, human ToM also…

Computation and Language · Computer Science 2025-07-23 Jared Moore , Ned Cooper , Rasmus Overmark , Beba Cibralic , Nick Haber , Cameron R. Jones

Within the context of human-robot interaction (HRI), Theory of Mind (ToM) is intended to serve as a user-friendly backend to the interface of robotic systems, enabling robots to infer and respond to human mental states. When integrated into…

Robotics · Computer Science 2026-02-20 Marie S. Bauer , Julia Gachot , Matthias Kerzel , Cornelius Weber , Stefan Wermter

The rapid growth of e-commerce increases the need for larger warehouses and their automation, thus using robots as assistants to human workers becomes a priority. In order to operate efficiently and safely, robot assistants or the…

Robotics · Computer Science 2018-04-06 Tomislav Petković , Ivan Marković , Ivan Petrović

We propose MToMnet - a Theory of Mind (ToM) neural network for predicting beliefs and their dynamics during human social interactions from multimodal input. ToM is key for effective nonverbal human communication and collaboration, yet,…

Artificial Intelligence · Computer Science 2024-08-29 Matteo Bortoletto , Constantin Ruhdorfer , Lei Shi , Andreas Bulling

The ability to understand and predict the mental states of oneself and others, known as the Theory of Mind (ToM), is crucial for effective social scenarios. Although recent studies have evaluated ToM in Large Language Models (LLMs),…

Computation and Language · Computer Science 2025-05-27 Fangxu Yu , Lai Jiang , Shenyi Huang , Zhen Wu , Xinyu Dai

Theory of Mind (ToM) -- the ability to model others' mental states -- is fundamental to human social cognition. Whether large language models (LLMs) can develop ToM has been tested exclusively through static vignettes, leaving open whether…

Artificial Intelligence · Computer Science 2026-04-07 Hsieh-Ting Lin , Tsung-Yu Hou

While Large Language Models (LLMs) have demonstrated impressive accomplishments in both reasoning and planning, their abilities in multi-agent collaborations remains largely unexplored. This study evaluates LLM-based agents in a multi-agent…

Computation and Language · Computer Science 2024-06-28 Huao Li , Yu Quan Chong , Simon Stepputtis , Joseph Campbell , Dana Hughes , Michael Lewis , Katia Sycara

With the substantial growth of logistics businesses the need for larger warehouses and their automation arises, thus using robots as assistants to human workers is becoming a priority. In order to operate efficiently and safely, robot…

Robotics · Computer Science 2019-01-11 Tomislav Petković , David Puljiz , Ivan Marković , Björn Hein

Cognitive abilities, such as Theory of Mind (ToM), play a vital role in facilitating cooperation in human social interactions. However, our study reveals that agents with higher ToM abilities may not necessarily exhibit better cooperative…

Multiagent Systems · Computer Science 2025-05-15 Jiaqi Shao , Tianjun Yuan , Tao Lin , Bing Luo

A major challenge for world models in multi-agent systems is to understand interdependent agent dynamics, predict interactive multi-agent trajectories, and plan over long horizons with collective awareness, without centralized supervision…

Artificial Intelligence · Computer Science 2026-03-03 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishna

Theory of Mind (ToM)$\unicode{x2014}$the ability to reason about the mental states of other people$\unicode{x2014}$is a key element of our social intelligence. Yet, despite their ever more impressive performance, large-scale neural language…

Computation and Language · Computer Science 2023-06-02 Melanie Sclar , Sachin Kumar , Peter West , Alane Suhr , Yejin Choi , Yulia Tsvetkov

Theory of Mind (ToM)-the ability to reason about the mental states of oneself and others-is a cornerstone of human social intelligence. As Large Language Models (LLMs) become increasingly integrated into daily life, understanding their…

Computation and Language · Computer Science 2025-08-26 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Cheston Tan