English
Related papers

Related papers: Video-Only ToM: Enhancing Theory of Mind in Multim…

200 papers

As large language models evolve, there is growing anticipation that they will emulate human-like Theory of Mind (ToM) to assist with routine tasks. However, existing methods for evaluating machine ToM focus primarily on unimodal models and…

Artificial Intelligence · Computer Science 2025-06-18 Xinyang Li , Siqi Liu , Bochao Zou , Jiansheng Chen , Huimin Ma

We introduce EgoToM, a new video question-answering benchmark that extends Theory-of-Mind (ToM) evaluation to egocentric domains. Using a causal ToM model, we generate multi-choice video QA instances for the Ego4D dataset to benchmark the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Yuxuan Li , Vijay Veerabadran , Michael L. Iuzzolino , Brett D. Roads , Asli Celikyilmaz , Karl Ridgeway

Can large multimodal models have a human-like ability for emotional and social reasoning, and if so, how does it work? Recent research has discovered emergent theory-of-mind (ToM) reasoning capabilities in large language models (LLMs). LLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhawnen Chen , Tianchun Wang , Yizhou Wang , Michal Kosinski , Xiang Zhang , Yun Fu , Sheng Li

Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to…

Artificial Intelligence · Computer Science 2023-11-20 Alex Wilf , Sihyun Shawn Lee , Paul Pu Liang , Louis-Philippe Morency

Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in LLMs are largely limited to English, neglecting the linguistic diversity that shapes human cognition.…

Large Language Models (LLMs) have developed rapidly and are widely applied to both general-purpose and professional tasks to assist human users. However, they still struggle to comprehend and respond to the true user needs when intentions…

Computation and Language · Computer Science 2026-02-17 Minyuan Ruan , Ziyue Wang , Kaiming Liu , Yunghwei Lai , Peng Li , Yang Liu

Theory of Mind (ToM) refers to the cognitive ability to infer and attribute mental states to oneself and others. As large language models (LLMs) are increasingly evaluated for social and cognitive capabilities, it remains unclear to what…

Computation and Language · Computer Science 2024-11-26 Jayanta Sadhu , Ayan Antik Khan , Noshin Nawal , Sanju Basak , Abhik Bhattacharjee , Rifat Shahriyar

Theory of Mind (ToM), the ability to infer others' knowledge, intentions, and emotions, is commonly evaluated in large language models (LLMs) using end-point question answering, where performance is judged solely by the final answer to a…

Artificial Intelligence · Computer Science 2026-05-27 Adam Bawatneh , Sagar Sapkota , Amrit Singh Bedi , Santu Karmaker , Mubarak Shah

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Vision Language Models (VLMs) have demonstrated strong reasoning capabilities in Visual Question Answering (VQA) tasks; however, their ability to perform Theory of Mind (ToM) tasks, such as inferring human intentions, beliefs, and mental…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ximing Wen , Mallika Mainali , Anik Sen

Theory-of-Mind (ToM), the ability to infer others' perceptions and mental states, is fundamental to human interaction but remains challenging for Large Language Models (LLMs). While existing ToM reasoning methods show promise with reasoning…

Computation and Language · Computer Science 2025-06-03 Hainiu Xu , Siya Qi , Jiazheng Li , Yuxiang Zhou , Jinhua Du , Caroline Catmur , Yulan He

Theory of Mind (ToM), the ability to understand people's minds based on their behavior, is key to developing socially intelligent agents. Current approaches to ToM reasoning either rely on prompting Large Language Models (LLMs), which are…

Artificial Intelligence · Computer Science 2026-01-15 Zhining Zhang , Chuanyang Jin , Mung Yao Jia , Shunchi Zhang , Tianmin Shu

Humans continuously infer the states, goals, and behaviors of others by perceiving their surroundings in dynamic, real-world social interactions. However, most Theory of Mind (ToM) benchmarks only evaluate static, text-based scenarios,…

Computation and Language · Computer Science 2025-12-16 Xianzhe Fan , Xuhui Zhou , Chuanyang Jin , Kolby Nottingham , Hao Zhu , Maarten Sap

Theory of Mind (ToM) refers to the ability to infer others' mental states, such as beliefs, desires, and intentions. Current vision-language embodied agents lack ToM-based decision-making, and existing benchmarks focus solely on human…

Artificial Intelligence · Computer Science 2026-02-25 Ruoxuan Zhang , Qiyun Zheng , Zhiyu Zhou , Ziqi Liao , Siyu Wu , Jian-Yu Jiang-Lin , Bin Wen , Hongxia Xie , Jianlong Fu , Wen-Huang Cheng

The ability to understand and predict the mental states of oneself and others, known as the Theory of Mind (ToM), is crucial for effective social scenarios. Although recent studies have evaluated ToM in Large Language Models (LLMs),…

Computation and Language · Computer Science 2025-05-27 Fangxu Yu , Lai Jiang , Shenyi Huang , Zhen Wu , Xinyu Dai

Theory of Mind (ToM)-the ability to reason about the mental states of oneself and others-is a cornerstone of human social intelligence. As Large Language Models (LLMs) become increasingly integrated into daily life, understanding their…

Computation and Language · Computer Science 2025-08-26 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Cheston Tan

While Large Language Models (LLMs) have demonstrated impressive accomplishments in both reasoning and planning, their abilities in multi-agent collaborations remains largely unexplored. This study evaluates LLM-based agents in a multi-agent…

Computation and Language · Computer Science 2024-06-28 Huao Li , Yu Quan Chong , Simon Stepputtis , Joseph Campbell , Dana Hughes , Michael Lewis , Katia Sycara

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

Large Language models are revolutionizing the conversational recommender systems through their impressive capabilities in instruction comprehension, reasoning, and human interaction. A core factor underlying effective recommendation…

Artificial Intelligence · Computer Science 2025-12-01 Mengfan Li , Xuanhua Shi , Yang Deng

Recent evidence suggests Large Language Models (LLMs) display Theory of Mind (ToM) abilities. Most ToM experiments place participants in a spectatorial role, wherein they predict and interpret other agents' behavior. However, human ToM also…

Computation and Language · Computer Science 2025-07-23 Jared Moore , Ned Cooper , Rasmus Overmark , Beba Cibralic , Nick Haber , Cameron R. Jones
‹ Prev 1 2 3 10 Next ›