English
Related papers

Related papers: AutoToM: Scaling Model-based Mental Inference via …

200 papers

User modeling has traditionally relied on inferring preferences, traits, or intents from observable behaviour. While effective in many adaptive systems, this paradigm treats behaviour as the primary object of modeling and leaves…

Human-Computer Interaction · Computer Science 2026-05-12 Cristina Gena

Can large multimodal models have a human-like ability for emotional and social reasoning, and if so, how does it work? Recent research has discovered emergent theory-of-mind (ToM) reasoning capabilities in large language models (LLMs). LLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhawnen Chen , Tianchun Wang , Yizhou Wang , Michal Kosinski , Xiang Zhang , Yun Fu , Sheng Li

We introduce DialToM, an annotated Theory of Mind (ToM) benchmark built from naturalistic human-human dialogues using a multiple-choice evaluation framework. Concurrent with recent work showing a gap between explicit mental-state inference…

Computation and Language · Computer Science 2026-05-29 Neemesh Yadav , Palakorn Achananuparp , Jing Jiang , Ee-Peng Lim

While humans naturally develop theory of mind (ToM), the capability to understand other people's mental states and beliefs, state-of-the-art large language models (LLMs) underperform on simple ToM benchmarks. We posit that we can extend our…

Computation and Language · Computer Science 2024-11-08 Chani Jung , Dongkwan Kim , Jiho Jin , Jiseon Kim , Yeon Seonwoo , Yejin Choi , Alice Oh , Hyunwoo Kim

Humans learn from observations and experiences to adjust their behaviours towards better performance. Interacting with such dynamic humans is challenging, as the robot needs to predict the humans accurately for safe and efficient…

Robotics · Computer Science 2025-02-13 Yuwen Liao , Muqing Cao , Xinhang Xu , Lihua Xie

Neural Theory-of-Mind (N-ToM), machine's ability to understand and keep track of the mental states of others, is pivotal in developing socially intelligent agents. However, prevalent N-ToM benchmarks have several shortcomings, including the…

Artificial Intelligence · Computer Science 2024-06-04 Hainiu Xu , Runcong Zhao , Lixing Zhu , Jinhua Du , Yulan He

Theory of Mind (ToM) refers to the ability of individuals to attribute mental states to others. While Large Language Models (LLMs) have shown some promise with ToM ability, they still struggle with complex ToM reasoning. Our approach…

Computation and Language · Computer Science 2024-06-27 Weizhi Tang , Vaishak Belle

Large Language Models (LLMs) have sparked substantial interest and debate concerning their potential emergence of Theory of Mind (ToM) ability. Theory of mind evaluations currently focuses on testing models using machine-generated data or…

Computation and Language · Computer Science 2024-10-08 Chunkit Chan , Cheng Jiayang , Yauwai Yim , Zheye Deng , Wei Fan , Haoran Li , Xin Liu , Hongming Zhang , Weiqi Wang , Yangqiu Song

Theory of mind (ToM; Premack & Woodruff, 1978) broadly refers to humans' ability to represent the mental states of others, including their desires, beliefs, and intentions. We propose to train a machine to build such models too. We design a…

Artificial Intelligence · Computer Science 2018-03-14 Neil C. Rabinowitz , Frank Perbet , H. Francis Song , Chiyuan Zhang , S. M. Ali Eslami , Matthew Botvinick

Natural language interaction with agentic Artificial Intelligence (AI), driven by Large Language Models (LLMs), is expected to remain a dominant paradigm in the near future. While humans instinctively align their communication with mental…

Computation and Language · Computer Science 2025-05-21 Mehdi Jafari , Devin Yuncheng Hua , Hao Xue , Flora Salim

The question of whether large language models (LLMs) possess Theory of Mind (ToM) -- often defined as the ability to reason about others' mental states -- has sparked significant scientific and public interest. However, the evidence as to…

Artificial Intelligence · Computer Science 2025-03-03 Jennifer Hu , Felix Sosa , Tomer Ullman

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

Computation and Language · Computer Science 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

Social reasoning necessitates the capacity of theory of mind (ToM), the ability to contextualise and attribute mental states to others without having access to their internal cognitive structure. Recent machine learning approaches to ToM…

Artificial Intelligence · Computer Science 2023-01-18 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. We implemented the principles of the Projective Consciousness Model into artificial agents embodied as virtual…

Neurons and Cognition · Quantitative Biology 2025-11-26 David Rudrauf , Grégoire Sergeant-Perthuis , Yvain Tisserand , Teerawat Monnor , Olivier Belli

Theory of Mind (ToM) -- the ability to model others' mental states -- is fundamental to human social cognition. Whether large language models (LLMs) can develop ToM has been tested exclusively through static vignettes, leaving open whether…

Artificial Intelligence · Computer Science 2026-04-07 Hsieh-Ting Lin , Tsung-Yu Hou

Job interview simulation with a virtual agents aims at improving people's social skills and supporting professional inclusion. In such simulators, the virtual agent must be capable of representing and reasoning about the user's mental state…

Artificial Intelligence · Computer Science 2014-02-21 Marwen Belkaid , Nicolas Sabouret

Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although recent progress in Large Reasoning Models (LRMs) has boosted…

Artificial Intelligence · Computer Science 2026-03-05 Nanxu Gong , Haotian Li , Sixun Dong , Jianxun Lian , Yanjie Fu , Xing Xie

As Large Language Models (LLMs) gain agentic abilities, they will have to navigate complex multi-agent scenarios, interacting with human users and other agents in cooperative and competitive settings. This will require new reasoning skills,…

Artificial Intelligence · Computer Science 2025-06-26 Andrei Lupu , Timon Willi , Jakob Foerster

Intuitive psychology is a pillar of common-sense reasoning. The replication of this reasoning in machine intelligence is an important stepping-stone on the way to human-like artificial intelligence. Several recent tasks and benchmarks for…

Artificial Intelligence · Computer Science 2023-03-15 Tomer Ullman

Theory of Mind (ToM)$\unicode{x2014}$the ability to reason about the mental states of other people$\unicode{x2014}$is a key element of our social intelligence. Yet, despite their ever more impressive performance, large-scale neural language…

Computation and Language · Computer Science 2023-06-02 Melanie Sclar , Sachin Kumar , Peter West , Alane Suhr , Yejin Choi , Yulia Tsvetkov