English
Related papers

Related papers: UserHarness: Harnessing User Minds for Stronger Ag…

200 papers

For machine agents to successfully interact with humans in real-world settings, they will need to develop an understanding of human mental life. Intuitive psychology, the ability to reason about hidden mental variables that drive observable…

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

Computation and Language · Computer Science 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

In human-centered design, developing a comprehensive and in-depth understanding of user experiences, i.e., empathic understanding, is paramount for designing products that truly meet human needs. Nevertheless, accurately comprehending the…

Human-Computer Interaction · Computer Science 2024-03-21 Qihao Zhu , Leah Chong , Maria Yang , Jianxi Luo

Machine learning of Theory of Mind (ToM) is essential to build social agents that co-live with humans and other agents. This capacity, once acquired, will help machines infer the mental states of others from observed contextual action…

Machine Learning · Computer Science 2022-04-21 Dung Nguyen , Phuoc Nguyen , Hung Le , Kien Do , Svetha Venkatesh , Truyen Tran

Job interview simulation with a virtual agents aims at improving people's social skills and supporting professional inclusion. In such simulators, the virtual agent must be capable of representing and reasoning about the user's mental state…

Artificial Intelligence · Computer Science 2014-02-21 Marwen Belkaid , Nicolas Sabouret

In this paper, a pragmatic semantic communication framework that enables effective goal-oriented information sharing between two-intelligent agents is proposed. In particular, semantics is defined as the causal state that encapsulates the…

Information Theory · Computer Science 2023-12-01 Christo Kurisummoottil Thomas , Emilio Calvanese Strinati , Walid Saad

Evaluating the theory of mind (ToM) capabilities of language models (LMs) has recently received a great deal of attention. However, many existing benchmarks rely on synthetic data, which risks misaligning the resulting experiments with…

Computation and Language · Computer Science 2024-06-11 Adil Soubki , John Murzaku , Arash Yousefi Jordehi , Peter Zeng , Magdalena Markowska , Seyed Abolghasem Mirroshandel , Owen Rambow

A growing body of work attempts to evaluate the theory of mind (ToM) abilities of humans and large language models (LLMs) using static, non-interactive question-and-answer benchmarks. However, theoretical work in the field suggests that…

Computation and Language · Computer Science 2026-02-20 Jared Moore , Rasmus Overmark , Ned Cooper , Beba Cibralic , Nick Haber , Cameron R. Jones

Large Language Models (LLMs) have shown potential in simulating human behaviors and performing theory-of-mind (ToM) reasoning, a crucial skill for complex social interactions. In this study, we investigate the role of ToM reasoning in…

Computation and Language · Computer Science 2025-06-02 Neemesh Yadav , Palakorn Achananuparp , Jing Jiang , Ee-Peng Lim

Recently, the field of Multi-Agent Systems (MAS) has gained popularity as researchers are trying to develop artificial intelligence capable of efficient collective reasoning. Agents based on Large Language Models (LLMs) perform well in…

Multiagent Systems · Computer Science 2025-07-30 Adam Kostka , Jarosław A. Chudziak

Do large language models (LLMs) have theory of mind? A plethora of papers and benchmarks have been introduced to evaluate if current models have been able to develop this key ability of social intelligence. However, all rely on limited…

Machine Learning · Computer Science 2024-12-18 Melanie Sclar , Jane Yu , Maryam Fazel-Zarandi , Yulia Tsvetkov , Yonatan Bisk , Yejin Choi , Asli Celikyilmaz

Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although recent progress in Large Reasoning Models (LRMs) has boosted…

Artificial Intelligence · Computer Science 2026-03-05 Nanxu Gong , Haotian Li , Sixun Dong , Jianxun Lian , Yanjie Fu , Xing Xie

Recent studies have increasingly demonstrated that large language models (LLMs) possess significant theory of mind (ToM) capabilities, showing the potential for simulating the tracking of mental states in generative agents. In this study,…

Computation and Language · Computer Science 2025-01-28 Bo Yang , Jiaxian Guo , Yusuke Iwasawa , Yutaka Matsuo

A key feature of human theory-of-mind is the ability to attribute beliefs to other agents as mentalistic explanations for their behavior. But given the wide variety of beliefs that agents may hold about the world and the rich language we…

Computation and Language · Computer Science 2025-05-27 Lance Ying , Almog Hillel , Ryan Truong , Vikash K. Mansinghka , Joshua B. Tenenbaum , Tan Zhi-Xuan

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of…

Robotics · Computer Science 2026-01-07 Biyuan Liu , Daigang Xu , Lei Jiang , Wenjun Guo , Ping Chen

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

Machine Learning · Computer Science 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to…

Artificial Intelligence · Computer Science 2023-11-20 Alex Wilf , Sihyun Shawn Lee , Paul Pu Liang , Louis-Philippe Morency

Table reasoning requires models to jointly perform semantic understanding and precise numerical operations. Most existing methods rely on a single-turn reasoning paradigm over tables which suffers from context overflow and weak numerical…

Computation and Language · Computer Science 2026-03-11 Mingyue Cheng , Shuo Yu , Chuang Jiang , Xiaoyu Tao , Qingyang Mao , Jie Ouyang , Qi Liu , Enhong Chen

LLM-based MAS are gaining popularity due to their potential for collaborative problem-solving enhanced by advances in natural language comprehension, reasoning, and planning. Research in Theory of Mind (ToM) and Belief-Desire-Intention…

Multiagent Systems · Computer Science 2026-03-03 Adam Kostka , Jarosław A. Chudziak

Understanding how humans attribute beliefs, goals, and intentions to others, known as theory of mind (ToM), is critical in the context of human-computer interaction. Despite various metrics used to assess ToM, the interplay between…

Human-Computer Interaction · Computer Science 2025-11-11 Thuy Ngoc Nguyen , Jeffrey Flagg , Cleotilde Gonzalez