English
Related papers

Related papers: AToM: Adaptive Theory-of-Mind-Based Human Motion P…

200 papers

Understanding people's social interactions in complex real-world scenarios often relies on intricate mental reasoning. To truly understand how and why people interact with one another, we must infer the underlying mental states that give…

Artificial Intelligence · Computer Science 2025-01-24 Haojun Shi , Suyu Ye , Xinyu Fang , Chuanyang Jin , Leyla Isik , Yen-Ling Kuo , Tianmin Shu

Robot understanding of human intentions is essential for fluid human-robot interaction. Intentions, however, cannot be directly observed and must be inferred from behaviors. We learn a model of adaptive human behavior conditioned on the…

Robotics · Computer Science 2019-01-23 Min Chen , David Hsu , Wee Sun Lee

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent…

Computation and Language · Computer Science 2023-09-14 Bart Holterman , Kees van Deemter

As autonomous systems become integral to various industries, effective strategies for fault handling are essential to ensure reliability and efficiency. Transfer of Control (ToC), a traditional approach for interrupting automated processes…

Robotics · Computer Science 2025-05-19 Julian Wolter , Amr Gomaa

Theory of Mind (ToM), the ability to understand people's mental states, is an essential ingredient for developing machines with human-level social intelligence. Recent machine learning models, particularly large language models, seem to…

Artificial Intelligence · Computer Science 2024-06-18 Chuanyang Jin , Yutong Wu , Jing Cao , Jiannan Xiang , Yen-Ling Kuo , Zhiting Hu , Tomer Ullman , Antonio Torralba , Joshua B. Tenenbaum , Tianmin Shu

Human motion prediction is essential for the safe and smooth operation of mobile service robots and intelligent vehicles around people. Commonly used neural network-based approaches often require large amounts of complete trajectories to…

Robotics · Computer Science 2023-06-07 Yufei Zhu , Andrey Rudenko , Tomasz P. Kucner , Achim J. Lilienthal , Martin Magnusson

Theory of Mind (ToM)-an understanding of the mental states of others-is a key aspect of human social intelligence, yet, chatbots and LLM-based social agents do not typically integrate it. In this work, we demonstrate that LLMs that…

Computation and Language · Computer Science 2026-04-14 EunJeong Hwang , Yuwei Yin , Giuseppe Carenini , Peter West , Vered Shwartz

Human social interactions depend on the ability to infer others' unspoken intentions, emotions, and beliefs-a cognitive skill grounded in the psychological concept of Theory of Mind (ToM). While large language models (LLMs) excel in…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

Theory of Mind (ToM) is central to social cognition and human-AI interaction, and Large Language Models (LLMs) have been used to help understand and represent ToM. However, most evaluations treat ToM as a static judgment at a single moment,…

Artificial Intelligence · Computer Science 2026-03-17 Thuy Ngoc Nguyen , Duy Nhat Phan , Cleotilde Gonzalez

A robot operating in isolation needs to reason over the uncertainty in its model of the world and adapt its own actions to account for this uncertainty. Similarly, a robot interacting with people needs to reason over its uncertainty over…

Robotics · Computer Science 2017-08-07 Stefanos Nikolaidis , Jodi Forlizzi , David Hsu , Julie Shah , Siddhartha Srinivasa

Theory of Mind (ToM) is the ability to understand and reflect on the mental states of others. Although this capability is crucial for human interaction, testing on Large Language Models (LLMs) reveals that they possess only a rudimentary…

Computation and Language · Computer Science 2025-01-17 Sneheel Sarangi , Maha Elgarf , Hanan Salam

Accurate prediction of human behavior is essential for robust and safe human-AI collaboration. However, existing approaches for modeling people are often data-hungry and brittle because they either make unrealistic assumptions about…

Artificial Intelligence · Computer Science 2025-10-03 Kunal Jha , Aydan Yuenan Huang , Eric Ye , Natasha Jaques , Max Kleiman-Weiner

Theory of Mind (ToM) refers to an agent's ability to model the internal states of others. Contributing to the debate whether large language models (LLMs) exhibit genuine ToM capabilities, our study investigates their ToM robustness using…

Computation and Language · Computer Science 2026-02-26 Christian Nickel , Laura Schrewe , Florian Mai , Lucie Flek

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to…

Robotics · Computer Science 2023-01-04 Ran Tian , Masayoshi Tomizuka , Anca Dragan , Andrea Bajcsy

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

While humans are inherently social creatures, the challenge of identifying when and how to assist and collaborate with others - particularly when pursuing independent goals - can hinder cooperation. To address this challenge, we aim to…

Artificial Intelligence · Computer Science 2025-09-08 Matteo Bortoletto , Yichao Zhou , Lance Ying , Tianmin Shu , Andreas Bulling

Recent evidence suggests Large Language Models (LLMs) display Theory of Mind (ToM) abilities. Most ToM experiments place participants in a spectatorial role, wherein they predict and interpret other agents' behavior. However, human ToM also…

Computation and Language · Computer Science 2025-07-23 Jared Moore , Ned Cooper , Rasmus Overmark , Beba Cibralic , Nick Haber , Cameron R. Jones

In the domain of autonomous household robots, it is of utmost importance for robots to understand human behaviors and provide appropriate services. This requires the robots to possess the capability to analyze complex human behaviors and…

Robotics · Computer Science 2025-04-11 Zhe Sun , Rujie Wu , Xiaodong Yang , Hongzhao Xie , Haiyan Jiang , Junda Bi , Zhenliang Zhang

Predictive human models often need to adapt their parameters online from human data. This raises previously ignored safety-related questions for robots relying on these models such as what the model could learn online and how quickly could…

Robotics · Computer Science 2021-10-01 Andrea Bajcsy , Anand Siththaranjan , Claire J. Tomlin , Anca D. Dragan