English
Related papers

Related papers: Robot Metacognition: Decision Making with Confiden…

200 papers

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

Intuitively, obedience -- following the order that a human gives -- seems like a good property for a robot to have. But, we humans are not perfect and we may give orders that are not best aligned to our preferences. We show that when a…

Artificial Intelligence · Computer Science 2017-05-30 Smitha Milli , Dylan Hadfield-Menell , Anca Dragan , Stuart Russell

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

Humans often assume that robots are rational. We believe robots take optimal actions given their objective; hence, when we are uncertain about what the robot's objective is, we interpret the robot's actions as optimal with respect to our…

Robotics · Computer Science 2019-09-13 Dylan P. Losey , Dorsa Sadigh

Autonomous robots operating in open and changing environments cannot always rely on predefined inputs, outputs, and action routines. Although existing learning methods enable robots to improve their performance through environmental…

Artificial Intelligence · Computer Science 2026-05-26 Hong Su

Using a dual-task paradigm, we explore how robot actions, performance, and the introduction of a secondary task influence human trust and engagement. In our study, a human supervisor simultaneously engages in a target-tracking task while…

Robotics · Computer Science 2024-10-29 Dong Hae Mangalindan , Vaibhav Srivastava

Robot-assisted navigation is a perfect example of a class of applications requiring flexible control approaches. When the human is reliable, the robot should concede space to their initiative. When the human makes inappropriate choices the…

Robotics · Computer Science 2023-12-25 Placido Falqueto , Alessandro Antonucci , Luigi Palopoli , Daniele Fontanelli

Assistive robots can potentially improve the quality of life and personal independence of elderly people by supporting everyday life activities. To guarantee a safe and intuitive interaction between human and robot, human intentions need to…

Robotics · Computer Science 2019-07-05 Susanne Trick , Dorothea Koert , Jan Peters , Constantin Rothkopf

This paper demonstrates the groundwork for the structure and nature of Human-Robot Cognitive Coupling.The human mind is best at associating objects, while digital devices can only compare. Successful communication between robot and human…

Robotics · Computer Science 2018-01-30 Yusuke Inoune , Agunar Prayit

Our goal is to model and experimentally assess trust evolution to predict future beliefs and behaviors of human-robot teams in dynamic environments. Research suggests that maintaining trust among team members in a human-robot team is vital…

Robotics · Computer Science 2025-11-12 Dong Hae Mangalindan , Ericka Rovira , Vaibhav Srivastava

Knowledge about how well a robot can perform a specific task is currently present only in engineering reports which are inaccessible to the robot. Artificial Intelligence techniques, such as hypergraphs and automated reasoning, can provide…

Software Engineering · Computer Science 2024-12-04 Joris Sijs , Carlos Hernandez-Corbato , Willeke van Vught , Julio Oliveira

Trust in robots has been gathering attention from multiple directions, as it has special relevance in the theoretical descriptions of human-robot interactions. It is essential for reaching high acceptance and usage rates of robotic…

Robotics · Computer Science 2021-06-07 Hebert Azevedo-Sa , X. Jessie Yang , Lionel P. Robert , Dawn M. Tilbury

The last half-decade has seen a steep rise in the number of contributions on safe learning methods for real-world robotic deployments from both the control and reinforcement learning communities. This article provides a concise but holistic…

To design trustworthy robots, we need to understand the impact factors of trust: people's attitudes, experience, and characteristics; the robot's physical design, reliability, and performance; a task's specification and the circumstances…

Robotics · Computer Science 2017-03-10 Satragni Sarkar , Dejanira Araiza-Illan , Kerstin Eder

Imitation learning enables robots to learn new tasks from human examples. One fundamental limitation while learning from humans is causal confusion. Causal confusion occurs when the robot's observations include both task-relevant and…

Robotics · Computer Science 2025-03-04 Robert Ramirez Sanchez , Heramb Nemlekar , Shahabedin Sagheb , Cara M. Nunez , Dylan P. Losey

Joint human-AI inference holds immense potential to improve outcomes in human-supervised robot missions. Current day missions are generally in the AI-assisted setting, where the human operator makes the final inference based on the AI…

Human-Computer Interaction · Computer Science 2025-08-06 Duc-An Nguyen , Clara Colombatto , Steve Fleming , Ingmar Posner , Nick Hawes , Raunak Bhattacharyya

Taking advice from others requires confidence in their competence. This is important for interaction with peers, but also for collaboration with social robots and artificial agents. Nonetheless, we do not always have access to information…

Robotics · Computer Science 2022-12-21 Joshua Zonca , Anna Folso , Alessandra Sciutti

A robust decision-making process must take into account uncertainty, especially when the choice involves inherent risks. Because artificial Intelligence (AI) systems are increasingly integrated into decision-making workflows, managing…

Artificial Intelligence · Computer Science 2026-04-17 Richard Servajean , Philippe Servajean

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

Metareasoning, a branch of AI, focuses on reasoning about reasons. It has the potential to enhance robots' decision-making processes in unexpected situations. However, the concept has largely been confined to theoretical discussions and…

Robotics · Computer Science 2025-05-07 Adrian Lendinez , Renxi Qiu , Lanfranco Zanzi , Dayou Li