English
Related papers

Related papers: Should Robots be Obedient?

200 papers

This work aims to interpret human behavior to anticipate potential user confusion when a robot provides explanations for failure, allowing the robot to adapt its explanations for more natural and efficient collaboration. Using a dataset…

Robotics · Computer Science 2025-04-15 Andreas Naoum , Parag Khanna , Elmira Yadollahi , Mårten Björkman , Christian Smith

Shared autonomy enables robots to infer user intent and assist in accomplishing it. But when the user wants to do a new task that the robot does not know about, shared autonomy will hinder their performance by attempting to assist them with…

Robotics · Computer Science 2021-04-15 Matthew Zurek , Andreea Bobu , Daniel S. Brown , Anca D. Dragan

The project of aligning machine behavior with human values raises a basic problem: whose moral expectations should guide AI decision-making? Much alignment research assumes that the appropriate benchmark is how humans themselves would act…

Computers and Society · Computer Science 2026-05-13 Benjamin Minhao Chen , Xinyu Xie

People deeply care about how fairly they are treated by robots. The established paradigm for probing fairness in Human-Robot Interaction (HRI) involves measuring the perception of the fairness of a robot at the conclusion of an interaction.…

Robotics · Computer Science 2024-09-13 Houston Claure , Kate Candon , Inyoung Shin , Marynel Vázquez

Modern AI and robotic systems are characterized by a high and ever-increasing level of autonomy. At the same time, their applications in fields such as autonomous driving, service robotics and digital personal assistants move closer to…

Artificial Intelligence · Computer Science 2018-06-28 Nicolas Berberich , Klaus Diepold

Given the fast rise of increasingly autonomous artificial agents and robots, a key acceptability criterion will be the possible moral implications of their actions. In particular, intelligent persuasive systems (systems designed to…

Computers and Society · Computer Science 2014-04-16 Marco Guerini , Fabio Pianesi , Oliviero Stock

When robots share the same workspace with other intelligent agents (e.g., other robots or humans), they must be able to reason about the behaviors of their neighboring agents while accomplishing the designated tasks. In practice,…

Robotics · Computer Science 2022-10-18 Junhong Xu , Durgakant Pushp , Kai Yin , Lantao Liu

Machine learning algorithms are increasingly used to assist human decision-making. When the goal of machine assistance is to improve the accuracy of human decisions, it might seem appealing to design ML algorithms that complement human…

Computers and Society · Computer Science 2022-09-09 Nina Grgić-Hlača , Claude Castelluccia , Krishna P. Gummadi

Contemporary robots are increasingly mimicking human social behaviours to facilitate interaction, such as smiling to signal approachability, or hesitating before taking an action to allow people time to react. Such techniques can activate a…

Human-Computer Interaction · Computer Science 2025-09-10 James M. Berzuk , Lauren Corcoran , Brannen McKenzie-Lefurgey , Katie Szilagyi , James E. Young

This position paper aims to highlight and discuss the role of a robot's social credibility in interaction with humans. In particular, I want to explore a potential relation between social credibility and a robot's acceptability and…

Robotics · Computer Science 2021-09-08 Patrick Holthaus

With the advent of AI technologies, humans and robots are increasingly teaming up to perform collaborative tasks. To enable smooth and effective collaboration, the topic of value alignment (operationalized herein as the degree of dynamic…

Robotics · Computer Science 2024-05-29 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

One way to improve the relationship between humans and anthropomorphic agents is to have humans empathize with the agents. In this study, we focused on a task between an agent and a human in which the agent makes a mistake. To investigate…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

A widely accepted explanation for robots planning overcautious or overaggressive trajectories alongside human is that the crowd density exceeds a threshold such that all feasible trajectories are considered unsafe -- the freezing robot…

Robotics · Computer Science 2024-03-05 Muchen Sun , Peter Trautman , Todd Murphey

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

Robots often need to convey information to human users. For example, robots can leverage visual, auditory, and haptic interfaces to display their intent or express their internal state. In some scenarios there are socially agreed upon…

Robotics · Computer Science 2024-09-17 Benjamin A. Christie , Heramb Nemlekar , Dylan P. Losey

The Robadom project aims at creating a homecare robot that help and assist people in their daily life, either in doing task for the human or in managing day organization. A robot could have this kind of role only if it is accepted by…

Robotics · Computer Science 2012-06-15 Céline Jost , Brigitte Le Pévédic , Dominique Duhaut

Recent advances in robot learning have enabled robots to become increasingly better at mastering a predefined set of tasks. On the other hand, as humans, we have the ability to learn a growing set of tasks over our lifetime. Continual robot…

Robotics · Computer Science 2021-12-21 Muhammad Burhan Hafez , Stefan Wermter

Robot policies need to adapt to human preferences and/or new environments. Human experts may have the domain knowledge required to help robots achieve this adaptation. However, existing works often require costly offline re-training on…

Machine Learning · Computer Science 2023-02-28 Vivek Myers , Erdem Bıyık , Dorsa Sadigh

This paper introduces benefits and detriments of a robot bartender that is capable of adapting the interaction with human users according to their preferences in drinks, music, and hobbies. We believe that a personalised experience during a…

Robotics · Computer Science 2021-04-05 Alessandra Rossi , Vito Giura , Carmine Di Leva , Silvia Rossi

The 'intuitive' trust people feel when encountering robots in public spaces is a key determinant of their willingness to cooperate with these robots. We conducted four experiments to study this topic in the context of peacekeeping robots.…

Robotics · Computer Science 2022-05-20 Ohad Inbar , Joachim Meyer