English
Related papers

Related papers: Effect of Adapting to Human Preferences on Trust i…

200 papers

This paper examines the effect of real-time, personalized alignment of a robot's reward function to the human's values on trust and team performance. We present and compare three distinct robot interaction strategies: a non-learner strategy…

Robotics · Computer Science 2023-11-28 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

Robotics · Computer Science 2022-10-21 Erdem Bıyık

In human-robot teams, humans often start with an inaccurate model of the robot capabilities. As they interact with the robot, they infer the robot's capabilities and partially adapt to the robot, i.e., they might change their actions based…

Robotics · Computer Science 2017-06-15 Stefanos Nikolaidis , Swaprava Nath , Ariel D. Procaccia , Siddhartha Srinivasa

In socially assistive robotics, an important research area is the development of adaptation techniques and their effect on human-robot interaction. We present a meta-learning based policy gradient method for addressing the problem of…

Robotics · Computer Science 2019-08-13 Yuan Gao , Elena Sibirtseva , Ginevra Castellano , Danica Kragic

Handing objects to humans is an essential capability for collaborative robots. Previous research works on human-robot handovers focus on facilitating the performance of the human partner and possibly minimising the physical effort needed to…

The study of human-robot interaction is fundamental to the design and use of robotics in real-world applications. Robots will need to predict and adapt to the actions of human collaborators in order to achieve good performance and improve…

To facilitate effective human-robot interaction (HRI), trust-aware HRI has been proposed, wherein the robotic agent explicitly considers the human's trust during its planning and decision making. The success of trust-aware HRI depends on…

Robotics · Computer Science 2021-03-19 Yaohui Guo , Cong Shi , X. Jessie Yang

With the introduction of collaborative robots, humans and robots can now work together in close proximity and share the same workspace. However, this collaboration presents various challenges that need to be addressed to ensure seamless…

Robotics · Computer Science 2023-07-24 Ali Noormohammadi-Asl , Ali Ayub , Stephen L. Smith , Kerstin Dautenhahn

We are interested in the design of autonomous robot behaviors that learn the preferences of users over continued interactions, with the goal of efficiently executing navigation behaviors in a way that the user expects. In this paper, we…

Robotics · Computer Science 2020-11-06 Cory Hayes , Matthew Marge

With the advent of AI technologies, humans and robots are increasingly teaming up to perform collaborative tasks. To enable smooth and effective collaboration, the topic of value alignment (operationalized herein as the degree of dynamic…

Robotics · Computer Science 2024-05-29 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

Humans often assume that robots are rational. We believe robots take optimal actions given their objective; hence, when we are uncertain about what the robot's objective is, we interpret the robot's actions as optimal with respect to our…

Robotics · Computer Science 2019-09-13 Dylan P. Losey , Dorsa Sadigh

When interacting with each other, humans adjust their behavior based on perceived trust. To achieve similar adaptability, robots must accurately estimate human trust at sufficiently granular timescales while collaborating with humans. Beta…

Robotics · Computer Science 2025-07-18 Resul Dagdanov , Milan Andrejevic , Dikai Liu , Chin-Teng Lin

Shared autonomy integrates user input with robot autonomy in order to control a robot and help the user to complete a task. Our work aims to improve the performance of such a human-robot team: the robot tries to guide the human towards an…

Robotics · Computer Science 2017-06-15 Stefanos Nikolaidis , Yu Xiang Zhu , David Hsu , Siddhartha Srinivasa

Trust in automation, or more recently trust in autonomy, has received extensive research attention in the past two decades. The majority of prior literature adopted a "snapshot" view of trust and typically evaluated trust through…

Human-Computer Interaction · Computer Science 2020-10-02 Yaohui Guo , X. Jessie Yang

Reinforcement learning from human feedback usually models preferences using a reward function that does not distinguish between people. We argue that this is unlikely to be a good design choice in contexts with high potential for…

Trust is essential in shaping human interactions with one another and with robots. This paper discusses how human trust in robot capabilities transfers across multiple tasks. We first present a human-subject study of two distinct task…

Robotics · Computer Science 2021-08-27 Harold Soh , Yaqi Xie , Min Chen , David Hsu

Learning preferences implicit in the choices humans make is a well studied problem in both economics and computer science. However, most work makes the assumption that humans are acting (noisily) optimally with respect to their preferences.…

Machine Learning · Computer Science 2019-01-28 Lawrence Chan , Dylan Hadfield-Menell , Siddhartha Srinivasa , Anca Dragan

Learning from human feedback is a popular approach to train robots to adapt to user preferences and improve safety. Existing approaches typically consider a single querying (interaction) format when seeking human feedback and do not…

Robotics · Computer Science 2026-01-16 Yashwanthi Anand , Nnamdi Nwagwu , Kevin Sabbe , Naomi T. Fitter , Sandhya Saisubramanian

Designing a reinforcement learning from human feedback (RLHF) algorithm to approximate a human's unobservable reward function requires assuming, implicitly or explicitly, a model of human preferences. A preference model that poorly…

Machine Learning · Computer Science 2026-04-14 Stephane Hatgis-Kessell , W. Bradley Knox , Serena Booth , Peter Stone

Trust between team members is an essential requirement for any successful cooperation. Thus, engendering and maintaining the fellow team members' trust becomes a central responsibility for any member trying to not only successfully…

Artificial Intelligence · Computer Science 2023-03-07 Zahra Zahedi , Mudit Verma , Sarath Sreedharan , Subbarao Kambhampati
‹ Prev 1 2 3 10 Next ›