English
Related papers

Related papers: The EMPATHIC Framework for Task Learning from Impl…

200 papers

Modern AI agents are powerful but often fail to align with the idiosyncratic, evolving preferences of individual users. Prior approaches typically rely on static datasets, either training implicit preference models on interaction history or…

Training automated agents to complete complex tasks in interactive environments is challenging: reinforcement learning requires careful hand-engineering of reward functions, imitation learning requires specialized infrastructure and access…

Machine Learning · Computer Science 2023-02-21 Olivia Watkins , Trevor Darrell , Pieter Abbeel , Jacob Andreas , Abhishek Gupta

In this work, we present a hybrid learning method for training task-oriented dialogue systems through online user interactions. Popular methods for learning task-oriented dialogues include applying reinforcement learning with user feedback…

Computation and Language · Computer Science 2018-04-19 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Reinforcement learning problems are often described through rewards that indicate if an agent has completed some task. This specification can yield desirable behavior, however many problems are difficult to specify in this manner, as one…

Artificial Intelligence · Computer Science 2016-08-15 Ashley Edwards , Charles Isbell , Atsuo Takanishi

This paper contributes a preliminary report on the advantages and disadvantages of incorporating simultaneous human control and feedback signals in the training of a reinforcement learning robotic agent. While robotic human-machine…

Human-Computer Interaction · Computer Science 2016-06-23 Kory W. Mathewson , Patrick M. Pilarski

To widen their accessibility and increase their utility, intelligent agents must be able to learn complex behaviors as specified by (non-expert) human users. Moreover, they will need to learn these behaviors within a reasonable amount of…

Machine Learning · Computer Science 2019-02-13 Dilip Arumugam , Jun Ki Lee , Sophie Saskin , Michael L. Littman

Despite the fact that robotic platforms can provide both consistent practice and objective assessments of users over the course of their training, there are relatively few instances where physical human robot interaction has been…

Robotics · Computer Science 2019-11-20 Kathleen Fitzsimons , Aleksandra Kalinowska , Julius P. A. Dewald , Todd Murphey

Reward modeling represents a long-standing challenge in reinforcement learning from human feedback (RLHF) for aligning language models. Current reward modeling is heavily contingent upon experimental feedback data with high collection…

Computation and Language · Computer Science 2026-03-25 Hao Wang , Haocheng Yang , Licheng Pan , Lei Shen , Xiaoxi Li , Yinuo Wang , Zhichao Chen , Yuan Lu , Haoxuan Li , Zhouchen Lin

Reward function, as an incentive representation that recognizes humans' agency and rationalizes humans' actions, is particularly appealing for modeling human behavior in human-robot interaction. Inverse Reinforcement Learning is an…

Artificial Intelligence · Computer Science 2021-03-09 Ran Tian , Masayoshi Tomizuka , Liting Sun

Artificial agents capable of understanding and aligning with others' intentions are essential for safe and socially robust artificial intelligence. We introduce a computational framework for empathy in active inference agents, grounded in…

Machine learning, artificial intelligence and especially deep learning based approaches are often used to simplify or eliminate the burden of programming industrial robots. Using these approaches robots inherently learn a skill instead of…

Robotics · Computer Science 2021-04-22 Sanaz Behbahani , Siddharth Chhatpar , Said Zahrai , Vishakh Duggal , Mohak Sukhwani

Robots which interact with the physical world will benefit from a fine-grained tactile understanding of objects and surfaces. Additionally, for certain tasks, robots may need to know the haptic properties of an object before touching it. To…

Robotics · Computer Science 2016-04-13 Yang Gao , Lisa Anne Hendricks , Katherine J. Kuchenbecker , Trevor Darrell

One way to improve the relationship between humans and anthropomorphic agents is to have humans empathize with the agents. In this study, we focused on a task between an agent and a human in which the agent makes a mistake. To investigate…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

Robotics · Computer Science 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Understanding the intentions of robots is essential for natural and seamless human-robot collaboration. Ensuring that robots have means for non-verbal communication is a basis for intuitive and implicit interaction. For this, we contribute…

Robotics · Computer Science 2024-10-03 Jan Leusmann , Steeven Villa , Thomas Liang , Chao Wang , Albrecht Schmidt , Sven Mayer

Conventional reinforcement learning (RL) approaches often struggle to learn effective policies under sparse reward conditions, necessitating the manual design of complex, task-specific reward functions. To address this limitation,…

Robotics · Computer Science 2025-12-02 Suzie Kim

Embodiment is an important characteristic for all intelligent agents (creatures and robots), while existing scene description tasks mainly focus on analyzing images passively and the semantic understanding of the scenario is separated from…

Robotics · Computer Science 2020-05-08 Sinan Tan , Huaping Liu , Di Guo , Xinyu Zhang , Fuchun Sun

The increasing level of autonomy of robots poses challenges of trust and social acceptance, especially in human-robot interaction scenarios. This requires an interpretable implementation of robotic cognitive capabilities, possibly based on…

Artificial Intelligence · Computer Science 2025-01-14 Daniele Meli , Paolo Fiorini

Human feedback is widely used to train agents in many domains. However, previous works rarely consider the uncertainty when humans provide feedback, especially in cases that the optimal actions are not obvious to the trainers. For example,…

Artificial Intelligence · Computer Science 2020-06-09 Xu He , Haipeng Chen , Bo An

The purpose of the present study is to learn emotion expression representations for artificial agents using reward shaping mechanisms. The approach takes inspiration from the TAMER framework for training a Multilayer Perceptron (MLP) to…

Robotics · Computer Science 2020-03-31 Nikhil Churamani , Francisco Cruz , Sascha Griffiths , Pablo Barros