English
Related papers

Related papers: GUIDE: Real-Time Human-Shaped Agents

200 papers

Reinforcement learning (RL) is crucial for data science decision-making but suffers from sample inefficiency, particularly in real-world scenarios with costly physical interactions. This paper introduces a novel human-inspired framework to…

Machine Learning · Computer Science 2024-03-13 Ali Beikmohammadi , Sindri Magnússon

Exploration and reward specification are fundamental and intertwined challenges for reinforcement learning. Solving sequential decision-making tasks requiring expansive exploration requires either careful design of reward functions or the…

Machine Learning · Computer Science 2023-07-21 Marcel Torne , Max Balsells , Zihan Wang , Samedh Desai , Tao Chen , Pulkit Agrawal , Abhishek Gupta

Humans are spectacular reinforcement learners, constantly learning from and adjusting to experience and feedback. Unfortunately, this doesn't necessarily mean humans are fast learners. When tasks are challenging, learning can become…

Machine Learning · Computer Science 2022-12-16 Mark A. Rucker , Layne T. Watson , Matthew S. Gerber , Laura E. Barnes

Reinforcement Learning from Human feedback (RLHF) has become a powerful tool to fine-tune or train agentic machine learning models. Similar to how humans interact in social contexts, we can use many types of feedback to communicate our…

Machine Learning · Computer Science 2025-02-21 Yannick Metz , David Lindner , Raphaël Baur , Mennatallah El-Assady

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

Training automated agents to complete complex tasks in interactive environments is challenging: reinforcement learning requires careful hand-engineering of reward functions, imitation learning requires specialized infrastructure and access…

Machine Learning · Computer Science 2023-02-21 Olivia Watkins , Trevor Darrell , Pieter Abbeel , Jacob Andreas , Abhishek Gupta

Effective human-AI collaboration for physical task completion has significant potential in both everyday activities and professional domains. AI agents equipped with informative guidance can enhance human performance, but evaluating such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Filippos Bellos , Yayuan Li , Cary Shu , Ruey Day , Jeffrey M. Siskind , Jason J. Corso

The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer…

Artificial Intelligence · Computer Science 2022-10-12 Francisco Cruz , Adam Bignold , Hung Son Nguyen , Richard Dazeley , Peter Vamplew

Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the preferences of the…

Information Retrieval · Computer Science 2022-11-07 Xiong Junwu , Xiaoyun Feng , YunZhou Shi , James Zhang , Zhongzhou Zhao , Wei Zhou

Due to the limited smartness and abilities of machine intelligence, currently autonomous vehicles are still unable to handle all kinds of situations and completely replace drivers. Because humans exhibit strong robustness and adaptability…

Robotics · Computer Science 2021-04-16 Jingda Wu , Zhiyu Huang , Chao Huang , Zhongxu Hu , Peng Hang , Yang Xing , Chen Lv

Interactive reinforcement learning has allowed speeding up the learning process in autonomous agents by including a human trainer providing extra information to the agent in real-time. Current interactive reinforcement learning research has…

Artificial Intelligence · Computer Science 2021-09-06 Adam Bignold , Francisco Cruz , Richard Dazeley , Peter Vamplew , Cameron Foale

Building assistive interfaces for controlling robots through arbitrary, high-dimensional, noisy inputs (e.g., webcam images of eye gaze) can be challenging, especially when it involves inferring the user's desired action in the absence of a…

Robotics · Computer Science 2022-02-08 Sean Chen , Jensen Gao , Siddharth Reddy , Glen Berseth , Anca D. Dragan , Sergey Levine

Human explanation (e.g., in terms of feature importance) has been recently used to extend the communication channel between human and agent in interactive machine learning. Under this setting, human trainers provide not only the ground…

Artificial Intelligence · Computer Science 2021-10-28 Lin Guan , Mudit Verma , Sihang Guo , Ruohan Zhang , Subbarao Kambhampati

Humanoid robotics has strong potential to transform daily service and caregiving applications. Although recent advances in general motion tracking within physics engines (GMT) have enabled virtual characters and humanoid robots to reproduce…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuto Shibata , Kashu Yamazaki , Lalit Jayanti , Yoshimitsu Aoki , Mariko Isogawa , Katerina Fragkiadaki

The rapid evolution of the web has led to an exponential growth in content. Recommender systems play a crucial role in Human-Computer Interaction (HCI) by tailoring content based on individual preferences. Despite their importance,…

Information Retrieval · Computer Science 2023-10-18 Yubo Shu , Haonan Zhang , Hansu Gu , Peng Zhang , Tun Lu , Dongsheng Li , Ning Gu

Graphical User Interface (GUI) agents have the potential to assist users in interacting with complex software (e.g., PowerPoint, Photoshop). While prior research has primarily focused on automating user actions through clicks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Saelyne Yang , Jaesang Yu , Yi-Hao Peng , Kevin Qinghong Lin , Jae Won Cho , Yale Song , Juho Kim

Interactive reinforcement learning has shown promise in learning complex robotic tasks. However, the process can be human-intensive due to the requirement of a large amount of interactive feedback. This paper presents a new method that uses…

Robotics · Computer Science 2023-08-08 Shukai Liu , Chenming Wu , Ying Li , Liangjun Zhang

We describe a method to use discrete human feedback to enhance the performance of deep learning agents in virtual three-dimensional environments by extending deep-reinforcement learning to model the confidence and consistency of human…

Artificial Intelligence · Computer Science 2021-06-24 Zhiyu Lin , Brent Harrison , Aaron Keech , Mark O. Riedl

Learning collaborative behaviors is essential for multi-agent systems. Traditionally, multi-agent reinforcement learning solves this implicitly through a joint reward and centralized observations, assuming collaborative behavior will…

Robotics · Computer Science 2025-02-27 Zhengran Ji , Lingyu Zhang , Paul Sajda , Boyuan Chen

Designing an effective reward function has long been a challenge in reinforcement learning, particularly for complex tasks in unstructured environments. To address this, various learning paradigms have emerged that leverage different forms…

Machine Learning · Computer Science 2025-04-29 Muhammad Qasim Elahi , Somtochukwu Oguchienti , Maheed H. Ahmed , Mahsa Ghasemi