English
Related papers

Related papers: Increasing Transparency of Reinforcement Learning …

200 papers

Cyber and cyber-physical systems equipped with machine learning algorithms such as autonomous cars share environments with humans. In such a setting, it is important to align system (or agent) behaviors with the preferences of one or more…

Machine Learning · Computer Science 2022-03-22 Arezoo Rajabi , Bhaskar Ramasubramanian , Abdullah Al Maruf , Radha Poovendran

Designing a reinforcement learning from human feedback (RLHF) algorithm to approximate a human's unobservable reward function requires assuming, implicitly or explicitly, a model of human preferences. A preference model that poorly…

Machine Learning · Computer Science 2026-04-14 Stephane Hatgis-Kessell , W. Bradley Knox , Serena Booth , Peter Stone

Robots can learn from humans by asking questions. In these questions the robot demonstrates a few different behaviors and asks the human for their favorite. But how should robots choose which questions to ask? Today's robots optimize for…

Human-Computer Interaction · Computer Science 2021-07-06 Soheil Habibian , Ananth Jonnavittula , Dylan P. Losey

Reinforcement learning (RL) is a popular machine learning paradigm for game playing, robotics control, and other sequential decision tasks. However, RL agents often have long learning times with high data requirements because they begin by…

Machine Learning · Computer Science 2021-02-05 Matthew E. Taylor , Nicholas Nissen , Yuan Wang , Neda Navidi

In reinforcement learning (RL), sparse rewards are a natural way to specify the task to be learned. However, most RL algorithms struggle to learn in this setting since the learning signal is mostly zeros. In contrast, humans are good at…

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

Machine Learning · Computer Science 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment. Safe Robot RL (SRRL) is a crucial step towards achieving human-robot…

Robotics · Computer Science 2023-10-18 Shangding Gu , Alap Kshirsagar , Yali Du , Guang Chen , Jan Peters , Alois Knoll

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

Robotics · Computer Science 2022-10-21 Erdem Bıyık

Reinforcement learning (RL) is a machine learning paradigm where an autonomous agent learns to make an optimal sequence of decisions by interacting with the underlying environment. The promise demonstrated by RL-guided workflows in…

Cryptography and Security · Computer Science 2022-08-31 Satwik Patnaik , Vasudev Gohil , Hao Guo , Jeyavijayan , Rajendran

We present the effect of adapting to human preferences on trust in a human-robot teaming task. The team performs a task in which the robot acts as an action recommender to the human. It is assumed that the behavior of the human and the…

Robotics · Computer Science 2023-09-12 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

Aligning human preference and value is an important requirement for contemporary foundation models. State-of-the-art techniques such as Reinforcement Learning from Human Feedback (RLHF) often consist of two stages: 1) supervised fine-tuning…

Artificial Intelligence · Computer Science 2024-10-29 Jiaxiang Li , Siliang Zeng , Hoi-To Wai , Chenliang Li , Alfredo Garcia , Mingyi Hong

Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks due to the difficulty in designing comprehensive and precise reward functions. This inherent difficulty curtails the broader…

Artificial Intelligence · Computer Science 2024-07-02 Zichao Shen , Tianchen Zhu , Qingyun Sun , Shiqi Gao , Jianxin Li

A robot's ability to provide descriptions of its decisions and beliefs promotes effective collaboration with humans. Providing such transparency is particularly challenging in integrated robot systems that include knowledge-based reasoning…

Artificial Intelligence · Computer Science 2020-10-22 Tiago Mota , Mohan Sridharan

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

In recent years, an increased effort has been invested to improve the capabilities of robots. Nevertheless, human-robot interaction remains a complex field of application where errors occur frequently. The reasons for these errors can…

Robotics · Computer Science 2021-08-27 Lukas Hindemith , Anna-Lisa Vollmer , Christiane B. Wiebel-Herboth , Britta Wrede

Reinforcement learning (RL) provides a powerful method to address problems in operations research. However, its real-world application often fails due to a lack of user acceptance and trust. A possible remedy is to provide managers with the…

Machine Learning · Computer Science 2025-04-04 Mirko Stappert , Bernhard Lutz , Niklas Goby , Dirk Neumann

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

Reinforcement learning (RL) agents aim at learning by interacting with an environment, and are not designed for representing or reasoning with declarative knowledge. Knowledge representation and reasoning (KRR) paradigms are strong in…

Artificial Intelligence · Computer Science 2018-11-26 Keting Lu , Shiqi Zhang , Peter Stone , Xiaoping Chen

Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid…

Cryptography and Security · Computer Science 2024-02-27 Zheyu Zhang