English
Related papers

Related papers: Uncertainty-Aware Reward-Free Exploration with Gen…

200 papers

The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is mainly dependent on the design of the underlying reward function, which is highly prone to reward hacking. A misalignment between the reward…

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with their environments to learn effectively. These limitations…

Machine Learning · Computer Science 2025-08-01 Yarden As , Bhavya Sukhija , Lenart Treven , Carmelo Sferrazza , Stelian Coros , Andreas Krause

The reward signal plays a central role in defining the desired behaviors of agents in reinforcement learning (RL). Rewards collected from realistic environments could be perturbed, corrupted, or noisy due to an adversary, sensor error, or…

Machine Learning · Computer Science 2025-03-12 Xi Chen , Zhihui Zhu , Andrew Perrault

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

To further improve the learning efficiency and performance of reinforcement learning (RL), in this paper we propose a novel uncertainty-aware model-based RL (UA-MBRL) framework, and then implement and validate it in autonomous driving under…

Robotics · Computer Science 2021-07-06 Jingda Wu , Zhiyu Huang , Chen Lv

In real-world tasks, reinforcement learning (RL) agents frequently encounter situations that are not present during training time. To ensure reliable performance, the RL agents need to exhibit robustness against worst-case situations. The…

Machine Learning · Computer Science 2021-03-19 Sebastian Curi , Ilija Bogunovic , Andreas Krause

Model-free continuous control for robot navigation tasks using Deep Reinforcement Learning (DRL) that relies on noisy policies for exploration is sensitive to the density of rewards. In practice, robots are usually deployed in cluttered…

Robotics · Computer Science 2023-02-24 Mingyu Cai , Erfan Aasi , Calin Belta , Cristian-Ioan Vasile

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

Robotics · Computer Science 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

Machine Learning · Computer Science 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

Reward model (RM) plays a pivotal role in reinforcement learning with human feedback (RLHF) for aligning large language models (LLMs). However, classical RMs trained on human preferences are vulnerable to reward hacking and generalize…

Machine Learning · Computer Science 2025-10-24 Zhenghao Xu , Qin Lu , Qingru Zhang , Liang Qiu , Ilgee Hong , Changlong Yu , Wenlin Yao , Yao Liu , Haoming Jiang , Lihong Li , Hyokun Yun , Tuo Zhao

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

Characterizing aleatoric and epistemic uncertainty on the predicted rewards can help in building reliable reinforcement learning (RL) systems. Aleatoric uncertainty results from the irreducible environment stochasticity leading to…

Machine Learning · Computer Science 2022-06-06 Bertrand Charpentier , Ransalu Senanayake , Mykel Kochenderfer , Stephan Günnemann

This paper investigates the application of reinforcement learning (RL) to multi-robot social formation navigation, a critical capability for enabling seamless human-robot coexistence. While RL offers a promising paradigm, the inherent…

Robotics · Computer Science 2025-12-17 Hao Fu , Wei Liu , Shuai Zhou

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

Exploration is a fundamental aspect of reinforcement learning (RL), and its effectiveness is a deciding factor in the performance of RL algorithms, especially when facing sparse extrinsic rewards. Recent studies have shown the effectiveness…

Machine Learning · Computer Science 2023-05-19 Shanchuan Wan , Yujin Tang , Yingtao Tian , Tomoyuki Kaneko

Conventional reinforcement learning (RL) ap proaches often struggle to learn effective policies under sparse reward conditions, necessitating the manual design of complex, task-specific reward functions. To address this limitation, rein…

Robotics · Computer Science 2025-12-15 Suzie Kim , Hye-Bin Shin , Seong-Whan Lee

Exploration in complex domains is a key challenge in reinforcement learning, especially for tasks with very sparse rewards. Recent successes in deep reinforcement learning have been achieved mostly using simple heuristic exploration…

Machine Learning · Computer Science 2017-03-07 Joshua Achiam , Shankar Sastry

Meta-reinforcement learning (RL) addresses the problem of sample inefficiency in deep RL by using experience obtained in past tasks for a new task to be solved. However, most meta-RL methods require partially or fully on-policy data, i.e.,…

Artificial Intelligence · Computer Science 2021-01-07 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka