中文
相关论文

相关论文: Feature Control as Intrinsic Motivation for Hierar…

200 篇论文

Deep Reinforcement Learning (DRL) is a promising approach for teaching robots new behaviour. However, one of its main limitations is the need for carefully hand-coded reward signals by an expert. We argue that it is crucial to automate the…

机器人学 · 计算机科学 2021-08-09 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this…

机器学习 · 计算机科学 2017-11-29 Harm van Seijen , Mehdi Fatemi , Joshua Romoff , Romain Laroche , Tavian Barnes , Jeffrey Tsang

Inverse reinforcement learning (IRL) is the problem of inferring the reward function of an agent, given its policy or observed behavior. Analogous to RL, IRL is perceived both as a problem and as a class of methods. By categorically…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

计算与语言 · 计算机科学 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent…

机器学习 · 计算机科学 2018-11-06 Ameet Deshpande , Srikanth Sarma , Ashutosh Jha , Balaraman Ravindran

In today's rapidly evolving military landscape, advancing artificial intelligence (AI) in support of wargaming becomes essential. Despite reinforcement learning (RL) showing promise for developing intelligent agents, conventional RL faces…

机器学习 · 计算机科学 2024-08-27 Scotty Black

Hierarchical reinforcement learning (HRL) decomposes the policy into a manager and a worker, enabling long-horizon planning but introducing a performance gap on tasks requiring agility. We identify a root cause: in subgoal-based HRL, the…

人工智能 · 计算机科学 2026-04-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

机器学习 · 计算机科学 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are easily interpreted,…

机器学习 · 计算机科学 2020-10-12 Hassam Sheikh , Shauharda Khadka , Santiago Miret , Somdeb Majumdar

The high-dimensional or sparse reward task of a reinforcement learning (RL) environment requires a superior potential controller such as hierarchical reinforcement learning (HRL) rather than an atomic RL because it absorbs the complexity of…

机器学习 · 计算机科学 2021-07-20 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

机器学习 · 计算机科学 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information about the environment.…

机器学习 · 计算机科学 2023-10-11 Jacob Chmura , Hasham Burhani , Xiao Qi Shi

Inverse reinforcement learning (IRL) denotes a powerful family of algorithms for recovering a reward function justifying the behavior demonstrated by an expert agent. A well-known limitation of IRL is the ambiguity in the choice of the…

机器学习 · 计算机科学 2023-04-26 Alberto Maria Metelli , Filippo Lazzati , Marcello Restelli

Conventional video summarization approaches based on reinforcement learning have the problem that the reward can only be received after the whole summary is generated. Such kind of reward is sparse and it makes reinforcement learning hard…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Yiyan Chen , Li Tao , Xueting Wang , Toshihiko Yamasaki

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

机器学习 · 计算机科学 2023-12-20 Lisheng Wu , Ke Chen

Humans are able to understand and perform complex tasks by strategically structuring the tasks into incremental steps or subgoals. For a robot attempting to learn to perform a sequential task with critical subgoal states, such states can…

人机交互 · 计算机科学 2018-06-25 Xinlei Pan , Eshed Ohn-Bar , Nicholas Rhinehart , Yan Xu , Yilin Shen , Kris M. Kitani

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

机器学习 · 计算机科学 2019-09-05 Jacob Rafati , David C. Noelle

Recent reinforcement learning (RL) approaches have shown strong performance in complex domains such as Atari games, but are often highly sample inefficient. A common approach to reduce interaction time with the environment is to use reward…

机器学习 · 计算机科学 2019-06-03 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Deep reinforcement Learning (DRL) offers a powerful framework for training AI agents to coordinate with human partners. However, DRL faces two critical challenges in human-AI coordination (HAIC): sparse rewards and unpredictable human…

人工智能 · 计算机科学 2025-08-04 Xin Hao , Bahareh Nakisa , Mohmmad Naim Rastgoo , Gaoyang Pang

Sparse rewards and long time horizons remain challenging for reinforcement learning algorithms. Exploration bonuses can help in sparse reward settings by encouraging agents to explore the state space, while hierarchical approaches can…

人工智能 · 计算机科学 2021-08-13 Willie McClinton , Andrew Levy , George Konidaris