中文
相关论文

相关论文: Reward-Respecting Subtasks for Model-Based Reinfor…

200 篇论文

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

系统与控制 · 电气工程与系统科学 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

A central challenge in reinforcement learning is discovering effective policies for tasks where rewards are sparsely distributed. We postulate that in the absence of useful reward signals, an effective exploration strategy should seek out…

In offline reinforcement learning (RL) agents are trained using a logged dataset. It appears to be the most natural route to attack real-life applications because in domains such as healthcare and robotics interactions with the environment…

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

机器学习 · 计算机科学 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

In this paper, we explore an approach to auxiliary task discovery in reinforcement learning based on ideas from representation learning. Auxiliary tasks tend to improve data efficiency by forcing the agent to learn auxiliary prediction and…

机器学习 · 计算机科学 2024-07-23 Banafsheh Rafiee , Sina Ghiassian , Jun Jin , Richard Sutton , Jun Luo , Adam White

Options in reinforcement learning allow agents to hierarchically decompose a task into subtasks, having the potential to speed up learning and planning. However, autonomously learning effective sets of options is still a major challenge in…

机器学习 · 计算机科学 2018-02-27 Marlos C. Machado , Clemens Rosenbaum , Xiaoxiao Guo , Miao Liu , Gerald Tesauro , Murray Campbell

Learning about many things can provide numerous benefits to a reinforcement learning system. For example, learning many auxiliary value functions, in addition to optimizing the environmental reward, appears to improve both exploration and…

机器学习 · 计算机科学 2020-08-25 Cam Linke , Nadia M. Ady , Martha White , Thomas Degris , Adam White

Options, which impose an inductive bias toward temporal and hierarchical structure, offer a powerful framework for reinforcement learning (RL). While effective in sequential decision-making, they are often handcrafted rather than learned.…

机器学习 · 计算机科学 2025-07-15 Harshil Kotamreddy , Marlos C. Machado

Reinforcement learning agents learn by encouraging behaviours which maximize their total reward, usually provided by the environment. In many environments, however, the reward is provided after a series of actions rather than each single…

人工智能 · 计算机科学 2022-01-04 Mohammad Reza Bonyadi , Rui Wang , Maryam Ziaei

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

机器学习 · 计算机科学 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

机器学习 · 计算机科学 2019-09-05 Jacob Rafati , David C. Noelle

In reinforcement learning, temporal difference-based algorithms can be sample-inefficient: for instance, with sparse rewards, no learning occurs until a reward is observed. This can be remedied by learning richer objects, such as a model of…

机器学习 · 计算机科学 2021-01-19 Léonard Blier , Corentin Tallec , Yann Ollivier

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

人工智能 · 计算机科学 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

We consider the problem of reward learning for temporally extended tasks. For reward learning, inverse reinforcement learning (IRL) is a widely used paradigm. Given a Markov decision process (MDP) and a set of demonstrations for a task, IRL…

机器人学 · 计算机科学 2021-07-14 Farzan Memarian , Zhe Xu , Bo Wu , Min Wen , Ufuk Topcu

Reinforcement learning provides a general framework for learning robotic skills while minimizing engineering effort. However, most reinforcement learning algorithms assume that a well-designed reward function is provided, and learn a single…

机器人学 · 计算机科学 2020-04-28 Archit Sharma , Michael Ahn , Sergey Levine , Vikash Kumar , Karol Hausman , Shixiang Gu

Rewards play an essential role in reinforcement learning. In contrast to rule-based game environments with well-defined reward functions, complex real-world robotic applications, such as contact-rich manipulation, lack explicit and…

机器学习 · 计算机科学 2022-05-30 Yuning Wu , Jieliang Luo , Hui Li

Although in recent years reinforcement learning has become very popular the number of successful applications to different kinds of operations research problems is rather scarce. Reinforcement learning is based on the well-studied dynamic…

机器学习 · 计算机科学 2020-04-03 Manuel Schneckenreither

Reinforcement Learning (RL) agents have demonstrated their potential across various robotic tasks. However, they still heavily rely on human-engineered reward functions, requiring extensive trial-and-error and access to target behavior…

机器人学 · 计算机科学 2025-03-03 Changyeon Kim , Minho Heo , Doohyun Lee , Jinwoo Shin , Honglak Lee , Joseph J. Lim , Kimin Lee

Reinforcement learning has shown promise in learning policies that can solve complex problems. However, manually specifying a good reward function can be difficult, especially for intricate tasks. Inverse reinforcement learning offers a…

机器学习 · 计算机科学 2017-11-28 Peter Henderson , Wei-Di Chang , Pierre-Luc Bacon , David Meger , Joelle Pineau , Doina Precup

Tasks where the set of possible actions depend discontinuously on the state pose a significant challenge for current reinforcement learning algorithms. For example, a locked door must be first unlocked, and then the handle turned before the…

机器人学 · 计算机科学 2023-03-09 Mrinal Verghese , Chris Atkeson