中文
相关论文

相关论文: Discovering and Exploiting Sparse Rewards in a Lea…

200 篇论文

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

机器学习 · 计算机科学 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

In many sequential decision making tasks, it is challenging to design reward functions that help an RL agent efficiently learn behavior that is considered good by the agent designer. A number of different formulations of the reward-design…

人工智能 · 计算机科学 2018-06-25 Zeyu Zheng , Junhyuk Oh , Satinder Singh

Solving sparse reward tasks through exploration is one of the major challenges in deep reinforcement learning, especially in three-dimensional, partially-observable environments. Critically, the algorithm proposed in this article uses a…

人工智能 · 计算机科学 2021-06-18 Gabriele Libardi , Gianni De Fabritiis

Reinforcement learning agents need exploratory behaviors to escape from local optima. These behaviors may include both immediate dithering perturbation and temporally consistent exploration. To achieve these, a stochastic policy model that…

机器学习 · 计算机科学 2018-12-27 Sirui Xie , Junning Huang , Lanxin Lei , Chunxiao Liu , Zheng Ma , Wei Zhang , Liang Lin

Dealing with sparse rewards is a longstanding challenge in reinforcement learning. The recent use of hindsight methods have achieved success on a variety of sparse-reward tasks, but they fail on complex tasks such as stacking multiple…

机器学习 · 计算机科学 2019-06-11 John B. Lanier , Stephen McAleer , Pierre Baldi

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

机器学习 · 计算机科学 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy

Learning to solve tasks from a sparse reward signal is a major challenge for standard reinforcement learning (RL) algorithms. However, in the real world, agents rarely need to solve sparse reward tasks entirely from scratch. More often, we…

机器学习 · 计算机科学 2023-11-22 Qiyang Li , Jason Zhang , Dibya Ghosh , Amy Zhang , Sergey Levine

Learning a near optimal policy in a partially observable system remains an elusive challenge in contemporary reinforcement learning. In this work, we consider episodic reinforcement learning in a reward-mixing Markov decision process (MDP).…

机器学习 · 计算机科学 2022-02-01 Jeongyeol Kwon , Yonathan Efroni , Constantine Caramanis , Shie Mannor

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

机器学习 · 计算机科学 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

Reinforcement learning with sparse rewards is still an open challenge. Classic methods rely on getting feedback via extrinsic rewards to train the agent, and in situations where this occurs very rarely the agent learns slowly or cannot…

机器学习 · 计算机科学 2022-03-04 Simone Parisi , Davide Tateo , Maximilian Hensel , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Reinforcement learning can solve decision-making problems and train an agent to behave in an environment according to a predesigned reward function. However, such an approach becomes very problematic if the reward is too sparse and so the…

人工智能 · 计算机科学 2024-06-12 Matej Pecháč , Michal Chovanec , Igor Farkaš

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

机器学习 · 计算机科学 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

While exploration in single-agent reinforcement learning has been studied extensively in recent years, considerably less work has focused on its counterpart in multi-agent reinforcement learning. To address this issue, this work proposes a…

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

机器学习 · 计算机科学 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Efficient exploration is an unsolved problem in Reinforcement Learning which is usually addressed by reactively rewarding the agent for fortuitously encountering novel situations. This paper introduces an efficient active exploration…

机器学习 · 计算机科学 2019-06-17 Pranav Shyam , Wojciech Jaśkowski , Faustino Gomez

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

机器学习 · 计算机科学 2020-01-13 Kai Jiang , XiaoLong Qin

Artificial intelligence is commonly defined as the ability to achieve goals in the world. In the reinforcement learning framework, goals are encoded as reward functions that guide agent behaviour, and the sum of observed rewards provide a…

机器学习 · 计算机科学 2016-05-26 Marlos C. Machado , Michael Bowling

Efficient exploration is necessary to achieve good sample efficiency for reinforcement learning in general. From small, tabular settings such as gridworlds to large, continuous and sparse reward settings such as robotic object manipulation…

机器学习 · 计算机科学 2019-06-20 Zhaohan Daniel Guo , Emma Brunskill

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

机器学习 · 计算机科学 2012-09-06 Christos Dimitrakakis