中文
相关论文

相关论文: Multimodal Reward Shaping for Efficient Exploratio…

200 篇论文

In online reinforcement learning (RL), efficient exploration remains particularly challenging in high-dimensional environments with sparse rewards. In low-dimensional environments, where tabular parameterization is possible, count-based…

机器学习 · 计算机科学 2021-06-21 Tianjun Zhang , Paria Rashidinejad , Jiantao Jiao , Yuandong Tian , Joseph Gonzalez , Stuart Russell

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

机器学习 · 计算机科学 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos

Goal-conditioned reinforcement learning (RL) is an interesting extension of the traditional RL framework, where the dynamic environment and reward sparsity can cause conventional learning algorithms to fail. Reward shaping is a practical…

机器学习 · 计算机科学 2023-07-18 Hongyu Ding , Yuanze Tang , Qing Wu , Bo Wang , Chunlin Chen , Zhi Wang

Sparsity of rewards while applying a deep reinforcement learning method negatively affects its sample-efficiency. A viable solution to deal with the sparsity of rewards is to learn via intrinsic motivation which advocates for adding an…

人工智能 · 计算机科学 2023-02-22 Jiong Li , Pratik Gajane

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

人工智能 · 计算机科学 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

机器学习 · 计算机科学 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

One major limitation to the applicability of Reinforcement Learning (RL) to many practical domains is the large number of samples required to learn an optimal policy. To address this problem and improve learning efficiency, we consider a…

机器学习 · 计算机科学 2023-08-07 Roberto Cipollone , Giuseppe De Giacomo , Marco Favorito , Luca Iocchi , Fabio Patrizi

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

人工智能 · 计算机科学 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

Exploration under sparse reward is a long-standing challenge of model-free reinforcement learning. The state-of-the-art methods address this challenge by introducing intrinsic rewards to encourage exploration in novel states or uncertain…

机器学习 · 计算机科学 2021-02-05 Daochen Zha , Wenye Ma , Lei Yuan , Xia Hu , Ji Liu

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

机器学习 · 计算机科学 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

We introduce Random Reward Perturbation (RRP), a novel exploration strategy for reinforcement learning (RL). Our theoretical analyses demonstrate that adding zero-mean noise to environmental rewards effectively enhances policy diversity…

机器学习 · 计算机科学 2025-06-11 Haozhe Ma , Guoji Fu , Zhengding Luo , Jiele Wu , Tze-Yun Leong

We introduce an exploration bonus for deep reinforcement learning methods calculated using self-organising feature maps. Our method uses adaptive resonance theory (ART) providing online, unsupervised clustering to quantify the novelty of a…

机器学习 · 计算机科学 2023-02-09 Marius Lindegaard , Hjalmar Jacob Vinje , Odin Aleksander Severinsen

In the last few years, the research activity around reinforcement learning tasks formulated over environments with sparse rewards has been especially notable. Among the numerous approaches proposed to deal with these hard exploration…

机器学习 · 计算机科学 2022-11-22 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

The exploration \& exploitation dilemma poses significant challenges in reinforcement learning (RL). Recently, curiosity-based exploration methods achieved great success in tackling hard-exploration problems. However, they necessitate…

机器学习 · 计算机科学 2024-12-06 Yiran Wang , Chenshu Liu , Yunfan Li , Sanae Amani , Bolei Zhou , Lin F. Yang

Maximum entropy reinforcement learning integrates exploration into policy learning by providing additional intrinsic rewards proportional to the entropy of some distribution. In this paper, we propose a novel approach in which the intrinsic…

机器学习 · 计算机科学 2025-09-30 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

This paper investigates the use of intrinsic reward to guide exploration in multi-agent reinforcement learning. We discuss the challenges in applying intrinsic reward to multiple collaborative agents and demonstrate how unreliable reward…

人工智能 · 计算机科学 2019-06-06 Wendelin Böhmer , Tabish Rashid , Shimon Whiteson

Reinforcement learning provides an automated framework for learning behaviors from high-level reward specifications, but in practice the choice of reward function can be crucial for good results -- while in principle the reward only needs…

机器学习 · 计算机科学 2022-10-19 Abhishek Gupta , Aldo Pacchiano , Yuexiang Zhai , Sham M. Kakade , Sergey Levine

Reinforcement Learning (RL) has become a compelling way to strengthen the multi step reasoning ability of Large Language Models (LLMs). However, prevalent RL paradigms still lean on sparse outcome-based rewards and limited exploration,…

人工智能 · 计算机科学 2025-10-24 Xuan Zhang , Ruixiao Li , Zhijian Zhou , Long Li , Yulei Qin , Ke Li , Xing Sun , Xiaoyu Tan , Chao Qu , Yuan Qi

This paper proposes \emph{Episodic and Lifelong Exploration via Maximum ENTropy} (ELEMENT), a novel, multiscale, intrinsically motivated reinforcement learning (RL) framework that is able to explore environments without using any extrinsic…

机器学习 · 计算机科学 2024-12-06 Hongming Li , Shujian Yu , Bin Liu , Jose C. Principe

Reinforcement learning for embodied agents is a challenging problem. The accumulated reward to be optimized is often a very rugged function, and gradient methods are impaired by many local optimizers. We demonstrate, in an experimental…

人工智能 · 计算机科学 2016-06-01 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay