中文
相关论文

相关论文: DEIR: Efficient and Robust Exploration through Dis…

200 篇论文

Autonomous exploration in complex multi-agent reinforcement learning (MARL) with sparse rewards critically depends on providing agents with effective intrinsic motivation. While artificial curiosity offers a powerful self-supervised signal,…

机器学习 · 计算机科学 2026-02-24 Yiyuan Pan , Zhe Liu , Hesheng Wang

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

机器学习 · 计算机科学 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

机器学习 · 计算机科学 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

机器学习 · 计算机科学 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

Task automation of surgical robot has the potentials to improve surgical efficiency. Recent reinforcement learning (RL) based approaches provide scalable solutions to surgical automation, but typically require extensive data collection to…

机器人学 · 计算机科学 2023-02-21 Tao Huang , Kai Chen , Bin Li , Yun-Hui Liu , Qi Dou

Under sparse extrinsic reward settings, reinforcement learning has remained challenging, despite surging interests in this field. Previous attempts suggest that intrinsic reward can alleviate the issue caused by sparsity. In this article,…

机器学习 · 计算机科学 2023-06-28 Zijian Gao , Kele Xu , Yuanzhao Zhai , Dawei Feng , Bo Ding , XinJun Mao , Huaimin Wang

Classic reinforcement learning (RL) frequently confronts challenges in tasks involving delays, which cause a mismatch between received observations and subsequent actions, thereby deviating from the Markov assumption. Existing methods…

机器学习 · 计算机科学 2024-06-06 Bo Xia , Yilun Kong , Yongzhe Chang , Bo Yuan , Zhiheng Li , Xueqian Wang , Bin Liang

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

机器学习 · 计算机科学 2021-10-14 Ammar Fayad , Majd Ibrahim

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

机器学习 · 计算机科学 2024-10-22 Nadav Merlis

We consider the problem of reward learning for temporally extended tasks. For reward learning, inverse reinforcement learning (IRL) is a widely used paradigm. Given a Markov decision process (MDP) and a set of demonstrations for a task, IRL…

机器人学 · 计算机科学 2021-07-14 Farzan Memarian , Zhe Xu , Bo Wu , Min Wen , Ufuk Topcu

Exploration efficiency is a challenging problem in multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the collaborative approach among multiple agents. Another important problem is the less…

机器学习 · 计算机科学 2019-12-30 Qisheng Wang , Qichao Wang

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

机器学习 · 计算机科学 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

We present a new computing model for intrinsic rewards in reinforcement learning that addresses the limitations of existing surprise-driven explorations. The reward is the novelty of the surprise rather than the surprise norm. We estimate…

机器学习 · 计算机科学 2024-02-01 Hung Le , Kien Do , Dung Nguyen , Svetha Venkatesh

Reinforcement learning algorithms struggle when the reward signal is very sparse. In these cases, naive random exploration methods essentially rely on a random walk to stumble onto a rewarding state. Recent works utilize intrinsic…

机器学习 · 计算机科学 2019-06-14 Hyoungseok Kim , Jaekyeom Kim , Yeonwoo Jeong , Sergey Levine , Hyun Oh Song

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

In multi-agent reinforcement learning (MARL), effective exploration is critical, especially in sparse reward environments. Although introducing global intrinsic rewards can foster exploration in such settings, it often complicates credit…

机器学习 · 计算机科学 2024-05-29 Xinran Li , Zifan Liu , Shibo Chen , Jun Zhang

Deep Reinforcement Learning achieves very good results in domains where reward functions can be manually engineered. At the same time, there is growing interest within the community in using games based on Procedurally Content Generation…

机器学习 · 计算机科学 2020-12-07 Alessandro Sestini , Alexander Kuhnle , Andrew D. Bagdanov

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

机器学习 · 计算机科学 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

Unsupervised skill learning objectives (Gregor et al., 2016, Eysenbach et al., 2018) allow agents to learn rich repertoires of behavior in the absence of extrinsic rewards. They work by simultaneously training a policy to produce…

机器学习 · 计算机科学 2022-05-13 DJ Strouse , Kate Baumli , David Warde-Farley , Vlad Mnih , Steven Hansen