中文
相关论文

相关论文: Understanding Multi-Step Deep Reinforcement Learni…

200 篇论文

The vast majority of Reinforcement Learning methods is largely impacted by the computation effort and data requirements needed to obtain effective estimates of action-value functions, which in turn determine the quality of the overall…

机器学习 · 计算机科学 2025-04-04 Théo Vincent , Daniel Palenicek , Boris Belousov , Jan Peters , Carlo D'Eramo

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

机器学习 · 计算机科学 2022-03-04 Toshitaka Matsuki

Deep Q-Network (DQN) based multi-agent systems (MAS) for reinforcement learning (RL) use various schemes where in the agents have to learn and communicate. The learning is however specific to each agent and communication may be…

机器学习 · 计算机科学 2020-08-11 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Reinforcement learning algorithms based on Q-learning are driving Deep Reinforcement Learning (DRL) research towards solving complex problems and achieving super-human performance on many of them. Nevertheless, Q-Learning is known to be…

机器学习 · 计算机科学 2022-06-14 Andrea Cini , Carlo D'Eramo , Jan Peters , Cesare Alippi

Despite the great empirical success of deep reinforcement learning, its theoretical foundation is less well understood. In this work, we make the first attempt to theoretically understand the deep Q-network (DQN) algorithm (Mnih et al.,…

机器学习 · 计算机科学 2020-02-25 Jianqing Fan , Zhaoran Wang , Yuchen Xie , Zhuoran Yang

In this work, we take a fresh look at some old and new algorithms for off-policy, return-based reinforcement learning. Expressing these in a common form, we derive a novel algorithm, Retrace($\lambda$), with three desired properties: (1) it…

机器学习 · 计算机科学 2016-11-09 Rémi Munos , Tom Stepleton , Anna Harutyunyan , Marc G. Bellemare

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

信号处理 · 电气工程与系统科学 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

Deep reinforcement learning (DRL) methods such as the Deep Q-Network (DQN) have achieved state-of-the-art results in a variety of challenging, high-dimensional domains. This success is mainly attributed to the power of deep neural networks…

人工智能 · 计算机科学 2017-11-06 Nir Levine , Tom Zahavy , Daniel J. Mankowitz , Aviv Tamar , Shie Mannor

While many algorithmic extensions to Deep Q-Networks (DQN) have been proposed, there remains limited understanding of how different improvements interact. In particular, multi-step and ensemble style extensions have shown promise in…

机器学习 · 计算机科学 2025-06-09 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal

This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with…

机器学习 · 计算机科学 2024-06-04 Kevin Roice , Parham Mohammad Panahi , Scott M. Jordan , Adam White , Martha White

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

机器人学 · 计算机科学 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

Tennis strategy optimization is a challenging sequential decision-making problem involving hierarchical scoring, stochastic outcomes, long-horizon credit assignment, physical fatigue, and adaptation to opponent skill. I present a…

机器学习 · 计算机科学 2025-12-30 Vishnu Mohan

Bootstrapping is a core mechanism in Reinforcement Learning (RL). Most algorithms, based on temporal differences, replace the true value of a transiting state by their current estimate of this value. Yet, another estimate could be leveraged…

机器学习 · 计算机科学 2020-11-05 Nino Vieillard , Olivier Pietquin , Matthieu Geist

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

人工智能 · 计算机科学 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Integration of reinforcement learning with unmanned aerial vehicles (UAVs) to achieve autonomous flight has been an active research area in recent years. An important part focuses on obstacle detection and avoidance for UAVs navigating…

人工智能 · 计算机科学 2021-03-12 Jeremy Roghair , Kyungtae Ko , Amir Ehsan Niaraki Asli , Ali Jannesari

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which…

人工智能 · 计算机科学 2017-03-13 Oron Anschel , Nir Baram , Nahum Shimkin

We propose Deep Q-Networks (DQN) with model-based exploration, an algorithm combining both model-free and model-based approaches that explores better and learns environments with sparse rewards more efficiently. DQN is a general-purpose,…

机器学习 · 计算机科学 2019-03-25 Stephen Zhen Gou , Yuyang Liu

Deep reinforcement learning can learn effective policies for a wide range of tasks, but is notoriously difficult to use due to instability and sensitivity to hyperparameters. The reasons for this remain unclear. When using standard…

机器学习 · 计算机科学 2020-03-17 Aviral Kumar , Abhishek Gupta , Sergey Levine

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks. However, its efficacy is often limited by static training modes and heavy reliance on vast data from stable environments. To…

机器学习 · 计算机科学 2024-11-06 Xinhao Zhang , Jinghan Zhang , Wujun Si , Kunpeng Liu