English
Related papers

Related papers: DQN with model-based exploration: efficient learni…

200 papers

Reinforcement Learning can be applied to various tasks, and environments. Many of these environments have a similar shared structure, which can be exploited to improve RL performance on other tasks. Transfer learning can be used to take…

Machine Learning · Computer Science 2023-08-02 Ashrya Agrawal , Priyanshi Shah , Sourabh Prakash

This paper provides a theoretical understanding of Deep Q-Network (DQN) with the $\varepsilon$-greedy exploration in deep reinforcement learning. Despite the tremendous empirical achievement of the DQN, its theoretical characterization…

Machine Learning · Computer Science 2023-10-26 Shuai Zhang , Hongkang Li , Meng Wang , Miao Liu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Keerthiram Murugesan , Subhajit Chaudhury

In this paper we consider reinforcement learning tasks with progressive rewards; that is, tasks where the rewards tend to increase in magnitude over time. We hypothesise that this property may be problematic for value-based deep…

Machine Learning · Computer Science 2021-04-30 Michael Dann , John Thangarajah

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daiki Kimura

Despite the empirical success of the deep Q network (DQN) reinforcement learning algorithm and its variants, DQN is still not well understood and it does not guarantee convergence. In this work, we show that DQN can indeed diverge and cease…

Machine Learning · Computer Science 2022-05-04 Zhikang T. Wang , Masahito Ueda

Deep Reinforcement Learning has been able to achieve amazing successes in a variety of domains from video games to continuous control by trying to maximize the cumulative reward. However, most of these successes rely on algorithms that…

Machine Learning · Computer Science 2017-09-15 Rakesh R Menon , Balaraman Ravindran

This paper reviews exploration techniques in deep reinforcement learning. Exploration techniques are of primary importance when solving sparse reward problems. In sparse reward problems, the reward is rare, which means that the agent will…

Machine Learning · Computer Science 2022-05-03 Pawel Ladosz , Lilian Weng , Minwoo Kim , Hyondong Oh

All reinforcement learning algorithms must handle the trade-off between exploration and exploitation. Many state-of-the-art deep reinforcement learning methods use noise in the action selection, such as Gaussian noise in policy gradient…

Machine Learning · Computer Science 2018-04-05 Trevor Barron , Oliver Obst , Heni Ben Amor

While many sophisticated exploration methods have been proposed, their lack of generality and high computational cost often lead researchers to favor simpler methods like $\epsilon$-greedy. Motivated by this, we introduce $\beta$-DQN, a…

Machine Learning · Computer Science 2025-10-29 Hongming Zhang , Fengshuo Bai , Chenjun Xiao , Chao Gao , Bo Xu , Martin Müller

Recent advancements in deep reinforcement learning (DRL) techniques have sparked its multifaceted applications in the automation sector. Managing complex decision-making problems with DRL encourages its use in the nuclear industry for tasks…

Artificial Intelligence · Computer Science 2026-02-19 Biswajit Sadhu , Trijit Sadhu , S. Anand

Guided exploration with expert demonstrations improves data efficiency for reinforcement learning, but current algorithms often overuse expert information. We propose a novel algorithm to speed up Q-learning with the help of a limited…

Machine Learning · Computer Science 2022-10-06 Fengdi Che , Xiru Zhu , Doina Precup , David Meger , Gregory Dudek

We present a detailed study of Deep Q-Networks in finite environments, emphasizing the impact of epsilon-greedy exploration schedules and prioritized experience replay. Through systematic experimentation, we evaluate how variations in…

Machine Learning · Computer Science 2025-11-06 Daniel Perkins , Oscar J. Escobar , Luke Green

We present the first massively distributed architecture for deep reinforcement learning. This architecture uses four main components: parallel actors that generate new behaviour; parallel learners that are trained from stored experience; a…

In reinforcement learning, it is often difficult to automate high-dimensional, rapid decision-making in dynamic environments, especially when domains require real-time online interaction and adaptive strategies such as web-based games. This…

Machine Learning · Computer Science 2024-05-30 Prabhath Reddy Gujavarthy

Exploration in an unknown environment is the core functionality for mobile robots. Learning-based exploration methods, including convolutional neural networks, provide excellent strategies without human-designed logic for the feature…

Robotics · Computer Science 2016-10-10 Lei Tai , Ming Liu

Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and…

Machine Learning · Computer Science 2022-10-05 Per-Arne Andersen , Ole-Christoffer Granmo , Morten Goodwin

Deep Reinforcement Learning has yielded proficient controllers for complex tasks. However, these controllers have limited memory and rely on being able to perceive the complete game screen at each decision point. To address these…

Machine Learning · Computer Science 2017-01-13 Matthew Hausknecht , Peter Stone

Learning goal-directed behavior in environments with sparse feedback is a major challenge for reinforcement learning algorithms. The primary difficulty arises due to insufficient exploration, resulting in an agent being unable to learn…

Machine Learning · Computer Science 2016-06-01 Tejas D. Kulkarni , Karthik R. Narasimhan , Ardavan Saeedi , Joshua B. Tenenbaum

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

Machine Learning · Computer Science 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu

We employ the Deep Q-Learning algorithm with Experience Replay to train an agent capable of achieving a high-level of play in the L-Game while self-learning from low-dimensional states. We also employ variable batch size for training in…

Machine Learning · Computer Science 2018-02-20 Petros Giannakopoulos , Yannis Cotronis