English
Related papers

Related papers: Implementing the Deep Q-Network

200 papers

Deep Q-learning algorithms often suffer from poor gradient estimations with an excessive variance, resulting in unstable training and poor sampling efficiency. Stochastic variance-reduced gradient methods such as SVRG have been applied to…

Machine Learning · Computer Science 2020-07-28 Haonan Jia , Xiao Zhang , Jun Xu , Wei Zeng , Hao Jiang , Xiaohui Yan , Ji-Rong Wen

DQN (Deep Q-Network) is a method to perform Q-learning for reinforcement learning using deep neural networks. DQNs require a large buffer and batch processing for an experience replay and rely on a backpropagation based iterative…

Machine Learning · Computer Science 2023-03-14 Hirohisa Watanabe , Mineto Tsukada , Hiroki Matsutani

Caching is envisioned to play a critical role in next-generation content delivery infrastructure, cellular networks, and Internet architectures. By smartly storing the most popular contents at the storage-enabled network entities during…

Information Theory · Computer Science 2019-07-12 Alireza Sadeghi , Gang Wang , Georgios B. Giannakis

Q-learning methods represent a commonly used class of algorithms in reinforcement learning: they are generally efficient and simple, and can be combined readily with function approximators for deep reinforcement learning (RL). However, the…

Machine Learning · Computer Science 2019-02-28 Justin Fu , Aviral Kumar , Matthew Soh , Sergey Levine

Predicting a sequence of actions has been crucial in the success of recent behavior cloning algorithms in robotics. Can similar ideas improve reinforcement learning (RL)? We answer affirmatively by observing that incorporating action…

Machine Learning · Computer Science 2025-11-18 Younggyo Seo , Pieter Abbeel

Deep learning is a modern approach to realize artificial intelligence. Many frameworks exist to implement the machine learning task; however, performance is limited by computing resources. Using a quantum computer to accelerate training is…

Quantum Physics · Physics 2019-01-29 Zhao-Yun Chen , Cheng Xue , Si-Ming Chen , Guo-Ping Guo

The use of Reinforcement Learning (RL) is still restricted to simulation or to enhance human-operated systems through recommendations. Real-world environments (e.g. industrial robots or power grids) are generally designed with safety…

Machine Learning · Computer Science 2020-08-14 Mathieu Seurin , Philippe Preux , Olivier Pietquin

In this paper, we propose a principled deep reinforcement learning (RL) approach that is able to accelerate the convergence rate of general deep neural networks (DNNs). With our approach, a deep RL agent (synonym for optimizer in this work)…

Machine Learning · Computer Science 2017-07-14 Jie Fu

This article revisits the 20-year-old neural fitted Q-iteration (NFQ) algorithm on its classical CartPole benchmark. NFQ was a pioneering approach towards modern Deep Reinforcement Learning (Deep RL) in applying multi-layer neural networks…

Machine Learning · Computer Science 2025-11-18 Sascha Lange , Roland Hafner , Martin Riedmiller

Deep reinforcement learning has been shown to be a powerful framework for learning policies from complex high-dimensional sensory inputs to actions in complex tasks, such as the Atari domain. In this paper, we explore output representation…

Machine Learning · Computer Science 2016-06-16 Ishan P. Durugkar , Clemens Rosenbaum , Stefan Dernbach , Sridhar Mahadevan

Recommender systems struggle to provide accurate suggestions to new users with limited interaction history, a challenge known as the cold-user problem. This paper proposes a reinforcement learning approach using Double and Dueling Deep…

Information Retrieval · Computer Science 2025-09-01 Minda Zhao

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

Machine Learning · Computer Science 2019-10-24 Egor Rotinov

We present a novel method for training a social robot to generate backchannels during human-robot interaction. We address the problem within an off-policy reinforcement learning framework, and show how a robot may learn to produce…

Artificial Intelligence · Computer Science 2019-08-06 Nusrah Hussain , Engin Erzin , T. Metin Sezgin , Yucel Yemez

Recent developments have established the vulnerability of deep Reinforcement Learning (RL) to policy manipulation attacks via adversarial perturbations. In this paper, we investigate the robustness and resilience of deep RL to training-time…

Artificial Intelligence · Computer Science 2017-12-29 Vahid Behzadan , Arslan Munir

With more deep learning techniques being introduced into the knowledge tracing domain, the interpretability issue of the knowledge tracing models has aroused researchers' attention. Our previous study(Lu et al. 2020) on building and…

Artificial Intelligence · Computer Science 2021-11-02 Deliang Wang , Yu Lu , Qinggang Meng , Penghe Chen

NDN has gained significant attention due to the appearance of several unforeseen design flaws that became evident with new communication scenarios. Among its many features, the two standard NDN forwarding strategies are not adaptive,…

Networking and Internet Architecture · Computer Science 2020-10-21 Ygor Amaral B. L. de Sena , Kelvin Lopes Dias , Cleber Zanchettin

Tailoring treatment for individual patients is crucial yet challenging in order to achieve optimal healthcare outcomes. Recent advances in reinforcement learning offer promising personalized treatment recommendations; however, they rely…

Machine Learning · Computer Science 2023-07-06 Simin Ma , Junghwan Lee , Nicoleta Serban , Shihao Yang

Reinforcement Learning (RL) is a research area that has blossomed tremendously in recent years and has shown remarkable potential for artificial intelligence based opponents in computer games. This success is primarily due to vast…

Artificial Intelligence · Computer Science 2018-01-30 Per-Arne Andersen

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

Information Theory · Computer Science 2018-12-10 Fan Meng , Peng Chen , Lenan Wu

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra