English
Related papers

Related papers: Natural Gradient Deep Q-learning

200 papers

Deep Q-learning algorithms often suffer from poor gradient estimations with an excessive variance, resulting in unstable training and poor sampling efficiency. Stochastic variance-reduced gradient methods such as SVRG have been applied to…

Machine Learning · Computer Science 2020-07-28 Haonan Jia , Xiao Zhang , Jun Xu , Wei Zeng , Hao Jiang , Xiaohui Yan , Ji-Rong Wen

Non-stationary environments pose a fundamental challenge for deep reinforcement learning, as changes in dynamics or rewards invalidate learned value functions and cause catastrophic forgetting. We propose \emph{Gradient-Boosted Deep…

Machine Learning · Computer Science 2025-12-22 Chang-Hwan Lee , Chanseung Lee

Deep reinforcement learning algorithms often use two networks for value function optimization: an online network, and a target network that tracks the online network with some delay. Using two separate networks enables the agent to hedge…

Machine Learning · Computer Science 2023-04-19 Kavosh Asadi , Rasool Fakoor , Omer Gottesman , Taesup Kim , Michael L. Littman , Alexander J. Smola

This paper focuses on the impact of leveraging autonomous offensive approaches in Deep Reinforcement Learning (DRL) to train more robust agents by exploring the impact of applying adversarial learning to DRL for autonomous security in…

Cryptography and Security · Computer Science 2023-08-15 Luke Borchjes , Clement Nyirenda , Louise Leenen

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

In this paper, we propose a principled deep reinforcement learning (RL) approach that is able to accelerate the convergence rate of general deep neural networks (DNNs). With our approach, a deep RL agent (synonym for optimizer in this work)…

Machine Learning · Computer Science 2017-07-14 Jie Fu

This paper investigates the effectiveness of adversarial training in enhancing the robustness of Deep Q-Network (DQN) policies to state-space perturbations. We first present a formal analysis of adversarial training in DQN agents and its…

Machine Learning · Computer Science 2019-06-05 Vahid Behzadan , William Hsu

The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science…

Robotics · Computer Science 2024-02-02 Raul Fernandez-Fernandez , Juan G. Victores , Carlos Balaguer

With the development of experimental quantum technology, quantum control has attracted increasing attention due to the realization of controllable artificial quantum systems. However, because quantum-mechanical systems are often too…

Quantum Physics · Physics 2022-12-22 Zhikang Wang

NDN has gained significant attention due to the appearance of several unforeseen design flaws that became evident with new communication scenarios. Among its many features, the two standard NDN forwarding strategies are not adaptive,…

Networking and Internet Architecture · Computer Science 2020-10-21 Ygor Amaral B. L. de Sena , Kelvin Lopes Dias , Cleber Zanchettin

Over the past decade, remarkable progress has been made in adopting deep neural networks to enhance the performance of conventional reinforcement learning. A notable milestone was the development of Deep Q-Networks (DQN), which achieved…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Klinsmann Agyei , Pouria Sarhadi , Daniel Polani

In this paper, we place deep Q-learning into a control-oriented perspective and study its learning dynamics with well-established techniques from robust control. We formulate an uncertain linear time-invariant model by means of the neural…

Machine Learning · Computer Science 2022-11-08 Balazs Varga , Balazs Kulcsar , Morteza Haghir Chehreghani

Standard deep reinforcement learning methods such as Deep Q-Networks (DQN) for multiple tasks (domains) face scalability problems. We propose a method for multi-domain dialogue policy learning---termed NDQN, and apply it to an…

Artificial Intelligence · Computer Science 2021-05-10 Heriberto Cuayáhuitl , Seunghak Yu , Ashley Williamson , Jacob Carse

We present DPIQN, a deep policy inference Q-network that targets multi-agent systems composed of controllable agents, collaborators, and opponents that interact with each other. We focus on one challenging issue in such systems---modeling…

Artificial Intelligence · Computer Science 2018-04-10 Zhang-Wei Hong , Shih-Yang Su , Tzu-Yun Shann , Yi-Hsiang Chang , Chun-Yi Lee

Deep reinforcement learning (DRL) algorithms have successfully been demonstrated on a range of challenging decision making and control tasks. One dominant component of recent deep reinforcement learning algorithms is the target network…

Machine Learning · Computer Science 2020-11-12 Lin Shao , Yifan You , Mengyuan Yan , Qingyun Sun , Jeannette Bohg

In this paper, the implementation of two Reinforcement learnings namely, Q Learning and Deep Q Network(DQN) on a Self Balancing Robot Gazebo model has been discussed. The goal of the experiments is to make the robot model learn the best…

Robotics · Computer Science 2018-07-24 MD Muhaimin Rahman , SM Hasanur Rashid , M. M Hossain

The Q-learning algorithm is known to be affected by the maximization bias, i.e. the systematic overestimation of action values, an important issue that has recently received renewed attention. Double Q-learning has been proposed as an…

Machine Learning · Computer Science 2021-02-03 Rong Zhu , Mattia Rigotti

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

Information Theory · Computer Science 2018-12-10 Fan Meng , Peng Chen , Lenan Wu

This paper presents a deep Q-network (DQN)-based gain-scheduling framework for safety-critical quadcopter trajectory tracking. Instead of directly learning control inputs, the proposed approach selects from a finite set of pre-certified…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hossein Rastgoftar , Muhammad J. H. Zahed

Deep Q-Networks algorithm (DQN) was the first reinforcement learning algorithm using deep neural network to successfully surpass human level performance in a number of Atari learning environments. However, divergent and unstable behaviour…

Machine Learning · Computer Science 2022-10-10 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal