English
Related papers

Related papers: Deep Q-Learning with Gradient Target Tracking

200 papers

Double Q-learning is a classical control algorithm that mitigates the maximization bias of Q-learning. To do so, it explicitly trains two independent action-value functions and uses them to decouple action-selection and action-evaluation…

Machine Learning · Computer Science 2026-05-18 Prabhat Nagarajan , Martha White , Marlos C. Machado

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

The use of target networks has been a popular and key component of recent deep Q-learning algorithms for reinforcement learning, yet little is known from the theory side. In this work, we introduce a new family of target-based temporal…

Machine Learning · Computer Science 2019-09-24 Donghwan Lee , Niao He

Deep reinforcement learning (DRL) methods such as the Deep Q-Network (DQN) have achieved state-of-the-art results in a variety of challenging, high-dimensional domains. This success is mainly attributed to the power of deep neural networks…

Artificial Intelligence · Computer Science 2017-11-06 Nir Levine , Tom Zahavy , Daniel J. Mankowitz , Aviv Tamar , Shie Mannor

Financial market prediction and optimal trading strategy development remain challenging due to market complexity and volatility. Our research in quantum finance and reinforcement learning for decision-making demonstrates the approach of…

Quantum Physics · Physics 2025-01-24 Siddhant Dutta , Nouhaila Innan , Alberto Marchisio , Sadok Ben Yahia , Muhammad Shafique

One of the major challenges in Deep Reinforcement Learning for control is the need for extensive training to learn the policy. Motivated by this, we present the design of the Control-Tutored Deep Q-Networks (CT-DQN) algorithm, a Deep…

Machine Learning · Computer Science 2022-12-05 Francesco De Lellis , Marco Coraggio , Giovanni Russo , Mirco Musolesi , Mario di Bernardo

Inspired by Double Q-learning algorithm, the Double-DQN (DDQN) algorithm was originally proposed in order to address the overestimation issue in the original DQN algorithm. The DDQN has successfully shown both theoretically and empirically…

Artificial Intelligence · Computer Science 2024-10-30 Shervin Halat , Mohammad Mehdi Ebadzadeh , Kiana Amani

This paper presents a novel technique based on gradient boosting to train the final layers of a neural network (NN). Gradient boosting is an additive expansion algorithm in which a series of models are trained sequentially to approximate a…

Machine Learning · Computer Science 2023-05-05 Seyedsaman Emami , Gonzalo Martínez-Muñoz

In this paper, the implementation of two Reinforcement learnings namely, Q Learning and Deep Q Network(DQN) on a Self Balancing Robot Gazebo model has been discussed. The goal of the experiments is to make the robot model learn the best…

Robotics · Computer Science 2018-07-24 MD Muhaimin Rahman , SM Hasanur Rashid , M. M Hossain

The Q-learning algorithm is known to be affected by the maximization bias, i.e. the systematic overestimation of action values, an important issue that has recently received renewed attention. Double Q-learning has been proposed as an…

Machine Learning · Computer Science 2021-02-03 Rong Zhu , Mattia Rigotti

Decentralized learning enables the training of deep learning models over large distributed datasets generated at different locations, without the need for a central server. However, in practical scenarios, the data distribution across these…

Machine Learning · Computer Science 2023-05-09 Sai Aparna Aketi , Abolfazl Hashemi , Kaushik Roy

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks. However, its efficacy is often limited by static training modes and heavy reliance on vast data from stable environments. To…

Machine Learning · Computer Science 2024-11-06 Xinhao Zhang , Jinghan Zhang , Wujun Si , Kunpeng Liu

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

The target network update frequency (TUF) is a central stabilization mechanism in (deep) Q-learning. However, their selection remains poorly understood and is often treated merely as another tunable hyperparameter rather than as a…

Machine Learning · Computer Science 2026-02-05 Simon Weissmann , Tilman Aach , Benedikt Wille , Sebastian Kassing , Leif Döring

This paper proposes a new robust update rule of target network for deep reinforcement learning (DRL), to replace the conventional update rule, given as an exponential moving average. The target network is for smoothly generating the…

Machine Learning · Computer Science 2021-01-12 Taisuke Kobayashi , Wendyam Eric Lionel Ilboudo

The fully-convolutional siamese network based on template matching has shown great potentials in visual tracking. During testing, the template is fixed with the initial target feature and the performance totally relies on the general…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Peixia Li , Boyu Chen , Wanli Ouyang , Dong Wang , Xiaoyun Yang , Huchuan Lu

This study enhances a Deep Q-Network (DQN) trading model by incorporating advanced techniques like Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, and Double DQN. Extensive tests on assets like BTC/USD and…

Computational Finance · Quantitative Finance 2023-11-21 Gang Hu

Deep Q-Networks (DQNs) estimate future returns by learning from transitions sampled from a replay buffer. However, the target updates in DQN often rely on next states generated by actions from past, potentially suboptimal, policy. As a…

Machine Learning · Computer Science 2025-11-07 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

With the development of experimental quantum technology, quantum control has attracted increasing attention due to the realization of controllable artificial quantum systems. However, because quantum-mechanical systems are often too…

Quantum Physics · Physics 2022-12-22 Zhikang Wang

Deep Q-Networks algorithm (DQN) was the first reinforcement learning algorithm using deep neural network to successfully surpass human level performance in a number of Atari learning environments. However, divergent and unstable behaviour…

Machine Learning · Computer Science 2022-10-10 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal