English
Related papers

Related papers: Quantum deep Q learning with distributed prioritiz…

200 papers

The popular Q-learning algorithm is known to overestimate action values under certain conditions. It was not previously known whether, in practice, such overestimations are common, whether they harm performance, and whether they can…

Machine Learning · Computer Science 2015-12-10 Hado van Hasselt , Arthur Guez , David Silver

We introduce a novel Deep Reinforcement Learning (DRL) algorithm called Deep Quality-Value (DQV) Learning. DQV uses temporal-difference learning to train a Value neural network and uses this network for training a second Quality-value…

Machine Learning · Statistics 2018-10-11 Matthia Sabatelli , Gilles Louppe , Pierre Geurts , Marco A. Wiering

Quantum circuits embed data in a Hilbert space whose dimensionality grows exponentially with the number of qubits, allowing even shallow parameterised quantum circuits (PQCs) to represent highly-correlated probability distributions that are…

Quantum Physics · Physics 2025-10-03 Jie Luo , Jeremy Kulcsar , Xueyin Chen , Giulio Giaconi , Georgios Korpas

Experience replay is central to off-policy algorithms in deep reinforcement learning (RL), but there remain significant gaps in our understanding. We therefore present a systematic and extensive analysis of experience replay in Q-learning…

Machine Learning · Computer Science 2020-07-15 William Fedus , Prajit Ramachandran , Rishabh Agarwal , Yoshua Bengio , Hugo Larochelle , Mark Rowland , Will Dabney

Deep Reinforcement Learning (DRL) has shown outstanding performance on inducing effective action policies that maximize expected long-term return on many complex tasks. Much of DRL work has been focused on sequences of events with discrete…

Machine Learning · Computer Science 2021-05-07 Yeo Jin Kim , Min Chi

Q-learning played a foundational role in the field reinforcement learning (RL). However, TD algorithms with off-policy data, such as Q-learning, or nonlinear function approximation like deep neural networks require several additional tricks…

Machine Learning · Computer Science 2025-04-23 Matteo Gallici , Mattie Fellows , Benjamin Ellis , Bartomeu Pou , Ivan Masmitja , Jakob Nicolaus Foerster , Mario Martin

Deep Reinforcement Learning has yielded proficient controllers for complex tasks. However, these controllers have limited memory and rely on being able to perceive the complete game screen at each decision point. To address these…

Machine Learning · Computer Science 2017-01-13 Matthew Hausknecht , Peter Stone

Reinforcement learning algorithms based on Q-learning are driving Deep Reinforcement Learning (DRL) research towards solving complex problems and achieving super-human performance on many of them. Nevertheless, Q-Learning is known to be…

Machine Learning · Computer Science 2022-06-14 Andrea Cini , Carlo D'Eramo , Jan Peters , Cesare Alippi

The deep Q-network (DQN) and return-based reinforcement learning are two promising algorithms proposed in recent years. DQN brings advances to complex sequential decision problems, while return-based algorithms have advantages in making use…

Machine Learning · Computer Science 2019-12-02 Wenjia Meng , Qian Zheng , Long Yang , Pengfei Li , Gang Pan

In this paper, a novel Deep Q-Network (DQN) based scheduling method to optimize delay time and fairness among entanglement requests in quantum repeater networks is proposed. The scheduling of requests determines which pairs of end nodes…

Quantum Physics · Physics 2025-05-20 Gongyu Ni , Lester Ho , Holger Claussen

Learning an effective representation for high-dimensional data is a challenging problem in reinforcement learning (RL). Deep reinforcement learning (DRL) such as Deep Q networks (DQN) achieves remarkable success in computer games by…

Machine Learning · Computer Science 2019-05-10 Borislav Mavrin , Hengshuai Yao , Linglong Kong

We propose Tabular Q-Learning (TabQL), a reinforcement learning framework that replaces the conventional parametric Q-network in Deep Q-Learning (DQN) with a tabular foundation model endowed with in-context learning capabilities. The key…

Machine Learning · Computer Science 2026-05-20 Qisai Liu , Zhanhong Jiang , Timilehin Ayanlade , Ashutosh Kumar Nirala , Yang Li , Aditya Balu , Soumik Sarkar

Model-based reinforcement learning uses models to plan, where the predictions and policies of an agent can be improved by using more computation without additional data from the environment, thereby improving sample efficiency. However,…

Machine Learning · Computer Science 2023-02-22 Animesh Kumar Paul , Videh Raj Nema

Recent advancements in quantum computing (QC) and machine learning (ML) have sparked considerable interest in the integration of these two cutting-edge fields. Among the various ML techniques, reinforcement learning (RL) stands out for its…

Quantum Physics · Physics 2024-09-10 Samuel Yen-Chi Chen

Distribution network reconfiguration (DNR) has proved to be an economical and effective way to improve the reliability of distribution systems. As optimal network configuration depends on system operating states (e.g., loads at each node),…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Mukesh Gautam , Narayan Bhusal , Mohammed Benidris

This paper presents a deep Q-network (DQN)-based gain-scheduling framework for safety-critical quadcopter trajectory tracking. Instead of directly learning control inputs, the proposed approach selects from a finite set of pre-certified…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hossein Rastgoftar , Muhammad J. H. Zahed

In recent years, Multifactorial Optimization (MFO) has gained a notable momentum in the research community. MFO is known for its inherent capability to efficiently address multiple optimization tasks at the same time, while transferring…

Machine Learning · Computer Science 2020-03-24 Aritz D. Martinez , Eneko Osaba , Javier Del Ser , Francisco Herrera

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

Machine Learning · Computer Science 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

Parameterised actions in reinforcement learning are composed of discrete actions with continuous action-parameters. This provides a framework for solving complex domains that require combining high-level actions with flexible control. The…

Machine Learning · Computer Science 2019-05-14 Craig J. Bester , Steven D. James , George D. Konidaris

Unit commitment (UC) optimizes the start-up and shutdown schedules of generating units to meet load demand while minimizing costs. However, the increasing integration of renewable energy introduces uncertainties for real-time scheduling.…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Xiang Wei , Ziqing Zhu , Linghua Zhu , Ze Hu , Xian Zhang , Guibin Wang , Siqi Bu , Ka Wing Chan