English
Related papers

Related papers: Deep Q-Learning: Theoretical Insights from an Asym…

200 papers

In the field of Autonomous Driving, the system controlling the vehicle can be seen as an agent acting in a complex environment and thus naturally fits into the modern framework of Reinforcement Learning. However, learning to drive can be a…

Artificial Intelligence · Computer Science 2018-11-26 Patrick Klose , Rudolf Mester

Temporal-difference and Q-learning play a key role in deep reinforcement learning, where they are empowered by expressive nonlinear function approximators such as neural networks. At the core of their empirical successes is the learned…

Machine Learning · Computer Science 2024-04-02 Yufeng Zhang , Qi Cai , Zhuoran Yang , Yongxin Chen , Zhaoran Wang

In this paper, we introduce a quantum extension of classical DNN, QDNN. The QDNN consisting of quantum structured layers can uniformly approximate any continuous function and has more representation power than the classical DNN. It still…

Quantum Physics · Physics 2020-10-20 Chen Zhao , Xiao-Shan Gao

The research on deep reinforcement learning which estimates Q-value by deep learning has been attracted the interest of researchers recently. In deep reinforcement learning, it is important to efficiently learn the experiences that an agent…

Machine Learning · Computer Science 2018-06-05 Daichi Nishio , Satoshi Yamane

Deep Learning methods have been adopted in mobile networks, especially for network management automation where they provide means for advanced machine cognition. Deep learning methods utilize cutting-edge hardware and software tools,…

Machine Learning · Computer Science 2021-03-09 Marton Kajo , Stephen S. Mwanje , Benedek Schultz , Georg Carle

Although Q-learning is one of the most successful algorithms for finding the best action-value function (and thus the optimal policy) in reinforcement learning, its implementation often suffers from large overestimation of Q-function values…

Machine Learning · Computer Science 2020-10-13 Huaqing Xiong , Lin Zhao , Yingbin Liang , Wei Zhang

Q-learning is a stochastic approximation version of the classic value iteration. The literature has established that Q-learning suffers from both maximization bias and slower convergence. Recently, multi-step algorithms have shown practical…

Machine Learning · Computer Science 2024-07-03 Antony Vijesh , Shreyas S R

We methodologically address the problem of Q-value overestimation in deep reinforcement learning to handle high-dimensional state spaces efficiently. By adapting concepts from information theory, we introduce an intrinsic penalty signal…

Artificial Intelligence · Computer Science 2018-11-21 Felix Leibfried , Jordi Grau-Moya , Haitham Bou-Ammar

In this paper, we introduce a non-crossing quantile (NQ) network for conditional distribution learning. By leveraging non-negative activation functions, the NQ network ensures that the learned distributions remain monotonic, effectively…

Machine Learning · Statistics 2025-04-14 Guohao Shen , Runpeng Dai , Guojun Wu , Shikai Luo , Chengchun Shi , Hongtu Zhu

Financial trading has been widely analyzed for decades with market participants and academics always looking for advanced methods to improve trading performance. Deep reinforcement learning (DRL), a recently reinvigorated method with…

Trading and Market Microstructure · Quantitative Finance 2021-06-17 Ali Hirsa , Joerg Osterrieder , Branka Hadji-Misheva , Jan-Alexander Posth

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

Information Theory · Computer Science 2018-12-10 Fan Meng , Peng Chen , Lenan Wu

Deep Q-Networks algorithm (DQN) was the first reinforcement learning algorithm using deep neural network to successfully surpass human level performance in a number of Atari learning environments. However, divergent and unstable behaviour…

Machine Learning · Computer Science 2022-10-10 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

We propose a novel distributionally robust $Q$-learning algorithm for the non-tabular case accounting for continuous state spaces where the state transition of the underlying Markov decision process is subject to model uncertainty. The…

Machine Learning · Computer Science 2025-05-27 Chung I Lu , Julian Sester , Aijia Zhang

This PhD thesis combines two of the most exciting research areas of the last decades: quantum computing and machine learning. We introduce dissipative quantum neural networks (DQNNs), which are designed for fully quantum learning tasks, are…

Quantum Physics · Physics 2022-05-18 Kerstin Beer

Deep reinforcement learning (DRL) has revolutionized quantitative trading (Q-trading) by achieving decent performance without significant human expert knowledge. Despite its achievements, we observe that the current state-of-the-art DRL…

Computational Engineering, Finance, and Science · Computer Science 2025-02-07 Zhiming Li , Junzhe Jiang , Yushi Cao , Aixin Cui , Bozhi Wu , Bo Li , Yang Liu , Danny Dongning Sun

In Reinforcement Learning the Q-learning algorithm provably converges to the optimal solution. However, as others have demonstrated, Q-learning can also overestimate the values and thereby spend too long exploring unhelpful states. Double…

Machine Learning · Computer Science 2023-03-16 David Barber

This paper proposes a Deep Reinforcement Learning algorithm for financial portfolio trading based on Deep Q-learning. The algorithm is capable of trading high-dimensional portfolios from cross-sectional datasets of any size which may…

Portfolio Management · Quantitative Finance 2021-12-10 Uta Pigorsch , Sebastian Schäfer

We propose a learning architecture that allows symbolic control and guidance in reinforcement learning with deep neural networks. We introduce SymDQN, a novel modular approach that augments the existing Dueling Deep Q-Networks (DuelDQN)…

Artificial Intelligence · Computer Science 2025-04-04 Ivo Amador , Nina Gierasimczuk

Deep learning and quantum computing have achieved dramatic progresses in recent years. The interplay between these two fast-growing fields gives rise to a new research frontier of quantum machine learning. In this work, we report the first…