English
Related papers

Related papers: Multi-Pass Q-Networks for Deep Reinforcement Learn…

200 papers

The performance of Deep Q-Networks (DQN) is critically dependent on the ability of its underlying neural network to accurately approximate the action-value function. Standard function approximators, such as multi-layer perceptrons, may…

Machine Learning · Computer Science 2025-08-21 Saman Yazdannik , Morteza Tayefi , Shamim Sanisales

This paper provides a theoretical understanding of Deep Q-Network (DQN) with the $\varepsilon$-greedy exploration in deep reinforcement learning. Despite the tremendous empirical achievement of the DQN, its theoretical characterization…

Machine Learning · Computer Science 2023-10-26 Shuai Zhang , Hongkang Li , Meng Wang , Miao Liu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Keerthiram Murugesan , Subhajit Chaudhury

We present the first massively distributed architecture for deep reinforcement learning. This architecture uses four main components: parallel actors that generate new behaviour; parallel learners that are trained from stored experience; a…

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of…

Machine Learning · Computer Science 2018-05-22 Zichuan Lin , Tianqi Zhao , Guangwen Yang , Lintao Zhang

We introduce a model-free algorithm for learning in Markov decision processes with parameterized actions-discrete actions with continuous parameters. At each step the agent must select both which action to use and which parameters to use…

Artificial Intelligence · Computer Science 2015-11-30 Warwick Masson , Pravesh Ranchod , George Konidaris

In recent years there is a growing interest in using deep representations for reinforcement learning. In this paper, we present a methodology and tools to analyze Deep Q-networks (DQNs) in a non-blind matter. Moreover, we propose a new…

Machine Learning · Computer Science 2017-04-25 Tom Zahavy , Nir Ben Zrihem , Shie Mannor

Deep Q-Networks (DQN) is one of the most well-known methods of deep reinforcement learning, which uses deep learning to approximate the action-value function. Solving numerous Deep reinforcement learning challenges such as moving targets…

Machine Learning · Computer Science 2020-08-18 S. Amirreza Badran , Mansoor Rezghi

We explore Deep Reinforcement Learning in a parameterized action space. Specifically, we investigate how to achieve sample-efficient end-to-end training in these tasks. We propose a new compact architecture for the tasks where the parameter…

Machine Learning · Computer Science 2018-10-24 Ermo Wei , Drew Wicke , Sean Luke

Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand. This also limits the applicability of RL in real-world…

Machine Learning · Computer Science 2025-03-04 Théo Vincent , Fabian Wahren , Jan Peters , Boris Belousov , Carlo D'Eramo

Experience replay lets online reinforcement learning agents remember and reuse experiences from the past. In prior work, experience transitions were uniformly sampled from a replay memory. However, this approach simply replays transitions…

Machine Learning · Computer Science 2016-02-26 Tom Schaul , John Quan , Ioannis Antonoglou , David Silver

One desired aspect of microservices architecture is the ability to self-adapt its own architecture and behaviour in response to changes in the operational environment. To achieve the desired high levels of self-adaptability, this research…

Software Engineering · Computer Science 2021-12-07 Basel Magableh

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

Systems and Control · Electrical Eng. & Systems 2022-05-19 Shambhuraj Sawant , Sebastien Gros

Discrete-action algorithms have been central to numerous recent successes of deep reinforcement learning. However, applying these algorithms to high-dimensional action tasks requires tackling the combinatorial increase of the number of…

Machine Learning · Computer Science 2019-01-28 Arash Tavakoli , Fabio Pardo , Petar Kormushev

In this study, we present two distinct approaches within the realm of Deep Reinforcement Learning (Deep-RL) aimed at enhancing mapless navigation for a ground-based mobile robot. The research methodology primarily involves a comparative…

We apply Deep Q-network (DQN) with the consideration of safety during the task for deciding whether to conduct the maneuver. Furthermore, we design two similar Deep Q learning frameworks with quadratic approximator for deciding how to…

Robotics · Computer Science 2019-07-31 Tianyu Shi , Pin Wang , Xuxin Cheng , Ching-Yao Chan , Ding Huang

In this paper, the implementation of two Reinforcement learnings namely, Q Learning and Deep Q Network(DQN) on a Self Balancing Robot Gazebo model has been discussed. The goal of the experiments is to make the robot model learn the best…

Robotics · Computer Science 2018-07-24 MD Muhaimin Rahman , SM Hasanur Rashid , M. M Hossain

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Tackling multi-agent learning problems efficiently is a challenging task in continuous action domains. While value-based algorithms excel in sample efficiency when applied to discrete action domains, they are usually inefficient when…

Multiagent Systems · Computer Science 2024-02-13 Yasin Findik , S. Reza Ahmadzadeh

The behavior decision-making subsystem is a key component of the autonomous driving system, which reflects the decision-making ability of the vehicle and the driver, and is an important symbol of the high-level intelligence of the vehicle.…

Machine Learning · Computer Science 2024-12-31 Zixiang Wang , Hao Yan , Changsong Wei , Junyu Wang , Minheng Xiao

The model-driven power allocation (PA) algorithms in the wireless cellular networks with interfering multiple-access channel (IMAC) have been investigated for decades. Nowadays, the data-driven model-free machine learning-based approaches…

Information Theory · Computer Science 2018-12-10 Fan Meng , Peng Chen , Lenan Wu