中文
相关论文

相关论文: Deep Reinforcement Learning with Double Q-learning

200 篇论文

Playing two-player games using reinforcement learning and self-play can be challenging due to the complexity of two-player environments and the possible instability in the training process. We propose that a reinforcement learning algorithm…

机器学习 · 计算机科学 2025-02-06 Kimiya Saadat , Richard Zhao

This paper studies accelerations in Q-learning algorithms. We propose an accelerated target update scheme by incorporating the historical iterates of Q functions. The idea is conceptually inspired by the momentum-based accelerated methods…

机器学习 · 计算机科学 2019-05-14 Bowen Weng , Huaqing Xiong , Wei Zhang

Q-learning is one of the most well-known Reinforcement Learning algorithms. There have been tremendous efforts to develop this algorithm using neural networks. Bootstrapped Deep Q-Learning Network is amongst them. It utilizes multiple…

机器学习 · 计算机科学 2024-06-25 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

Q-learning methods represent a commonly used class of algorithms in reinforcement learning: they are generally efficient and simple, and can be combined readily with function approximators for deep reinforcement learning (RL). However, the…

机器学习 · 计算机科学 2019-02-28 Justin Fu , Aviral Kumar , Matthew Soh , Sergey Levine

Reinforcement learning agents learn by encouraging behaviours which maximize their total reward, usually provided by the environment. In many environments, however, the reward is provided after a series of actions rather than each single…

人工智能 · 计算机科学 2022-01-04 Mohammad Reza Bonyadi , Rui Wang , Maryam Ziaei

Off-policy reinforcement learning (RL) using a fixed offline dataset of logged interactions is an important consideration in real world applications. This paper studies offline RL using the DQN replay dataset comprising the entire replay…

机器学习 · 计算机科学 2020-11-25 Rishabh Agarwal , Dale Schuurmans , Mohammad Norouzi

In this paper, the implementation of two Reinforcement learnings namely, Q Learning and Deep Q Network(DQN) on a Self Balancing Robot Gazebo model has been discussed. The goal of the experiments is to make the robot model learn the best…

机器人学 · 计算机科学 2018-07-24 MD Muhaimin Rahman , SM Hasanur Rashid , M. M Hossain

A primary requirement for any reinforcement learning method is that it should produce policies that improve upon the initial guess. In this work, we show that the widely used Deep Q-Network (DQN) fails to satisfy this minimal criterion --…

机器学习 · 计算机科学 2025-06-18 Aditya Gopalan , Gugan Thoppe

Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the…

机器学习 · 计算机科学 2022-01-11 Jiajun Fan , Changnan Xiao , Yue Huang

Parameterised actions in reinforcement learning are composed of discrete actions with continuous action-parameters. This provides a framework for solving complex domains that require combining high-level actions with flexible control. The…

机器学习 · 计算机科学 2019-05-14 Craig J. Bester , Steven D. James , George D. Konidaris

The research on deep reinforcement learning which estimates Q-value by deep learning has been attracted the interest of researchers recently. In deep reinforcement learning, it is important to efficiently learn the experiences that an agent…

机器学习 · 计算机科学 2018-06-05 Daichi Nishio , Satoshi Yamane

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

机器学习 · 计算机科学 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

神经与进化计算 · 计算机科学 2024-05-09 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

The variable and unpredictable load demands in hybrid agricultural tractors make it difficult to design optimal rule-based energy management strategies, motivating the use of adaptive, learning-based control. However, existing approaches…

系统与控制 · 电气工程与系统科学 2025-08-06 Hend Abououf , Sidra Ghayour Bhatti , Qadeer Ahmed

This paper proposes new, end-to-end deep reinforcement learning algorithms for learning two-player zero-sum Markov games. Different from prior efforts on training agents to beat a fixed set of opponents, our objective is to find the Nash…

机器学习 · 计算机科学 2023-03-08 Zihan Ding , Dijia Su , Qinghua Liu , Chi Jin

In this paper we investigate the properties of representations learned by deep reinforcement learning systems. Much of the early work on representations for reinforcement learning focused on designing fixed-basis architectures to achieve…

机器学习 · 计算机科学 2023-05-08 Han Wang , Erfan Miahi , Martha White , Marlos C. Machado , Zaheer Abbas , Raksha Kumaraswamy , Vincent Liu , Adam White

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance,…

人工智能 · 计算机科学 2019-09-10 Kamyar Azizzadenesheli , Animashree Anandkumar

We propose a new ternary spiking neuron model to improve the representation capacity of binary spiking neurons in deep Q-learning. Although a ternary neuron model has recently been introduced to overcome the limited representation capacity…

机器学习 · 计算机科学 2025-06-05 Aref Ghoreishee , Abhishek Mishra , John Walsh , Anup Das , Nagarajan Kandasamy

Experience replay enables online reinforcement learning agents to store and reuse the previous experiences of interacting with the environment. In the original method, the experiences are sampled and replayed uniformly at random. A prior…

机器学习 · 计算机科学 2021-12-13 Fanchen Bu , Dong Eui Chang

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…