English
Related papers

Related papers: VA-learning as a more efficient alternative to Q-l…

200 papers

Recent work in deep reinforcement learning has allowed algorithms to learn complex tasks such as Atari 2600 games just from the reward provided by the game, but these algorithms presently require millions of training steps in order to…

Machine Learning · Computer Science 2018-01-09 Benjamin Spector , Serge Belongie

Artificial neural networks are promising for general function approximation but challenging to train on non-independent or non-identically distributed data due to catastrophic forgetting. The experience replay buffer, a standard component…

Machine Learning · Computer Science 2023-04-12 Qingfeng Lan , Yangchen Pan , Jun Luo , A. Rupam Mahmood

Offline reinforcement learning can enable policy learning from pre-collected, sub-optimal datasets without online interactions. This makes it ideal for real-world robots and safety-critical scenarios, where collecting online data or expert…

Robotics · Computer Science 2025-08-07 Sreyas Venkataraman , Yufei Wang , Ziyu Wang , Navin Sriram Ravie , Zackory Erickson , David Held

Deep reinforcement learning has demonstrated superhuman performance in complex decision-making tasks, but it struggles with generalization and knowledge reuse - key aspects of true intelligence. This article introduces a novel approach that…

Machine Learning · Computer Science 2024-11-12 Marko Ruman , Tatiana V. Guy

Real-world tasks are often highly structured. Hierarchical reinforcement learning (HRL) has attracted research interest as an approach for leveraging the hierarchical structure of a given task in reinforcement learning (RL). However,…

Machine Learning · Computer Science 2019-03-08 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

In this work we propose a planning and acting architecture endowed with a module which learns to select subgoals with Deep Q-Learning. This allows us to decrease the load of a planner when faced with scenarios with real-time restrictions.…

Artificial Intelligence · Computer Science 2024-06-24 Carlos Núñez-Molina , Juan Fernández-Olivares , Raúl Pérez

Q-learning methods represent a commonly used class of algorithms in reinforcement learning: they are generally efficient and simple, and can be combined readily with function approximators for deep reinforcement learning (RL). However, the…

Machine Learning · Computer Science 2019-02-28 Justin Fu , Aviral Kumar , Matthew Soh , Sergey Levine

Q-learning is one of the most well-known Reinforcement Learning algorithms. There have been tremendous efforts to develop this algorithm using neural networks. Bootstrapped Deep Q-Learning Network is amongst them. It utilizes multiple…

Machine Learning · Computer Science 2024-06-25 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

In traditional reinforcement learning, an agent maximizes the reward collected during its interaction with the environment by approximating the optimal policy through the estimation of value functions. Typically, given a state s and action…

Machine Learning · Computer Science 2018-06-20 Shangda Li , Selina Bing , Steven Yang

Deep Reinforcement Learning (DRL) has shown its promising capabilities to learn optimal policies directly from trial and error. However, learning can be hindered if the goal of the learning, defined by the reward function, is "not optimal".…

Artificial Intelligence · Computer Science 2019-10-09 Yizheng Zhang , Andre Rosendo

In some agent designs like inverse reinforcement learning an agent needs to learn its own reward function. Learning the reward function and optimising for it are typically two different processes, usually performed at different stages. We…

Artificial Intelligence · Computer Science 2020-04-29 Stuart Armstrong , Jan Leike , Laurent Orseau , Shane Legg

Offline reinforcement learning provides a viable approach to obtain advanced control strategies for dynamical systems, in particular when direct interaction with the environment is not available. In this paper, we introduce a conceptual…

Machine Learning · Computer Science 2024-01-04 Marc Weber , Phillip Swazinna , Daniel Hein , Steffen Udluft , Volkmar Sterzing

The asynchronous nature of the state-of-the-art reinforcement learning algorithms such as the Asynchronous Advantage Actor-Critic algorithm, makes them exceptionally suitable for CPU computations. However, given the fact that deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-17 Robert Adamski , Tomasz Grel , Maciej Klimek , Henryk Michalewski

Reinforcement learning is a model-free optimal control method that optimizes a control policy through direct interaction with the environment. For reaching tasks that end in regulation, popular discrete-action methods are not well suited…

Robotics · Computer Science 2021-06-23 Wouter Caarls

We propose a general agent population learning system, and on this basis, we propose lineage evolution reinforcement learning algorithm. Lineage evolution reinforcement learning is a kind of derivative algorithm which accords with the…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Zeyu Zhang , Guisheng Yin

We investigate the combination of actor-critic reinforcement learning algorithms with uniform large-scale experience replay and propose solutions for two challenges: (a) efficient actor-critic learning with experience replay (b) stability…

Machine Learning · Computer Science 2019-11-19 Simon Schmitt , Matteo Hessel , Karen Simonyan

Sample efficiency and performance in the offline setting have emerged as significant challenges of deep reinforcement learning. We introduce Q-Value Weighted Regression (QWR), a simple RL algorithm that excels in these aspects. QWR is an…

Machine Learning · Computer Science 2021-02-16 Piotr Kozakowski , Łukasz Kaiser , Henryk Michalewski , Afroz Mohiuddin , Katarzyna Kańska

Double Q-learning is a classical control algorithm that mitigates the maximization bias of Q-learning. To do so, it explicitly trains two independent action-value functions and uses them to decouple action-selection and action-evaluation…

Machine Learning · Computer Science 2026-05-18 Prabhat Nagarajan , Martha White , Marlos C. Machado

As AI technology advances, research in playing text-based games with agents has becomeprogressively popular. In this paper, a novel approach to agent design and agent learning ispresented with the context of reinforcement learning. A model…

Computation and Language · Computer Science 2025-09-04 Haonan Wang , Mingjia Zhao , Junfeng Sun , Wei Liu