English
Related papers

Related papers: Generalization and Regularization in DQN

200 papers

While reinforcement learning methods have delivered remarkable results in a number of settings, generalization, i.e., the ability to produce policies that generalize in a reliable and systematic way, has remained a challenge. The problem of…

Artificial Intelligence · Computer Science 2025-12-23 Simon Ståhlberg , Blai Bonet , Hector Geffner

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Despite overparameterization, deep networks trained via supervised learning are easy to optimize and exhibit excellent generalization. One hypothesis to explain this is that overparameterized deep networks enjoy the benefits of implicit…

Machine Learning · Computer Science 2021-12-10 Aviral Kumar , Rishabh Agarwal , Tengyu Ma , Aaron Courville , George Tucker , Sergey Levine

Off-policy reinforcement learning (RL) using a fixed offline dataset of logged interactions is an important consideration in real world applications. This paper studies offline RL using the DQN replay dataset comprising the entire replay…

Machine Learning · Computer Science 2020-11-25 Rishabh Agarwal , Dale Schuurmans , Mohammad Norouzi

Reinforcement Learning can be applied to various tasks, and environments. Many of these environments have a similar shared structure, which can be exploited to improve RL performance on other tasks. Transfer learning can be used to take…

Machine Learning · Computer Science 2023-08-02 Ashrya Agrawal , Priyanshi Shah , Sourabh Prakash

In this paper, we investigate the problem of overfitting in deep reinforcement learning. Among the most common benchmarks in RL, it is customary to use the same environments for both training and testing. This practice offers relatively…

Machine Learning · Computer Science 2019-07-16 Karl Cobbe , Oleg Klimov , Chris Hesse , Taehoon Kim , John Schulman

A deep learning approach to reinforcement learning led to a general learner able to train on visual input to play a variety of arcade games at the human and superhuman levels. Its creators at the Google DeepMind's team called the approach:…

Machine Learning · Computer Science 2015-12-08 Ivan Sorokin , Alexey Seleznev , Mikhail Pavlov , Aleksandr Fedorov , Anastasiia Ignateva

Policies for complex visual tasks have been successfully learned with deep reinforcement learning, using an approach called deep Q-networks (DQN), but relatively large (task-specific) networks and extensive training are needed to achieve…

A machine learning (ML) system must learn not only to match the output of a target function on a training set, but also to generalize to novel situations in order to yield accurate predictions at deployment. In most practical applications,…

Machine Learning · Computer Science 2022-12-13 Clare Lyle

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

Machine Learning · Computer Science 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

Deep reinforcement learning (RL) agents often fail to generalize to unseen environments (yet semantically similar to trained agents), particularly when they are trained on high-dimensional state spaces, such as images. In this paper, we…

Machine Learning · Computer Science 2020-02-18 Kimin Lee , Kibok Lee , Jinwoo Shin , Honglak Lee

The recently introduced Deep Q-Networks (DQN) algorithm has gained attention as one of the first successful combinations of deep neural networks and reinforcement learning. Its promise was demonstrated in the Arcade Learning Environment…

Machine Learning · Computer Science 2016-04-25 Yitao Liang , Marlos C. Machado , Erik Talvitie , Michael Bowling

The deep reinforcement learning community has made several independent improvements to the DQN algorithm. However, it is unclear which of these extensions are complementary and can be fruitfully combined. This paper examines six extensions…

Artificial Intelligence · Computer Science 2017-10-09 Matteo Hessel , Joseph Modayil , Hado van Hasselt , Tom Schaul , Georg Ostrovski , Will Dabney , Dan Horgan , Bilal Piot , Mohammad Azar , David Silver

This study conducts a comparative analysis of three advanced Deep Reinforcement Learning models: Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C), within the BreakOut Atari game environment. Our…

Machine Learning · Computer Science 2024-07-22 Neil De La Fuente , Daniel A. Vidal Guerra

Since the introduction of DQN, a vast majority of reinforcement learning research has focused on reinforcement learning with deep neural networks as function approximators. New methods are typically evaluated on a set of environments that…

Machine Learning · Computer Science 2021-05-25 Johan S. Obando-Ceron , Pablo Samuel Castro

Despite the empirical success of the deep Q network (DQN) reinforcement learning algorithm and its variants, DQN is still not well understood and it does not guarantee convergence. In this work, we show that DQN can indeed diverge and cease…

Machine Learning · Computer Science 2022-05-04 Zhikang T. Wang , Masahito Ueda

Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a single level in a…

Machine Learning · Computer Science 2018-11-30 Niels Justesen , Ruben Rodriguez Torrado , Philip Bontrager , Ahmed Khalifa , Julian Togelius , Sebastian Risi

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent…

Machine Learning · Computer Science 2018-11-20 Farzan Farnia , Jesse M. Zhang , David Tse

Generalization remains a challenging problem for deep reinforcement learning algorithms, which are often trained and tested on the same set of deterministic game environments. When test environments are unseen and perturbed but the nature…

Machine Learning · Computer Science 2020-07-06 Jerry Zikun Chen

A hallmark of intelligence is the ability to deduce general principles from examples, which are correct beyond the range of those observed. Generalized Planning deals with finding such principles for a class of planning problems, so that…

Artificial Intelligence · Computer Science 2020-05-06 Or Rivlin , Tamir Hazan , Erez Karpas