English
Related papers

Related papers: Pseudorehearsal in actor-critic agents with neural…

200 papers

In this paper, we consider the problem of actor-critic reinforcement learning. Firstly, we extend the actor-critic architecture to actor-critic-N architecture by introducing more critics beyond rewards. Secondly, we combine the reward-based…

Machine Learning · Computer Science 2020-06-15 Weiya Ren

Memory replay may be key to learning in biological brains, which manage to learn new tasks continually without catastrophically interfering with previous knowledge. On the other hand, artificial neural networks suffer from catastrophic…

Machine Learning · Computer Science 2022-01-06 Haitz Sáez de Ocáriz Borde

Inspired by recent work in attention models for image captioning and question answering, we present a soft attention model for the reinforcement learning domain. This model uses a soft, top-down attention mechanism to create a bottleneck in…

Machine Learning · Computer Science 2019-06-07 Alex Mott , Daniel Zoran , Mike Chrzanowski , Daan Wierstra , Danilo J. Rezende

Reinforcement learning (RL) actor-critic algorithms enable autonomous learning but often require a large number of environment interactions, which limits their applicability in robotics. Leveraging expert data can reduce the number of…

Machine Learning · Computer Science 2026-03-02 Andreas Kernbach , Amr Elsheikh , Nicolas Grupp , René Nagel , Marco F. Huber

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

Artificial Intelligence · Computer Science 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan

Data rehearsal has emerged as a leading approach for mitigating catastrophic forgetting in Continual Reinforcement Learning (CRL). However, existing work remains confined to policy gradient frameworks, regularizing only actors due to the…

Machine Learning · Computer Science 2026-05-22 Benjamin Poole , Andrew Quinn , Li Yang , Minwoo Lee

Deep reinforcement learning has learned to play many games well, but failed on others. To better characterize the modes and reasons of failure of deep reinforcement learners, we test the widely used Asynchronous Actor-Critic (A2C) algorithm…

Machine Learning · Computer Science 2019-08-14 Philip Bontrager , Ahmed Khalifa , Damien Anderson , Matthew Stephenson , Christoph Salge , Julian Togelius

Centralized Training for Decentralized Execution, where agents are trained offline using centralized information but execute in a decentralized manner online, has gained popularity in the multi-agent reinforcement learning community. In…

Machine Learning · Computer Science 2021-12-06 Xueguang Lyu , Yuchen Xiao , Brett Daley , Christopher Amato

In recent years, peer learning has gained attention as a method that promotes spontaneous thinking among learners, and its effectiveness has been confirmed by numerous studies. This study aims to develop an AI Agent as a learning companion…

Artificial Intelligence · Computer Science 2025-07-18 Sosui Moribe , Taketoshi Ushiama

The adaptive learning capabilities seen in biological neural networks are largely a product of the self-modifying behavior emerging from online plastic changes in synaptic connectivity. Current methods in Reinforcement Learning (RL) only…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Samuel Schmidgall

Catastrophic forgetting has remained a significant challenge for efficient reinforcement learning for decades (Ring 1994, Rivest and Precup 2003). While recent works have proposed effective methods to mitigate this issue, they mainly focus…

Machine Learning · Computer Science 2025-09-24 Qingfeng Lan , Gautham Vasan , A. Rupam Mahmood

Simulation to Real-World Transfer allows affordable and fast training of learning-based robots for manipulation tasks using Deep Reinforcement Learning methods. Currently, Sim2Real uses Asymmetric Actor-Critic approaches to reduce the rich…

Robotics · Computer Science 2024-10-17 Lingfeng Tao , Jiucai Zhang , Qiaojie Zheng , Xiaoli Zhang

Continual learning faces a crucial challenge of catastrophic forgetting. To address this challenge, experience replay (ER) that maintains a tiny subset of samples from previous tasks has been commonly used. Existing ER works usually focus…

Machine Learning · Computer Science 2022-10-18 Yejia Liu , Wang Zhu , Shaolei Ren

Optimization of parameterized policies for reinforcement learning (RL) is an important and challenging problem in artificial intelligence. Among the most common approaches are algorithms based on gradient ascent of a score function…

Machine Learning · Computer Science 2020-06-15 Sriram Srinivasan , Marc Lanctot , Vinicius Zambaldi , Julien Perolat , Karl Tuyls , Remi Munos , Michael Bowling

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Reinforcement learning algorithms are known to be sample inefficient, and often performance on one task can be substantially improved by leveraging information (e.g., via pre-training) on other related tasks. In this work, we propose a…

Machine Learning · Computer Science 2019-10-15 Jonathan Lebensold , William Hamilton , Borja Balle , Doina Precup

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

Machine Learning · Computer Science 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

Nowadays, model-free reinforcement learning algorithms have achieved remarkable performance on many decision making and control tasks, but high sample complexity and low sample efficiency still hinder the wide use of model-free…

Artificial Intelligence · Computer Science 2020-10-27 Jingbin Liu , Xinyang Gu , Shuai Liu

Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task…

Machine Learning · Computer Science 2018-06-13 Elliot Meyerson , Risto Miikkulainen

This paper considers cooperative Multi-Agent Reinforcement Learning, focusing on emergent communication in settings where multiple pairs of independent learners interact at varying frequencies. In this context, multiple distinct and…

Artificial Intelligence · Computer Science 2021-11-23 J. D. Thomas , R. Santos-Rodríguez , R. Piechocki , M. Anca