中文
相关论文

相关论文: Policy Consolidation for Continual Reinforcement L…

200 篇论文

Fictitious play with reinforcement learning is a general and effective framework for zero-sum games. However, using the current deep neural network models, the implementation of fictitious play faces crucial challenges. Neural network model…

机器学习 · 计算机科学 2019-12-02 Rong-Jun Qin , Jing-Cheng Pang , Yang Yu

We focus on the problem of teaching a robot to solve tasks presented sequentially, i.e., in a continual learning scenario. The robot should be able to solve all tasks it has encountered, without forgetting past tasks. We provide preliminary…

Deep reinforcement learning algorithms can learn complex behavioral skills, but real-world application of these methods requires a large amount of experience to be collected by the agent. In practical settings, such as robotics, this…

机器学习 · 计算机科学 2017-11-21 Benjamin Eysenbach , Shixiang Gu , Julian Ibarz , Sergey Levine

Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent remarkable progress in state-of-the-art deep learning, deep…

机器学习 · 计算机科学 2019-05-22 Xilai Li , Yingbo Zhou , Tianfu Wu , Richard Socher , Caiming Xiong

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

Catastrophic forgetting and capacity saturation are the central challenges of any parametric lifelong learning system. In this work, we study these challenges in the context of sequential supervised learning with an emphasis on recurrent…

机器学习 · 计算机科学 2019-09-10 Shagun Sodhani , Sarath Chandar , Yoshua Bengio

Catastrophic forgetting in deep neural networks occurs when learning new tasks degrades performance on previously learned tasks due to knowledge overwriting. Among the approaches to mitigate this issue, regularization techniques aim to…

机器学习 · 计算机科学 2025-07-14 Idan Mashiach , Oren Glickman , Tom Tirer

Human being and different species of animals having the skills to gather, transferring knowledge, processing, fine-tune and generating information throughout their lifetime. The ability of learning throughout their lifespan is referred as…

机器学习 · 计算机科学 2024-05-15 Ashutosh Kumar , Sonali Agarwal , D Jude Hemanth

Humans can continuously learn new knowledge as their experience grows. In contrast, previous learning in deep neural networks can quickly fade out when they are trained on a new task. In this paper, we hypothesize this problem can be…

机器学习 · 计算机科学 2020-03-27 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

We introduce a novel continual learning method based on multifidelity deep neural networks. This method learns the correlation between the output of previously trained models and the desired output of the model on the current training…

数值分析 · 数学 2024-07-01 Amanda Howard , Yucheng Fu , Panos Stinis

The effects of policy sharing between agents in a multi-agent dynamical system has not been studied extensively. I simulate a system of agents optimizing the same task using reinforcement learning, to study the effects of different…

多智能体系统 · 计算机科学 2008-12-10 Jake Ellowitz

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

机器学习 · 计算机科学 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

TPC (Three-Phase Consolidation) is here introduced as a simple but effective approach to continually learn new classes (and/or instances of known classes) while controlling forgetting of previous knowledge. Each experience (a.k.a. task) is…

机器学习 · 计算机科学 2024-03-25 Davide Maltoni , Lorenzo Pellegrini

Humans accumulate knowledge in a lifelong fashion. Modern deep neural networks, on the other hand, are susceptible to catastrophic forgetting: when adapted to perform new tasks, they often fail to preserve their performance on previously…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Mengyao Zhai , Lei Chen , Jiawei He , Megha Nawhal , Frederick Tung , Greg Mori

This paper aims to establish an entropy-regularized value-based reinforcement learning method that can ensure the monotonic improvement of policies at each policy update. Unlike previously proposed lower-bounds on policy improvement in…

机器学习 · 计算机科学 2020-08-26 Lingwei Zhu , Takamitsu Matsubara

Catastrophic forgetting of previously learned knowledge while learning new tasks is a widely observed limitation of contemporary neural networks. Although many continual learning methods are proposed to mitigate this drawback, the main…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Wojciech Masarczyk , Kamil Deja , Tomasz Trzciński

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address…

机器学习 · 计算机科学 2023-10-24 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Continuously learning to solve unseen tasks with limited experience has been extensively pursued in meta-learning and continual learning, but with restricted assumptions such as accessible task distributions, independently and identically…

机器学习 · 计算机科学 2020-12-01 Mengdi Xu , Wenhao Ding , Jiacheng Zhu , Zuxin Liu , Baiming Chen , Ding Zhao

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Data-driven modeling in mechanics is evolving rapidly based on recent machine learning advances, especially on artificial neural networks. As the field matures, new data and models created by different groups become available, opening…

数值分析 · 数学 2024-03-11 Aleksandr Dekhovich , O. Taylan Turan , Jiaxiang Yi , Miguel A. Bessa