English
Related papers

Related papers: Reinforced Continual Learning

200 papers

Neural networks can achieve excellent results in a wide variety of applications. However, when they attempt to sequentially learn, they tend to learn the new task while catastrophically forgetting previous ones. We propose a model that…

Machine Learning · Computer Science 2020-12-18 Craig Atkinson , Brendan McCane , Lech Szymanski , Anthony Robins

On the one hand, there has been considerable progress on neural network verification in recent years, which makes certifying neural networks a possibility. On the other hand, neural networks in practice are often re-trained over time to…

Machine Learning · Computer Science 2024-07-10 Long H. Pham , Jun Sun

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning. In recent years, numerous methods have been proposed for continual…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

Unlike humans, who are capable of continual learning over their lifetimes, artificial neural networks have long been known to suffer from a phenomenon known as catastrophic forgetting, whereby new learning can lead to abrupt erasure of…

Artificial Intelligence · Computer Science 2018-06-20 Christos Kaplanis , Murray Shanahan , Claudia Clopath

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

We introduce a novel continual learning method based on multifidelity deep neural networks. This method learns the correlation between the output of previously trained models and the desired output of the model on the current training…

Numerical Analysis · Mathematics 2024-07-01 Amanda Howard , Yucheng Fu , Panos Stinis

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Catastrophic forgetting is a significant challenge in the field of machine learning, particularly in neural networks. When a neural network learns to perform well on a new task, it often forgets its previously acquired knowledge or…

Machine Learning · Computer Science 2023-12-04 Nuri Korhan , Ceren Öner

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

Machine Learning · Computer Science 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

Machine Learning · Computer Science 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Continual learning (CL) refers to the ability to continually learn over time by accommodating new knowledge while retaining previously learned experience. While this concept is inherent in human learning, current machine learning methods…

Machine Learning · Computer Science 2024-08-15 Anna Vettoruzzo , Joaquin Vanschoren , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Artificial neural networks encounter a notable challenge known as continual learning, which involves acquiring knowledge of multiple tasks over an extended period. This challenge arises due to the tendency of previously learned weights to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yonatan Sverdlov , Shimon Ullman

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

Machine Learning · Computer Science 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

In recent years, model-free methods that use deep learning have achieved great success in many different reinforcement learning environments. Most successful approaches focus on solving a single task, while multi-task reinforcement learning…

Machine Learning · Computer Science 2017-05-25 Asier Mujika

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

Machine Learning · Computer Science 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

Task incremental learning aims to enable a system to maintain its performance on previously learned tasks while learning new tasks, solving the problem of catastrophic forgetting. One promising approach is to build an individual network or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jian Jiang , Oya Celiktutan

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

Machine Learning · Computer Science 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao