English
Related papers

Related papers: Rethinking Continual Learning for Autonomous Agent…

200 papers

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

Machine Learning · Computer Science 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once. The evolution of…

Machine Learning · Computer Science 2019-11-25 Timothée Lesort , Vincenzo Lomonaco , Andrei Stoian , Davide Maltoni , David Filliat , Natalia Díaz-Rodríguez

This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data. Although continual learning is a natural skill for the human brain, it is very…

Machine Learning · Computer Science 2025-09-11 Gido M. van de Ven , Nicholas Soures , Dhireesha Kudithipudi

An agent that efficiently accumulates knowledge to develop increasingly sophisticated skills over a long lifetime could advance the frontier of artificial intelligence capabilities. The design of such agents, which remains a long-standing…

Machine Learning · Computer Science 2025-06-27 Saurabh Kumar , Henrik Marklund , Ashish Rao , Yifan Zhu , Hong Jun Jeon , Yueyang Liu , Benjamin Van Roy

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that…

Machine Learning · Computer Science 2019-02-12 German I. Parisi , Ronald Kemker , Jose L. Part , Christopher Kanan , Stefan Wermter

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions. The purpose of this study is to review the state-of-the-art methods that allow…

Machine Learning · Computer Science 2022-02-28 Khadija Shaheen , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Humans' continual learning (CL) ability is closely related to Stability Versus Plasticity Dilemma that describes how humans achieve ongoing learning capacity and preservation for learned information. The notion of CL has always been present…

Machine Learning · Computer Science 2021-11-24 Yifan Chang , Wenbo Li , Jian Peng , Bo Tang , Yu Kang , Yinjie Lei , Yuanmiao Gui , Qing Zhu , Yu Liu , Haifeng Li

In a standard view of the reinforcement learning problem, an agent's goal is to efficiently identify a policy that maximizes long-term reward. However, this perspective is based on a restricted view of learning as finding a solution, rather…

Machine Learning · Computer Science 2023-12-04 David Abel , André Barreto , Benjamin Van Roy , Doina Precup , Hado van Hasselt , Satinder Singh

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

The goal of continual learning is to find a model that solves multiple learning tasks which are presented sequentially to the learner. A key challenge in this setting is that the learner may forget how to solve a previous task when learning…

Machine Learning · Computer Science 2023-06-09 Liangzu Peng , Paris V. Giampouras , René Vidal

Unlike humans, who are capable of continual learning over their lifetimes, artificial neural networks have long been known to suffer from a phenomenon known as catastrophic forgetting, whereby new learning can lead to abrupt erasure of…

Artificial Intelligence · Computer Science 2018-06-20 Christos Kaplanis , Murray Shanahan , Claudia Clopath

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Continual lifelong learning requires an agent or model to learn many sequentially ordered tasks, building on previous knowledge without catastrophically forgetting it. Much work has gone towards preventing the default tendency of machine…

Machine Learning · Computer Science 2020-03-05 Shawn Beaulieu , Lapo Frati , Thomas Miconi , Joel Lehman , Kenneth O. Stanley , Jeff Clune , Nick Cheney

Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to…

Machine Learning · Computer Science 2021-10-29 Maciej Wołczyk , Michał Zając , Razvan Pascanu , Łukasz Kuciński , Piotr Miłoś

Continual learning consists of algorithms that learn from a stream of data/tasks continuously and adaptively thought time, enabling the incremental development of ever more complex knowledge and skills. The lack of consensus in evaluating…

Artificial Intelligence · Computer Science 2018-11-01 Natalia Díaz-Rodríguez , Vincenzo Lomonaco , David Filliat , Davide Maltoni

In continual learning (CL), an AI agent (e.g., autonomous vehicles or robotics) learns from non-stationary data streams under dynamic environments. For the practical deployment of such applications, it is important to guarantee robustness…

Machine Learning · Computer Science 2024-01-11 Minsu Kim , Walid Saad

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Continual learning (CL) refers to the ability to continually learn over time by accommodating new knowledge while retaining previously learned experience. While this concept is inherent in human learning, current machine learning methods…

Machine Learning · Computer Science 2024-08-15 Anna Vettoruzzo , Joaquin Vanschoren , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson
‹ Prev 1 2 3 10 Next ›