English
Related papers

Related papers: Improving information retention in large scale onl…

200 papers

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

Online Continual Learning (OCL) models continuously adapt to nonstationary data streams, usually without task information. These settings are complex and many traditional CL methods fail, while online methods (mainly replay-based) suffer…

Machine Learning · Computer Science 2025-02-05 Edoardo Urettini , Antonio Carta

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

Machine Learning · Computer Science 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

A continual learning agent should be able to build on top of existing knowledge to learn on new data quickly while minimizing forgetting. Current intelligent systems based on neural network function approximators arguably do the…

Machine Learning · Computer Science 2019-11-01 Khurram Javed , Martha White

Continual Learning (CL) aims to incrementally acquire new knowledge while mitigating catastrophic forgetting. Within this setting, Online Continual Learning (OCL) focuses on updating models promptly and incrementally from single or small…

Machine Learning · Computer Science 2025-12-19 Giovanni Donghi , Luca Pasa , Daniele Zambon , Cesare Alippi , Nicolò Navarin

In Online Continual Learning (OCL), a neural network sequentially learns from a non-stationary data stream in a single-pass with access only to a limited memory replay buffer. This contrasts sharply with off-line continual learning where…

Machine Learning · Computer Science 2026-05-20 Ankita Awasthi , Marco Apolinario , Kaushik Roy

Online continual learning, especially when task identities and task boundaries are unavailable, is a challenging continual learning setting. One representative kind of methods for online continual learning is replay-based methods, in which…

Machine Learning · Computer Science 2022-09-26 Yan-Shuo Liang , Wu-Jun Li

Online Continual Learning (OCL) for image classification represents a challenging subset of Continual Learning, focusing on classifying images from a stream without assuming data independence and identical distribution (i.i.d). The primary…

Machine Learning · Computer Science 2026-03-24 Joe Khawand , David Colliaux

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

Machine Learning · Computer Science 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continual learning, the…

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

Machine Learning · Computer Science 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

Online continual learning (OCL) seeks to learn new tasks from data streams that appear only once, while retaining knowledge of previously learned tasks. Most existing methods rely on replay, focusing on enhancing memory retention through…

Machine Learning · Computer Science 2024-12-25 Sihao Liu , Yibo Yang , Xiaojie Li , David A. Clifton , Bernard Ghanem

Online Continual Learning (OCL) addresses the problem of training neural networks on a continuous data stream where multiple classification tasks emerge in sequence. In contrast to offline Continual Learning, data can be seen only once in…

Machine Learning · Computer Science 2024-06-06 Nicolas Michel , Maorong Wang , Ling Xiao , Toshihiko Yamasaki

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

Machine Learning · Computer Science 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye

Online continual learning (OCL) aims to train neural networks incrementally from a non-stationary data stream with a single pass through data. Rehearsal-based methods attempt to approximate the observed input distributions over time with a…

Machine Learning · Computer Science 2022-11-15 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet , Nick Jin Sean Lim , Yunzhe Jia
‹ Prev 1 2 3 10 Next ›