English
Related papers

Related papers: Online Curvature-Aware Replay: Leveraging $\mathbf…

200 papers

Online Continual Learning (OCL) for image classification represents a challenging subset of Continual Learning, focusing on classifying images from a stream without assuming data independence and identical distribution (i.i.d). The primary…

Machine Learning · Computer Science 2026-03-24 Joe Khawand , David Colliaux

Graph continual learning (GCL) aims to learn from a continuous sequence of graph-based tasks. Regularization methods are vital for preventing catastrophic forgetting in GCL, particularly in the challenging replay-free, class-incremental…

Machine Learning · Computer Science 2025-09-17 Jie Yin , Ke Sun , Han Wu

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Given a stream of data sampled from non-stationary distributions, online continual learning (OCL) aims to adapt efficiently to new data while retaining existing knowledge. The typical approach to address information retention (the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zhipeng Cai , Vladlen Koltun , Ozan Sener

Online continual learning (OCL) aims to train neural networks incrementally from a non-stationary data stream with a single pass through data. Rehearsal-based methods attempt to approximate the observed input distributions over time with a…

Machine Learning · Computer Science 2022-11-15 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet , Nick Jin Sean Lim , Yunzhe Jia

In Online Continual Learning (OCL) a learning system receives a stream of data and sequentially performs prediction and training steps. Important challenges in OCL are concerned with automatic adaptation to the particular non-stationary…

Machine Learning · Computer Science 2024-11-11 Michalis K. Titsias , Alexandre Galashov , Amal Rannen-Triki , Razvan Pascanu , Yee Whye Teh , Jorg Bornschein

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Online continual learning (OCL) seeks to learn new tasks from data streams that appear only once, while retaining knowledge of previously learned tasks. Most existing methods rely on replay, focusing on enhancing memory retention through…

Machine Learning · Computer Science 2024-12-25 Sihao Liu , Yibo Yang , Xiaojie Li , David A. Clifton , Bernard Ghanem

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

Online continual learning (OCL) enables real-time adaptation to new data, making it crucial for dynamic robotic applications. However, its practical deployment is hindered by memory constraints in resource-limited systems, which affect key…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Zexin Li , Nikil Dutt , Cong Liu

Continual Learning (CL) aims to incrementally acquire new knowledge while mitigating catastrophic forgetting. Within this setting, Online Continual Learning (OCL) focuses on updating models promptly and incrementally from single or small…

Machine Learning · Computer Science 2025-12-19 Giovanni Donghi , Luca Pasa , Daniele Zambon , Cesare Alippi , Nicolò Navarin

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

Online continual learning (OCL) methods adapt to changing environments without forgetting past knowledge. Similarly, online time series forecasting (OTSF) is a real-world problem where data evolve in time and success depends on both rapid…

Machine Learning · Computer Science 2026-01-21 Edoardo Urettini , Daniele Atzeni , Ioanna-Yvonni Tsaknaki , Antonio Carta

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline tasks likely leads to the catastrophic forgetting issue under…

Machine Learning · Computer Science 2024-04-23 Sibo Gai , Donglin Wang , Li He

In the realm of high-frequency data streams, achieving real-time learning within varying memory constraints is paramount. This paper presents Ferret, a comprehensive framework designed to enhance online accuracy of Online Continual Learning…

Machine Learning · Computer Science 2025-03-18 Yuhao Zhou , Yuxin Tian , Jindi Lv , Mingjia Shi , Yuanxi Li , Qing Ye , Shuhao Zhang , Jiancheng Lv

This paper proposes an Online Control-Informed Learning (OCIL) framework, which employs the well-established optimal control and state estimation techniques in the field of control to solve a broad class of learning tasks in an online…

Optimization and Control · Mathematics 2025-03-12 Zihao Liang , Tianyu Zhou , Zehui Lu , Shaoshuai Mou

Online Continual Learning (OCL) addresses the problem of training neural networks on a continuous data stream where multiple classification tasks emerge in sequence. In contrast to offline Continual Learning, data can be seen only once in…

Machine Learning · Computer Science 2024-06-06 Nicolas Michel , Maorong Wang , Ling Xiao , Toshihiko Yamasaki

Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facilitating the transfer of knowledge to both previous tasks…

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua
‹ Prev 1 2 3 10 Next ›