中文
相关论文

相关论文: Rehearsal-free and Task-free Online Continual Lear…

200 篇论文

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

计算机视觉与模式识别 · 计算机科学 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

机器学习 · 计算机科学 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

Catastrophic forgetting is a significant challenge in online continual learning (OCL), especially for non-stationary data streams that do not have well-defined task boundaries. This challenge is exacerbated by the memory constraints and…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Xiwen Wei , Guihong Li , Radu Marculescu

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

计算与语言 · 计算机科学 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

机器学习 · 计算机科学 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

机器学习 · 计算机科学 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

机器学习 · 计算机科学 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang

The data privacy constraint in online continual learning (OCL), where the data can be seen only once, complicates the catastrophic forgetting problem in streaming data. A common approach applied by the current SOTAs in OCL is with the use…

Online continual learning requires the models to learn from constant, endless streams of data. While significant efforts have been made in this field, most were focused on mitigating the catastrophic forgetting issue to achieve better…

机器学习 · 计算机科学 2024-10-14 Xinrui Wang , Chuanxing Geng , Wenhai Wan , Shao-yuan Li , Songcan Chen

Online continual learning (OCL) involves deep neural networks retaining knowledge from old data while adapting to new data, which is accessible only once. A critical challenge in OCL is catastrophic forgetting, reflected in reduced model…

机器学习 · 计算机科学 2024-07-18 Huiwei Lin

A dataset is a shred of crucial evidence to describe a task. However, each data point in the dataset does not have the same potential, as some of the data points can be more representative or informative than others. This unequal importance…

机器学习 · 计算机科学 2022-03-21 Jaehong Yoon , Divyam Madaan , Eunho Yang , Sung Ju Hwang

Learning from non-stationary data streams, also called Task-Free Continual Learning (TFCL) remains challenging due to the absence of explicit task information. Although recently some methods have been proposed for TFCL, they lack…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Fei Ye , Adrian G. Bors

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

机器学习 · 计算机科学 2022-06-09 Benedikt Bagus , Alexander Gepperth

Continual learning (CL) refers to a machine learning paradigm that learns continuously without forgetting previously acquired knowledge. Thereby, major difficulty in CL is catastrophic forgetting of preceding tasks, caused by shifts in data…

机器学习 · 计算机科学 2023-03-08 Stella Ho , Ming Liu , Lan Du , Longxiang Gao , Yong Xiang

Online continual learning (CL) studies the problem of learning continuously from a single-pass data stream while adapting to new data and mitigating catastrophic forgetting. Recently, by storing a small subset of old data, replay-based…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Yujie Wei , Jiaxin Ye , Zhizhong Huang , Junping Zhang , Hongming Shan

Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on…

机器学习 · 计算机科学 2022-03-16 Samuel Kessler , Jack Parker-Holder , Philip Ball , Stefan Zohren , Stephen J. Roberts

Continual Learning (CL) algorithms incrementally learn a predictor or representation across multiple sequentially observed tasks. Designing CL algorithms that perform reliably and avoid so-called catastrophic forgetting has proven a…

机器学习 · 计算机科学 2020-06-11 Jeremias Knoblauch , Hisham Husain , Tom Diethe

Federated continual learning (FCL) learns incremental tasks over time from confidential datasets distributed across clients. This paper focuses on rehearsal-free FCL, which has severe forgetting issues when learning new tasks due to the…

机器学习 · 计算机科学 2023-09-07 Gaurav Bagwe , Xiaoyong Yuan , Miao Pan , Lan Zhang
‹ 上一页 1 2 3 10 下一页 ›