中文
相关论文

相关论文: GCR: Gradient Coreset Based Replay Buffer Selectio…

200 篇论文

Continual learning (CL) refers to the ability to continually learn over time by accommodating new knowledge while retaining previously learned experience. While this concept is inherent in human learning, current machine learning methods…

机器学习 · 计算机科学 2024-08-15 Anna Vettoruzzo , Joaquin Vanschoren , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

We tackle the problem of class incremental learning (CIL) in the realm of landcover classification from optical remote sensing (RS) images in this paper. The paradigm of CIL has recently gained much prominence given the fact that data are…

计算机视觉与模式识别 · 计算机科学 2023-09-06 S Divakar Bhat , Biplab Banerjee , Subhasis Chaudhuri , Avik Bhattacharya

By learning a sequence of tasks continually, an agent in continual learning (CL) can improve the learning performance of both a new task and `old' tasks by leveraging the forward knowledge transfer and the backward knowledge transfer,…

机器学习 · 计算机科学 2022-11-03 Sen Lin , Li Yang , Deliang Fan , Junshan Zhang

Training deep neural networks at the edge on light computational devices, embedded systems and robotic platforms is nowadays very challenging. Continual learning techniques, where complex models are incrementally trained on small batches of…

机器学习 · 计算机科学 2020-03-05 Lorenzo Pellegrini , Gabriele Graffieti , Vincenzo Lomonaco , Davide Maltoni

Recent Continual Learning (CL)-based Temporal Knowledge Graph Reasoning (TKGR) methods focus on significantly reducing computational cost and mitigating catastrophic forgetting caused by fine-tuning models with new data. However, existing…

信息检索 · 计算机科学 2025-06-05 Zhiyu Zhang , Wei Chen , Youfang Lin , Huaiyu Wan

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Continual Learning (CL) focuses on maximizing the predictive performance of a model across a non-stationary stream of data. Unfortunately, CL models tend to forget previous knowledge, thus often underperforming when compared with an offline…

机器学习 · 计算机科学 2024-04-15 Lanpei Li , Elia Piccoli , Andrea Cossu , Davide Bacciu , Vincenzo Lomonaco

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

机器学习 · 计算机科学 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

Recent advancements in data-driven task-oriented dialogue systems (ToDs) struggle with incremental learning due to computational constraints and time-consuming issues. Continual Learning (CL) attempts to solve this by avoiding intensive…

计算与语言 · 计算机科学 2023-09-14 Min Zeng , Wei Xue , Qifeng Liu , Yike Guo

Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on…

机器学习 · 计算机科学 2022-03-16 Samuel Kessler , Jack Parker-Holder , Philip Ball , Stefan Zohren , Stephen J. Roberts

Deep clustering as an important branch of unsupervised representation learning focuses on embedding semantically similar samples into the identical feature space. This core demand inspires the exploration of contrastive learning and…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Haifeng Xia , Hai Huang , Zhengming Ding

We introduce Continual Learning via Neural Pruning (CLNP), a new method aimed at lifelong learning in fixed capacity models based on neuronal model sparsification. In this method, subsequent tasks are trained using the inactive neurons and…

机器学习 · 计算机科学 2019-03-12 Siavash Golkar , Michael Kagan , Kyunghyun Cho

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

机器学习 · 计算机科学 2024-12-25 Shugang Hao , Lingjie Duan

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is…

系统与控制 · 电气工程与系统科学 2024-01-30 Xiangyu Zhang , Abinet Tesfaye Eseye , Bernard Knueven , Weijia Liu , Matthew Reynolds , Wesley Jones

Continual Learning (CL) aims to learn from a non-stationary data stream where the underlying distribution changes over time. While recent advances have produced efficient memory-free methods in the offline CL (offCL) setting, where tasks…

机器学习 · 计算机科学 2025-06-10 Nicolas Michel , Maorong Wang , Jiangpeng He , Toshihiko Yamasaki

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Continual learning, one's ability to adapt to a sequence of tasks without forgetting previously acquired knowledge, remains a major challenge in machine learning and a key gap between artificial and human intelligence. While regularisation…

机器学习 · 计算机科学 2025-12-01 Hugo Hazard , Zafeirios Fountas , Martin A. Benfeghoul , Adnan Oomerjee , Jun Wang , Haitham Bou-Ammar

Replay strategies are Continual Learning techniques which mitigate catastrophic forgetting by keeping a buffer of patterns from previous experiences, which are interleaved with new data during training. The amount of patterns stored in the…

机器学习 · 计算机科学 2021-06-23 Andrea Rosasco , Antonio Carta , Andrea Cossu , Vincenzo Lomonaco , Davide Bacciu

With the explosion of digital data in recent years, continuously learning new tasks from a stream of data without forgetting previously acquired knowledge has become increasingly important. In this paper, we propose a new continual learning…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Bo Zhao , Shixiang Tang , Dapeng Chen , Hakan Bilen , Rui Zhao

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, and exploit knowledge throughout its lifetime. This ability, known as Continual learning, provides a foundation for AI systems to develop…

机器学习 · 计算机科学 2025-12-19 Hesham G. Moussa , Aroosa Hameed , Arashmid Akhavain