English
Related papers

Related papers: Preserving Linear Separability in Continual Learni…

200 papers

An important aspect of deploying face recognition (FR) algorithms in real-world applications is their ability to learn new face identities from a continuous data stream. However, the online training of existing deep neural network-based FR…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Md Mahedi Hasan , Shoaib Meraj Sami , Nasser Nasrabadi

Federated Learning, a new machine learning paradigm enhancing the use of edge devices, is receiving a lot of attention in the pervasive community to support the development of smart services. Nevertheless, this approach still needs to be…

Artificial Intelligence · Computer Science 2021-09-10 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Replay strategies are Continual Learning techniques which mitigate catastrophic forgetting by keeping a buffer of patterns from previous experiences, which are interleaved with new data during training. The amount of patterns stored in the…

Machine Learning · Computer Science 2021-06-23 Andrea Rosasco , Antonio Carta , Andrea Cossu , Vincenzo Lomonaco , Davide Bacciu

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Occluded person re-identification aims to retrieve holistic images based on occluded ones. Existing methods often rely on aligning visible body parts, applying occlusion augmentation, or complementing missing semantics using holistic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yufei Zheng , Wenjun Wang , Wenjun Gan , Jiawei Liu

A fundamental and challenging problem in deep learning is catastrophic forgetting, i.e. the tendency of neural networks to fail to preserve the knowledge acquired from old tasks when learning new tasks. This problem has been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Moin Nabi , Xavier Alameda-Pineda , Elisa Ricci

Neural networks are prone to catastrophic forgetting when trained incrementally on different tasks. Popular incremental learning methods mitigate such forgetting by retaining a subset of previously seen samples and replaying them during the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Kevin Thandiackal , Tiziano Portenier , Andrea Giovannini , Maria Gabrani , Orcun Goksel

Continual learning methods are known to suffer from catastrophic forgetting, a phenomenon that is particularly hard to counter for methods that do not store exemplars of previous tasks. Therefore, to reduce potential drift in the feature…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Dipam Goswami , Albin Soutif--Cormerais , Yuyang Liu , Sandesh Kamath , Bartłomiej Twardowski , Joost van de Weijer

Deep neural networks (DNNs) have recently achieved a great success in computer vision and several related fields. Despite such progress, current neural architectures still suffer from catastrophic interference (a.k.a. forgetting) which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Hichem Sahbi , Haoming Zhan

LiDAR place recognition plays a crucial role in SLAM, robot navigation, and autonomous driving. However, existing LiDAR place recognition methods often struggle to adapt to new environments without forgetting previously learned knowledge, a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Xufei Wang , Junqiao Zhao , Siyue Tao , Qiwen Gu , Wonbong Kim , Tiantian Feng

To address the problem of catastrophic forgetting due to the invisibility of old categories in sequential input, existing work based on relatively simple categorization tasks has made some progress. In contrast, video captioning is a more…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Huiyu Xiong , Lanxiao Wang , Heqian Qiu , Taijin Zhao , Benliu Qiu , Hongliang Li

Recent preference learning frameworks for large language models (LLMs) simplify human preferences with binary pairwise comparisons and scalar rewards. This simplification could make LLMs' responses biased to mostly preferred features, and…

Machine Learning · Computer Science 2025-06-16 Dongyoung Kim , Jinsung Yoon , Jinwoo Shin , Jaehyung Kim

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Neural fields are increasingly used as a light-weight, continuous, and differentiable signal representation in (bio)medical imaging. However, unlike discrete signal representations such as voxel grids, neural fields cannot be easily…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Wouter Visser , Jelmer M. Wolterink

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

Machine Learning · Computer Science 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge

Unsupervised Continual Learning (UCL) is a burgeoning field in machine learning, focusing on enabling neural networks to sequentially learn tasks without explicit label information. Catastrophic Forgetting (CF), where models forget…

Machine Learning · Computer Science 2024-05-30 Mohammadreza Sadeghi , Zihan Wang , Narges Armanfard

The ability of machine learning systems to learn continually is hindered by catastrophic forgetting, the tendency of neural networks to overwrite previously acquired knowledge when learning a new task. Existing methods mitigate this problem…