English
Related papers

Related papers: Distribution-Level Memory Recall for Continual Lea…

200 papers

Large Language Models (LLMs) possess encompassing capabilities that can process diverse language-related tasks. However, finetuning on LLMs will diminish this general skills and continual finetuning will further cause severe degradation on…

Machine Learning · Computer Science 2025-07-09 Kai Tong , Kang Pan , Xiao Zhang , Erli Meng , Run He , Yawen Cui , Nuoyan Guo , Huiping Zhuang

In object re-identification (ReID), the development of deep learning techniques often involves model updates and deployment. It is unbearable to re-embedding and re-index with the system suspended when deploying new models. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Shengsen Wu , Liang Chen , Yihang Lou , Yan Bai , Tao Bai , Minghua Deng , Lingyu Duan

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy between conditional distributions by drawing support from nonlinear kernel functions, thus it has been successfully used for pattern classification. However, CMMD does…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Chuan-Xian Ren , Pengfei Ge , Dao-Qing Dai , Hong Yan

Humans are capable of learning new tasks without forgetting previous ones, while neural networks fail due to catastrophic forgetting between new and previously-learned tasks. We consider a class-incremental setting which means that the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Xialei Liu , Chenshen Wu , Mikel Menta , Luis Herranz , Bogdan Raducanu , Andrew D. Bagdanov , Shangling Jui , Joost van de Weijer

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

We propose Deep Companion Learning (DCL), a novel training method for Deep Neural Networks (DNNs) that enhances generalization by penalizing inconsistent model predictions compared to its historical performance. To achieve this, we train a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Ruizhao Zhu , Venkatesh Saligrama

Multi-instance learning (MIL) is a widely-applied technique in practical applications that involve complex data structures. MIL can be broadly categorized into two types: traditional methods and those based on deep learning. These…

Artificial Intelligence · Computer Science 2023-04-25 Yu-Xuan Zhang , Zhengchun Zhou , Xingxing He , Avik Ranjan Adhikary , Bapi Dutta

Dual-to-Dual MLLMs refer to Multimodal Large Language Models, which can enable unified multimodal comprehension and generation through text and image modalities. Although exhibiting strong instantaneous learning and generalization…

Machine Learning · Computer Science 2026-02-23 Jingyang Qiao , Zhizhong Zhang , Xin Tan , Jingyu Gong , Yanyun Qu , Yuan Xie

Neuromorphic Continual Learning (NCL) paradigm leverages Spiking Neural Networks (SNNs) to enable continual learning (CL) capabilities for AI systems to adapt to dynamically changing environments. Currently, the state-of-the-art employ a…

Neural and Evolutionary Computing · Computer Science 2025-10-30 Mishal Fatima Minhas , Rachmad Vidya Wicaksana Putra , Falah Awwad , Osman Hasan , Muhammad Shafique

Continual learning (CL) refers to the ability to continuously learn and accumulate new knowledge while retaining useful information from past experiences. Although numerous CL methods have been proposed in recent years, it is not…

Machine Learning · Statistics 2025-03-27 Hanwen Xing , Christopher Yau

Custom Diffusion Models (CDMs) have gained significant attention due to their remarkable ability to personalize generative processes. However, existing CDMs suffer from catastrophic forgetting when continuously learning new concepts. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Arjun Ramesh Kaushik , Naresh Kumar Devulapally , Vishnu Suresh Lokhande , Nalini Ratha , Venu Govindaraju

Continual Learning (CL) focuses on learning from dynamic and changing data distributions while retaining previously acquired knowledge. Various methods have been developed to address the challenge of catastrophic forgetting, including…

Machine Learning · Computer Science 2024-03-21 Zhenyi Wang , Yan Li , Li Shen , Heng Huang

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

Label Distribution Learning (LDL) is a novel machine learning paradigm that addresses the problem of label ambiguity and has found widespread applications. Obtaining complete label distributions in real-world scenarios is challenging, which…

Machine Learning · Computer Science 2024-10-18 Zhiqiang Kou , Haoyuan Xuan , Jing Wang , Yuheng Jia , Xin Geng

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

Machine Learning · Computer Science 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiuwei Chen , Xiaobin Chang

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

Multimodal learning aims to capture both shared and private information from multiple modalities. However, existing methods that project all modalities into a single latent space for fusion often overlook the asynchronous, multi-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chunlei Meng , Guanhong Huang , Rong Fu , Runmin Jian , Zhongxue Gan , Chun Ouyang

Subspace clustering is a classical technique that has been widely used for human motion segmentation and other related tasks. However, existing segmentation methods often cluster data without guidance from prior knowledge, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Tao Zhou , Huazhu Fu , Chen Gong , Ling Shao , Fatih Porikli , Haibin Ling , Jianbing Shen