中文
相关论文

相关论文: Distribution-Level Memory Recall for Continual Lea…

200 篇论文

Large Language Models (LLMs) possess encompassing capabilities that can process diverse language-related tasks. However, finetuning on LLMs will diminish this general skills and continual finetuning will further cause severe degradation on…

机器学习 · 计算机科学 2025-07-09 Kai Tong , Kang Pan , Xiao Zhang , Erli Meng , Run He , Yawen Cui , Nuoyan Guo , Huiping Zhuang

In object re-identification (ReID), the development of deep learning techniques often involves model updates and deployment. It is unbearable to re-embedding and re-index with the system suspended when deploying new models. Therefore,…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Shengsen Wu , Liang Chen , Yihang Lou , Yan Bai , Tao Bai , Minghua Deng , Lingyu Duan

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

机器学习 · 计算机科学 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy between conditional distributions by drawing support from nonlinear kernel functions, thus it has been successfully used for pattern classification. However, CMMD does…

计算机视觉与模式识别 · 计算机科学 2020-08-25 Chuan-Xian Ren , Pengfei Ge , Dao-Qing Dai , Hong Yan

Humans are capable of learning new tasks without forgetting previous ones, while neural networks fail due to catastrophic forgetting between new and previously-learned tasks. We consider a class-incremental setting which means that the…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Xialei Liu , Chenshen Wu , Mikel Menta , Luis Herranz , Bogdan Raducanu , Andrew D. Bagdanov , Shangling Jui , Joost van de Weijer

Deep metric learning (DML) is a cornerstone of many computer vision applications. It aims at learning a mapping from the input domain to an embedding space, where semantically similar objects are located nearby and dissimilar objects far…

计算机视觉与模式识别 · 计算机科学 2021-09-10 Artsiom Sanakoyeu , Pingchuan Ma , Vadim Tschernezki , Björn Ommer

We propose Deep Companion Learning (DCL), a novel training method for Deep Neural Networks (DNNs) that enhances generalization by penalizing inconsistent model predictions compared to its historical performance. To achieve this, we train a…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Ruizhao Zhu , Venkatesh Saligrama

Multi-instance learning (MIL) is a widely-applied technique in practical applications that involve complex data structures. MIL can be broadly categorized into two types: traditional methods and those based on deep learning. These…

人工智能 · 计算机科学 2023-04-25 Yu-Xuan Zhang , Zhengchun Zhou , Xingxing He , Avik Ranjan Adhikary , Bapi Dutta

Dual-to-Dual MLLMs refer to Multimodal Large Language Models, which can enable unified multimodal comprehension and generation through text and image modalities. Although exhibiting strong instantaneous learning and generalization…

机器学习 · 计算机科学 2026-02-23 Jingyang Qiao , Zhizhong Zhang , Xin Tan , Jingyu Gong , Yanyun Qu , Yuan Xie

Neuromorphic Continual Learning (NCL) paradigm leverages Spiking Neural Networks (SNNs) to enable continual learning (CL) capabilities for AI systems to adapt to dynamically changing environments. Currently, the state-of-the-art employ a…

神经与进化计算 · 计算机科学 2025-10-30 Mishal Fatima Minhas , Rachmad Vidya Wicaksana Putra , Falah Awwad , Osman Hasan , Muhammad Shafique

Continual learning (CL) refers to the ability to continuously learn and accumulate new knowledge while retaining useful information from past experiences. Although numerous CL methods have been proposed in recent years, it is not…

机器学习 · 统计学 2025-03-27 Hanwen Xing , Christopher Yau

Custom Diffusion Models (CDMs) have gained significant attention due to their remarkable ability to personalize generative processes. However, existing CDMs suffer from catastrophic forgetting when continuously learning new concepts. Most…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Arjun Ramesh Kaushik , Naresh Kumar Devulapally , Vishnu Suresh Lokhande , Nalini Ratha , Venu Govindaraju

Continual Learning (CL) focuses on learning from dynamic and changing data distributions while retaining previously acquired knowledge. Various methods have been developed to address the challenge of catastrophic forgetting, including…

机器学习 · 计算机科学 2024-03-21 Zhenyi Wang , Yan Li , Li Shen , Heng Huang

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

机器学习 · 计算机科学 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

Label Distribution Learning (LDL) is a novel machine learning paradigm that addresses the problem of label ambiguity and has found widespread applications. Obtaining complete label distributions in real-world scenarios is challenging, which…

机器学习 · 计算机科学 2024-10-18 Zhiqiang Kou , Haoyuan Xuan , Jing Wang , Yuheng Jia , Xin Geng

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

机器学习 · 计算机科学 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Xiuwei Chen , Xiaobin Chang

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

机器学习 · 计算机科学 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

Multimodal learning aims to capture both shared and private information from multiple modalities. However, existing methods that project all modalities into a single latent space for fusion often overlook the asynchronous, multi-level…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Chunlei Meng , Guanhong Huang , Rong Fu , Runmin Jian , Zhongxue Gan , Chun Ouyang

Subspace clustering is a classical technique that has been widely used for human motion segmentation and other related tasks. However, existing segmentation methods often cluster data without guidance from prior knowledge, resulting in…

计算机视觉与模式识别 · 计算机科学 2022-02-11 Tao Zhou , Huazhu Fu , Chen Gong , Ling Shao , Fatih Porikli , Haibin Ling , Jianbing Shen