English
Related papers

Related papers: Knowledge Restore and Transfer for Multi-label Cla…

200 papers

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

Online Class-Incremental continual Learning (OCIL) addresses the challenge of continuously learning from a single-channel data stream, adapting to new tasks while mitigating catastrophic forgetting. Recently, Mutual Information (MI)-based…

Machine Learning · Computer Science 2024-07-29 Huan Zhang , Fan Lyu , Shenghua Fan , Yujin Zheng , Dingwen Wang

Classical deep neural networks are limited in their ability to learn from emerging streams of training data. When trained sequentially on new or evolving tasks, their performance degrades sharply, making them inappropriate in real-world use…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Mozhgan PourKeshavarz , Mohammad Sabokrou

How to enable learnability for new classes while keeping the capability well on old classes has been a crucial challenge for class incremental learning. Beyond the normal case, long-tail class incremental learning and few-shot class…

Machine Learning · Computer Science 2023-08-04 Yibo Yang , Haobo Yuan , Xiangtai Li , Jianlong Wu , Lefei Zhang , Zhouchen Lin , Philip Torr , Dacheng Tao , Bernard Ghanem

Multi-domain learning (MDL) refers to simultaneously constructing a model or a set of models on datasets collected from different domains. Conventional approaches emphasize domain-shared information extraction and domain-private information…

Machine Learning · Computer Science 2023-07-31 Rui He , Shengcai Liu , Jiahao Wu , Shan He , Ke Tang

Graph class-incremental learning (GCIL) allows graph neural networks (GNNs) to adapt to evolving graph analytical tasks by incrementally learning new class knowledge while retaining knowledge of old classes. Existing GCIL methods primarily…

Machine Learning · Computer Science 2025-07-24 Jiazhen Chen , Zheng Ma , Sichao Fu , Mingbin Feng , Tony S. Wirjanto , Weihua Ou

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Deep neural models have hitherto achieved significant performances on numerous classification tasks, but meanwhile require sufficient manually annotated data. Since it is extremely time-consuming and expensive to annotate adequate data for…

Machine Learning · Computer Science 2022-05-05 Yinghui Li , Ruiyang Liu , ZiHao Zhang , Ning Ding , Ying Shen , Linmi Tao , Hai-Tao Zheng

Deep learning models suffer from catastrophic forgetting when learning new tasks incrementally. Incremental learning has been proposed to retain the knowledge of old classes while learning to identify new classes. A typical approach is to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Huitong Chen , Yu Wang , Qinghua Hu

Meta-learning is widely used for few-shot slot tagging in task of few-shot learning. The performance of existing methods is, however, seriously affected by \textit{sample forgetting issue}, where the model forgets the historically learned…

Artificial Intelligence · Computer Science 2023-09-12 Hongru Wang , Zezhong Wang , Wai Chung Kwan , Kam-Fai Wong

Online continual learning, especially when task identities and task boundaries are unavailable, is a challenging continual learning setting. One representative kind of methods for online continual learning is replay-based methods, in which…

Machine Learning · Computer Science 2022-09-26 Yan-Shuo Liang , Wu-Jun Li

The ability to incrementally learn new classes from limited samples is crucial to the development of artificial intelligence systems for real clinical application. Although existing incremental learning techniques have attempted to address…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Hao Yang , Weijian Huang , Jiarun Liu , Cheng Li , Shanshan Wang

Multimodal Continual Instruction Tuning (MCIT) aims to enable Multimodal Large Language Models (MLLMs) to incrementally learn new tasks without catastrophic forgetting. In this paper, we explore forgetting in this context, categorizing it…

Machine Learning · Computer Science 2025-05-06 Jinpeng Chen , Runmin Cong , Yuzhi Zhao , Hongzheng Yang , Guangneng Hu , Horace Ho Shing Ip , Sam Kwong

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

Few-Shot Class-Incremental Learning (FSCIL) aims at incrementally learning novel classes from a few labeled samples by avoiding the overfitting and catastrophic forgetting simultaneously. The current protocol of FSCIL is built by mimicking…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yawen Cui , Zitong Yu , Wei Peng , Li Liu

Class-Incremental Learning (CIL) [40] trains classifiers under a strict memory budget: in each incremental phase, learning is done for new data, most of which is abandoned to free space for the next phase. The preserved data are exemplars…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yaoyao Liu , Bernt Schiele , Qianru Sun

Real-world recognition system often encounters the challenge of unseen labels. To identify such unseen labels, multi-label zero-shot learning (ML-ZSL) focuses on transferring knowledge by a pre-trained textual label embedding (e.g., GloVe).…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Bo Ren , Shu-Tao Xia

Building models of natural language processing (NLP) is challenging in low-resource scenarios where only limited data are available. Optimization-based meta-learning algorithms achieve promising results in low-resource scenarios by adapting…

Computation and Language · Computer Science 2022-07-15 Yingxiu Zhao , Zhiliang Tian , Huaxiu Yao , Yinhe Zheng , Dongkyu Lee , Yiping Song , Jian Sun , Nevin L. Zhang

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

In class-incremental learning (CIL) scenarios, the phenomenon of catastrophic forgetting caused by the classifier's bias towards the current task has long posed a significant challenge. It is mainly caused by the characteristic of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xusheng Cao , Haori Lu , Linlan Huang , Xialei Liu , Ming-Ming Cheng