English
Related papers

Related papers: PAL: Prompting Analytic Learning with Missing Moda…

200 papers

Multimodal incremental learning needs to digest the information from multiple modalities while concurrently learning new knowledge without forgetting the previously learned information. There are numerous challenges for this task, mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yi-Lun Lee , Chen-Yu Lee , Wei-Chen Chiu , Yi-Hsuan Tsai

Few-Shot Class Incremental Learning (FSCIL) is a challenging continual learning task, where limited training examples are available during several learning sessions. To succeed in this task, it is necessary to avoid over-fitting new classes…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Marco D'Alessandro , Alberto Alonso , Enrique Calabrés , Mikel Galar

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

Machine Learning · Computer Science 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Online Class Incremental Learning (OCIL) aims to train models incrementally, where data arrive in mini-batches, and previous data are not accessible. A major challenge in OCIL is Catastrophic Forgetting, i.e., the loss of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Huiping Zhuang , Yuchen Liu , Run He , Kai Tong , Ziqian Zeng , Cen Chen , Yi Wang , Lap-Pui Chau

Exemplar-free class-incremental learning (EFCIL) aims to mitigate catastrophic forgetting in class-incremental learning (CIL) without available historical training samples as exemplars. Compared with its exemplar-based CIL counterpart that…

Machine Learning · Computer Science 2025-12-18 Run He , Di Fang , Yizhu Chen , Kai Tong , Cen Chen , Yi Wang , Lap-pui Chau , Huiping Zhuang

Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Chenhao Ding , Songlin Dong , Zhengdong Zhou , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former ones. While traditional CIL methods focus on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Da-Wei Zhou , Yuanhan Zhang , Yan Wang , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Multi-view multi-label classification (MvMLC) is indispensable for modern web applications aggregating information from diverse sources. However, real-world web-scale settings are rife with missing views and continuously emerging classes,…

Machine Learning · Computer Science 2026-01-27 Jiajun Chen , Yue Wu , Kai Huang , Wen Xi , Yangyang Wu , Xiaoye Miao , Mengying Zhu , Meng Xi , Guanjie Cheng

Using multiple spatial modalities has been proven helpful in improving semantic segmentation performance. However, there are several real-world challenges that have yet to be addressed: (a) improving label efficiency and (b) enhancing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Harsh Maheshwari , Yen-Cheng Liu , Zsolt Kira

Multi-label class-incremental learning (MLCIL) continuously expands the label space while recognizing multiple co-occurring classes, making it prone to catastrophic forgetting and high false-positive rates (FPR). Extending CLIP to MLCIL is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Kaile Du , Zihan Ye , Junzhou Xie , Yixi Shen , Yuyang Li , Fuyuan Hu , Ling Shao , Guangcan Liu , Joost van de Weijer , Fan Lyu

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

In the era of big data, data mining has become indispensable for uncovering hidden patterns and insights from vast and complex datasets. The integration of multimodal data sources further enhances its potential. Multimodal Federated…

Machine Learning · Computer Science 2025-08-22 Lishan Yang , Wei Emma Zhang , Quan Z. Sheng , Lina Yao , Weitong Chen , Ali Shakeri

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Missing modalities consistently lead to significant performance degradation in multimodal models. Existing approaches either synthesize missing modalities at high computational cost or apply prompt-based fine-tuning that relies only on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hongye Zhu , Xuan Liu , Yanwen Ba , Jingye Xue , Shigeng Zhang

Traditional Incremental Learning (IL) targets to handle sequential fully-supervised learning problems where novel classes emerge from time to time. However, due to inherent annotation uncertainty and ambiguity, collecting high-quality…

Machine Learning · Computer Science 2025-05-08 Rui Wang , Mingxuan Xia , Chang Yao , Lei Feng , Junbo Zhao , Gang Chen , Haobo Wang

Multimodal models trained on complete modality data often exhibit a substantial decrease in performance when faced with imperfect data containing corruptions or missing modalities. To address this robustness challenge, prior methods have…

Multimedia · Computer Science 2023-10-24 Mengxi Chen , Jiangchao Yao , Linyu Xing , Yu Wang , Ya Zhang , Yanfeng Wang

Continual learning aims to enable models to learn sequentially from continuously incoming data while retaining performance on previously learned tasks. With the Contrastive Language-Image Pre-trained model (CLIP) exhibiting strong…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Linlan Huang , Xusheng Cao , Haori Lu , Yifan Meng , Fei Yang , Xialei Liu

Incremental learning aims to enable models to continuously acquire knowledge from evolving data streams while preserving previously learned capabilities. While current research predominantly focuses on unimodal incremental learning and…

Machine Learning · Computer Science 2025-04-21 Yaguang Song , Xiaoshan Yang , Dongmei Jiang , Yaowei Wang , Changsheng Xu

Existing class incremental learning is mainly designed for single-label classification task, which is ill-equipped for multi-label scenarios due to the inherent contradiction of learning objectives for samples with incomplete labels. We…

Machine Learning · Computer Science 2025-03-24 Aoting Zhang , Dongbao Yang , Chang Liu , Xiaopeng Hong , Yu Zhou