English
Related papers

Related papers: Continual Panoptic Perception: Towards Multi-modal…

200 papers

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Continual learning (CL) aims to learn a sequence of tasks without forgetting the previously acquired knowledge. However, recent CL advances are restricted to supervised continual learning (SCL) scenarios. Consequently, they are not scalable…

Machine Learning · Computer Science 2022-04-06 Divyam Madaan , Jaehong Yoon , Yuanchun Li , Yunxin Liu , Sung Ju Hwang

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

Machine Learning · Computer Science 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

The deployment of pre-trained models (PTMs) has greatly advanced the field of continual learning (CL), enabling positive knowledge transfer and resilience to catastrophic forgetting. To sustain these advantages for sequentially arriving…

Machine Learning · Computer Science 2025-04-18 Liyuan Wang , Jingyi Xie , Xingxing Zhang , Hang Su , Jun Zhu

Fine-tuning vision-language models (VLMs) such as CLIP often leads to catastrophic forgetting of pretrained knowledge. Prior work primarily aims to mitigate forgetting during adaptation; however, forgetting often remains inevitable during…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Wenqing Wang , Da Li , Xiatian Zhu , Josef Kittler

Multimodal Contrastive Learning (MCL) advances in aligning different modalities and generating multimodal representations in a joint space. By leveraging contrastive learning across diverse modalities, large-scale multimodal data enhances…

Machine Learning · Computer Science 2025-09-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

Computation and Language · Computer Science 2023-05-12 Zixuan Ke , Bing Liu

We focus on domain and class generalization problems in analyzing optical remote sensing images, using the large-scale pre-trained vision-language model (VLM), CLIP. While contrastively trained VLMs show impressive zero-shot generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Avigyan Bhattacharya , Mainak Singha , Ankit Jha , Biplab Banerjee

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

Continual learning (CL) has two main objectives: preventing catastrophic forgetting (CF) and encouraging knowledge transfer (KT). The existing literature mainly focused on overcoming CF. Some work has also been done on KT when the tasks are…

Computation and Language · Computer Science 2023-10-17 Zixuan Ke , Bing Liu , Wenhan Xiong , Asli Celikyilmaz , Haoran Li

Continual learning (CL) empowers pre-trained vision-language models to adapt effectively to novel or previously underrepresented data distributions without comprehensive retraining, enhancing their adaptability and efficiency. While…

Artificial Intelligence · Computer Science 2025-09-04 Zhiyuan Wang , Bokui Chen

Spatial scene understanding, including monocular depth estimation, is an important problem in various applications, such as robotics and autonomous driving. While improvements in unsupervised monocular depth estimation have potentially…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Continual learning (CL) - the ability to progressively acquire and integrate new concepts - is essential to intelligent systems to adapt to dynamic environments. However, deep neural networks struggle with catastrophic forgetting (CF) when…

Machine Learning · Computer Science 2025-07-08 Marco Paul E. Apolinario , Sakshi Choudhary , Kaushik Roy

While numerous methods achieving remarkable performance exist in the Object Detection literature, addressing data distribution shifts remains challenging. Continual Learning (CL) offers solutions to this issue, enabling models to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Francesco Pasti , Marina Ceccon , Davide Dalle Pezze , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To…

Machine Learning · Computer Science 2020-11-13 Changqing Zhang , Yajie Cui , Zongbo Han , Joey Tianyi Zhou , Huazhu Fu , Qinghua Hu

Current remote-sensing interpretation models often focus on a single task such as detection, segmentation, or caption. However, the task-specific designed models are unattainable to achieve the comprehensive multi-level interpretation of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Danpei Zhao , Bo Yuan , Ziqiang Chen , Tian Li , Zhuoran Liu , Wentao Li , Yue Gao