English
Related papers

Related papers: Cross-Domain Continual Learning via CLAMP

200 papers

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Active learning (AL) aims to improve model performance within a fixed labeling budget by choosing the most informative data points to label. Existing AL focuses on the single-domain setting, where all data come from the same domain (e.g.,…

Machine Learning · Computer Science 2024-02-12 Guang-Yuan Hao , Hengguan Huang , Haotian Wang , Jie Gao , Hao Wang

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learning (CIL), which is…

Machine Learning · Computer Science 2026-04-17 Amirhosein Javadi , Tuomas Oikarinen , Tara Javidi , Tsui-Wei Weng

Large Language Models (LLMs) have demonstrated strong performance in open-ended generation tasks. However, they often struggle to adapt content to users with differing cognitive capacities, leading to a phenomenon we term cognitive…

Computation and Language · Computer Science 2025-09-25 Qingsong Wang , Tao Wu , Wang Lin , Yueying Feng , Gongsheng Yuan , Chang Yao , Jingyuan Chen

Quantum computers may outperform classical computers on machine learning tasks. In recent years, a variety of quantum algorithms promising unparalleled potential to enhance, speed up, or innovate machine learning have been proposed. Yet,…

Foundation Models (FMs) have been successful in various computer vision tasks like image classification, object detection and image segmentation. However, these tasks remain challenging when these models are tested on datasets with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Julian D. Santamaria , Claudia Isaza , Jhony H. Giraldo

The main challenge of continual learning is \textit{catastrophic forgetting}. Because of processing data in one pass, online continual learning (OCL) is one of the most difficult continual learning scenarios. To address catastrophic…

Machine Learning · Computer Science 2025-10-02 Aopeng Wang , Ke Deng , Yongli Ren , Jun Luo

High content imaging assays can capture rich phenotypic response data for large sets of compound treatments, aiding in the characterization and discovery of novel drugs. However, extracting representative features from high content images…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Johan Fredin Haslum , Christos Matsoukas , Karl-Johan Leuchowius , Erik Müllers , Kevin Smith

Cross-Domain Few-Shot Learning (CDFSL) adapts models trained with large-scale general data (source domain) to downstream target domains with only scarce training data, where the research on vision-language models (e.g., CLIP) is still in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yaze Zhao , Yixiong Zou , Yuhua Li , Ruixuan Li

We introduce an algorithm for tackling the problem of unsupervised domain adaptation (UDA) in continual learning (CL) scenarios. The primary objective is to maintain model generalization under domain shift when new domains arrive…

Machine Learning · Computer Science 2024-02-02 Mohammad Rostami

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

Contrastive learning (CL) has been successful as a powerful representation learning method. In this work we propose CLIM: Contrastive Learning with mutual Information Maximization, to explore the potential of CL on cross-domain sentiment…

Computation and Language · Computer Science 2020-11-13 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

In this work, we address the problem of unsupervised domain adaptation for person re-ID where annotations are available for the source domain but not for target. Previous methods typically follow a two-stage optimization pipeline, where the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Takashi Isobe , Dong Li , Lu Tian , Weihua Chen , Yi Shan , Shengjin Wang

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Due to the lack of labels and the domain diversities, it is a challenge to study person re-identification in the cross-domain setting. An admirable method is to optimize the target model by assigning pseudo-labels for unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hongliang Zhang , Shoudong Han , Xiaofeng Pan , Jun Zhao

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Continual learning (CL) in deep neural networks (DNNs) involves incrementally accumulating knowledge in a DNN from a growing data stream. A major challenge in CL is that non-stationary data streams cause catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-02 Md Yousuf Harun , Jhair Gallardo , Junyu Chen , Christopher Kanan