English
Related papers

Related papers: GR4CIL: Gap-compensated Routing for CLIP-based Cla…

200 papers

This paper studies continual learning (CL) of a sequence of aspect sentiment classification(ASC) tasks in a particular CL setting called domain incremental learning (DIL). Each task is from a different domain or product. The DIL setting is…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Hu Xu , Lei Shu

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

Computation and Language · Computer Science 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

Continual learning (CL) empowers pre-trained vision-language models to adapt effectively to novel or previously underrepresented data distributions without comprehensive retraining, enhancing their adaptability and efficiency. While…

Artificial Intelligence · Computer Science 2025-09-04 Zhiyuan Wang , Bokui Chen

In-context learning (ICL) enables generalization to new tasks with minimal labeled data. However, mainstream ICL approaches rely on a gridding strategy, which lacks the flexibility required for vision applications. We introduce Temporal, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Wahd , Jacob Jaremko , Abhilash Hareendranathan

Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the…

Artificial Intelligence · Computer Science 2026-02-17 Osher Elhadad , Felipe Meneguzzi , Reuth Mirsky

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

In this paper, we introduce DetailCLIP: A Detail-Oriented CLIP to address the limitations of contrastive learning-based vision-language models, particularly CLIP, in handling detail-oriented and fine-grained tasks like segmentation. While…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Amin Karimi Monsefi , Kishore Prakash Sailaja , Ali Alilooee , Ser-Nam Lim , Rajiv Ramnath

Contrastive Language-Image Pre-training (CLIP) formulates image classification as an image-to-text matching task, i.e., matching images to the corresponding natural language descriptions instead of discrete category IDs. This allows for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Shuhuai Ren , Lei Li , Xuancheng Ren , Guangxiang Zhao , Xu Sun

Video-text retrieval plays an essential role in multi-modal research and has been widely used in many real-world web applications. The CLIP (Contrastive Language-Image Pre-training), an image-language pre-training model, has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Huaishao Luo , Lei Ji , Ming Zhong , Yang Chen , Wen Lei , Nan Duan , Tianrui Li

Cross-Modal Retrieval (CMR) is an important research topic across multimodal computing and information retrieval, which takes one type of data as the query to retrieve relevant data of another type. It has been widely used in many…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhixiong Zeng , Wenji Mao

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

Class-incremental learning (CIL) for time series data faces critical challenges in balancing stability against catastrophic forgetting and plasticity for new knowledge acquisition, particularly under real-world constraints where historical…

Machine Learning · Computer Science 2025-03-11 Yuanlong Wu , Mingxing Nie , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting old ones. Traditional CIL models are trained from scratch to continually acquire knowledge as data evolves. Recently, pre-training has achieved…

Machine Learning · Computer Science 2024-08-06 Da-Wei Zhou , Zi-Wen Cai , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

For future learning systems, incremental learning is desirable because it allows for: efficient resource usage by eliminating the need to retrain from scratch at the arrival of new data; reduced memory usage by preventing or limiting the…

Machine Learning · Computer Science 2022-10-12 Marc Masana , Xialei Liu , Bartlomiej Twardowski , Mikel Menta , Andrew D. Bagdanov , Joost van de Weijer

Continual learning, especially class-incremental learning (CIL), on the basis of a pre-trained model (PTM) has garnered substantial research interest in recent years. However, how to effectively learn both discriminative and comprehensive…

Machine Learning · Computer Science 2026-05-11 Meng Lou , Yunxiang Fu , Yizhou Yu

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Class-incremental learning (CIL) aims to adapt to continuously emerging new classes while preserving knowledge of previously learned ones. Few-shot class-incremental learning (FSCIL) presents a greater challenge that requires the model to…

Artificial Intelligence · Computer Science 2025-08-19 Shiwon Kim , Dongjun Hwang , Sungwon Woo , Rita Singh

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Despite their consistent performance improvements, cross-modal retrieval models (e.g., CLIP) show degraded performances with retrieving keys composed of fused image-text modality (e.g., Wikipedia pages with both images and text). To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jungsoo Lee , Janghoon Cho , Hyojin Park , Munawar Hayat , Kyuwoong Hwang , Fatih Porikli , Sungha Choi