English
Related papers

Related papers: Class-Aware Prototype Learning with Negative Contr…

200 papers

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

With the increasing attention to pre-trained vision-language models (VLMs), \eg, CLIP, substantial efforts have been devoted to many downstream tasks, especially in test-time adaptation (TTA). However, previous works focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingyu Zhu , Shuo Wang , Beier Zhu , Miaoge Li , Yunfan Li , Junfeng Fang , Zhicai Wang , Dongsheng Wang , Hanwang Zhang

Test-time adaptation (TTA) is crucial in maintaining performance of Vision Language Models (VLMs) when facing distribution shifts, particularly when the source data or target labels are inaccessible. Existing TTA methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xiaozhen Qiao , Peng Huang , Jiakang Yuan , Xianda Guo , Bowen Ye , Chaocan Xue , Ye Zheng , Zhe Sun , Xuelong Li

Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts. In response, we…

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimated pseudo-labels.…

Machine Learning · Computer Science 2024-01-26 Guowei Wang , Changxing Ding , Wentao Tan , Mingkui Tan

Large-scale pre-trained Vision-Language Models (VLMs) have exhibited impressive zero-shot performance and transferability, allowing them to adapt to downstream tasks in a data-efficient manner. However, when only a few labeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Ce Zhang , Simon Stepputtis , Katia Sycara , Yaqi Xie

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

In zero-shot setting, test-time adaptation adjusts pre-trained models using unlabeled data from the test phase to enhance performance on unknown test distributions. Existing cache-enhanced TTA methods rely on a low-entropy criterion to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Xinyu Chen , Haotian Zhai , Can Zhang , Xiupeng Shi , Ruirui Li

Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalization, enabling deployment in a wide range of real-world tasks without additional task-specific training. However, in real deployment…

Artificial Intelligence · Computer Science 2025-10-27 Yujin Jo , Taesup Kim

Pre-trained large-scale vision-language models (VLMs) have acquired profound understanding of general visual concepts. Recent advancements in efficient transfer learning (ETL) have shown remarkable success in fine-tuning VLMs within the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Haoxing Chen , Yaohui Li , Zizheng Huang , Yan Hong , Zhuoer Xu , Zhangxuan Gu , Jun Lan , Huijia Zhu , Weiqiang Wang

Test-time adaptation (TTA) of visual language models has recently attracted significant attention as a solution to the performance degradation caused by distribution shifts in downstream tasks. However, existing cache-based TTA methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haotian Zhai , Xinyu Chen , Can Zhang , Tianming Sha , Ruirui Li

Vision-language object detectors (VLODs) such as YOLO-World and Grounding DINO exhibit strong zero-shot generalization, but their performance degrades under distribution shift. Test-time adaptation (TTA) offers a practical way to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Atif Belal , Heitor R. Medeiros , Marco Pedersoli , Eric Granger

Contrastive Language-Image Pretraining (CLIP) excels at learning generalizable image representations but often falls short in zero-shot inference on certain downstream datasets. Test-time adaptation (TTA) mitigates this issue by adjusting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zixin Wang , Dong Gong , Sen Wang , Zi Huang , Yadan Luo

Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot recognition by comparing image embeddings to text-derived class prototypes. However, under domain shift, they suffer from feature drift, class-prior mismatch, and severe…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Byunghyun Kim

Current pre-trained vision-language models, such as CLIP, have demonstrated remarkable zero-shot generalization capabilities across various downstream tasks. However, their performance significantly degrades when test inputs exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junhui Yin , Xinyu Zhang , Lin Wu , Xiaojie Wang

The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize input text prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhongxing Xu , Feilong Tang , Zhe Chen , Yingxue Su , Zhiyi Zhao , Ge Zhang , Jionglong Su , Zongyuan Ge

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time involves tuning learnable prompts, ie, test-time prompt tuning. This paper introduces Test-Time Low-rank adaptation (TTL) as an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Raza Imam , Hanan Gani , Muhammad Huzaifa , Karthik Nandakumar

3D Vision-Language Foundation Models (VLFMs) have shown strong generalization and zero-shot recognition capabilities in open-world point cloud processing tasks. However, these models often underperform in practical scenarios where data are…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Mehran Tamjidi , Hamidreza Dastmalchi , Mohammadreza Alimoradijazi , Ali Cheraghian , Aijun An , Morteza Saberi

Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Gustavo Adolfo Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers