English
Related papers

Related papers: Test-Time Adaptation with CLIP Reward for Zero-Sho…

200 papers

Vision-language models (VLMs) like CLIP exhibit strong zero-shot capabilities but often fail to generalize under distribution shifts. Test-time adaptation (TTA) allows models to update at inference time without labeled data, typically via…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Gustavo Adolfo Vargas Hakim , Clément Rambour , Christian Desrosier , Nicolas Thome

Vision-Language Models (VLMs) such as CLIP enable strong zero-shot recognition but suffer substantial degradation under distribution shifts. Test-Time Adaptation (TTA) aims to improve robustness using only unlabeled test samples, yet most…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sanggeon Yun , Ryozo Masukawa , SungHeon Jeong , Wenjun Huang , Hanning Chen , Mohsen Imani

Vision-Language Models (VLMs) demonstrate impressive zero-shot generalization through large-scale image-text pretraining, yet their performance can drop once the deployment distribution diverges from the training distribution. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Xiaozhen Qiao , Jingkai Zhao , Yuqiu Jiang , Xianda Guo , Zhe Sun , Hongyuan Zhang , Xuelong Li

Vision-Language Models (VLMs) show promise as zero-shot goal-conditioned value functions, but their frozen pre-trained representations limit generalization and temporal reasoning. We introduce VITA, a zero-shot value function learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Christos Ziakas , Alessandra Russo

Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Gustavo Adolfo Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Large-scale pretrained vision-language models like CLIP have demonstrated remarkable zero-shot image classification capabilities across diverse domains. To enhance CLIP's performance while preserving the zero-shot paradigm, various…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Xuefeng Hu , Ke Zhang , Min Sun , Albert Chen , Cheng-Hao Kuo , Ram Nevatia

Test-time adaptation (TTA) has emerged as a promising paradigm for vision-language models (VLMs) to bridge the distribution gap between pre-training and test data. Recent works have focused on backpropagation-free TTA methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhaohong Huang , Yuxin Zhang , Wenjing Liu , Fei Chao , Rongrong Ji

Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts. In response, we…

Test-time adaptation (TTA) methods have gained significant attention for enhancing the performance of vision-language models (VLMs) such as CLIP during inference, without requiring additional labeled data. However, current TTA researches…

Machine Learning · Computer Science 2025-10-14 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Pretrained vision-language models (VLMs) like CLIP show strong zero-shot performance but struggle with generalization under distribution shifts. Test-Time Adaptation (TTA) addresses this by adapting VLMs to unlabeled test data in new…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Hamidreza Dastmalchi , Aijun An , Ali cheraghian

Vision-language models (VLMs), despite their extraordinary zero-shot capabilities, are vulnerable to distribution shifts. Test-time adaptation (TTA) emerges as a predominant strategy to adapt VLMs to unlabeled test data on the fly. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Zhichen Zeng , Wenxuan Bao , Xiao Lin , Ruizhong Qiu , Tianxin Wei , Xuying Ning , Yuchen Yan , Chen Luo , Monica Xiao Cheng , Jingrui He , Hanghang Tong

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination or seasonal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shuang Cui , Jinglin Xu , Yi Li , Xiongxin Tang , Jiangmeng Li , Jiahuan Zhou , Fanjiang Xu , Fuchun Sun , Hui Xiong

Contrastive Language-Image Pretraining (CLIP) excels at learning generalizable image representations but often falls short in zero-shot inference on certain downstream datasets. Test-time adaptation (TTA) mitigates this issue by adjusting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zixin Wang , Dong Gong , Sen Wang , Zi Huang , Yadan Luo

Test-time adaptation (TTA) has gained increasing popularity due to its efficacy in addressing ``distribution shift'' issue while simultaneously protecting data privacy. However, most prior methods assume that a paired source domain model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Aiming Zhang , Tianyuan Yu , Liang Bai , Jun Tang , Yanming Guo , Yirun Ruan , Yun Zhou , Zhihe Lu

The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time involves tuning learnable prompts, ie, test-time prompt tuning. This paper introduces Test-Time Low-rank adaptation (TTL) as an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Raza Imam , Hanan Gani , Muhammad Huzaifa , Karthik Nandakumar
‹ Prev 1 2 3 10 Next ›