English
Related papers

Related papers: Ramen: Robust Test-Time Adaptation of Vision-Langu…

200 papers

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Foundation Vision-Language Models (VLMs) like CLIP exhibit strong generalization capabilities due to large-scale pretraining on diverse image-text pairs. However, their performance often degrades when applied to target datasets with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Debarshi Brahma , Soma Biswas

Transfer learning enables the sharing of common knowledge among models for a variety of downstream tasks, but traditional methods suffer in limited training data settings and produce narrow models incapable of effectively generalizing under…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Kevin Vogt-Lowell , Noah Lee , Theodoros Tsiligkaridis , Marc Vaillant

Large-scale pre-trained Vision-Language models (VLMs), such as CLIP, exhibit strong zero-shot generalization, yet remain highly vulnerable to imperceptible adversarial perturbations, raising serious safety concerns for open-world…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xin Wang , Yixu Wang , Jiaming Zhang , Ruofan Wang , Jiaqi Yu , Kai Chen , Jingjing Chen , Xingjun Ma , Yu-Gang Jiang

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

Deep learning models in medical imaging often encounter challenges when adapting to new clinical settings unseen during training. Test-time adaptation offers a promising approach to optimize models for these unseen domains, yet its…

Machine Learning · Computer Science 2024-10-28 Sameer Ambekar , Julia A. Schnabel , Cosmin I. Bercea

Contrastively trained vision-language models such as CLIP provide strong zero-shot transfer by aligning images and text in a shared embedding space. However, adapting these models to downstream tasks without degrading their open-vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Simone Carnemolla , Salvatore Calcagno , Daniela Giordano , Concetto Spampinato , Matteo Pennisi

The adaptation of large-scale Vision-Language Models (VLMs) like CLIP to downstream tasks with extremely limited data -- specifically in the one-shot regime -- is often hindered by a significant "Stability-Plasticity" dilemma. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Md Jahidul Islam

The recent advancements in Generative Adversarial Networks (GANs) and the emergence of Diffusion models have significantly streamlined the production of highly realistic and widely accessible synthetic content. As a result, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

We propose a test-time adaptation method for cross-domain image segmentation. Our method is simple: Given a new unseen instance at test time, we adapt a pre-trained model by conducting instance-specific BatchNorm (statistics) calibration.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yuliang Zou , Zizhao Zhang , Chun-Liang Li , Han Zhang , Tomas Pfister , Jia-Bin Huang

Vision-language models (VLMs) like CLIP have demonstrated remarkable applicability across a variety of downstream tasks, including zero-shot image classification. Recently, the use of prompts or adapters for efficient transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Yongjin Yang , Jongwoo Ko , Se-Young Yun

Test-time adaptation (TTA) has emerged as a promising paradigm for vision-language models (VLMs) to bridge the distribution gap between pre-training and test data. Recent works have focused on backpropagation-free TTA methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhaohong Huang , Yuxin Zhang , Wenjing Liu , Fei Chao , Rongrong Ji

Vision-language models (VLMs) exhibit remarkable zero-shot generalization but suffer performance degradation under distribution shifts in downstream tasks, particularly in the absence of labeled data. Test-Time Adaptation (TTA) addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Khanh-Binh Nguyen , Phuoc-Nguyen Bui , Hyunseung Choo , Duc Thanh Nguyen

Pretrained vision-language models (VLMs), such as CLIP, achieve remarkable zero-shot performance, yet their downstream potential hinges on effective fine-tuning. Most adaptation methods typically focus on refining representation from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Liang Chen , Ghazi Shazan Ahmad , Tianjun Yao , Lingqiao Liu , Zhiqiang Shen

With the emergence of Transformers and Vision-Language Models (VLMs) such as CLIP, fine-tuning large pre-trained models has recently become a prevalent strategy in Continual Learning. This has led to the development of numerous prompting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Emanuele Frascaroli , Aniello Panariello , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a significant role in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jindong Li , Yongguang Li , Yali Fu , Jiahong Liu , Yixin Liu , Menglin Yang , Irwin King

Earth observation (EO) data spans a wide range of spatial, spectral, and temporal resolutions, from high-resolution optical imagery to low resolution multispectral products or radar time series. While recent foundation models have improved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Nicolas Houdré , Diego Marcos , Hugo Riffaud de Turckheim , Dino Ienco , Laurent Wendling , Camille Kurtz , Sylvain Lobry

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Magnetic Resonance Imaging (MRI) scans acquired from different scanners or institutions often suffer from domain shifts owing to variations in hardware, protocols, and acquisition parameters. This discrepancy degrades the performance of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mohd Usama , Belal Ahmad , Faleh Menawer R Althiyabi