English
Related papers

Related papers: Realistic Test-Time Adaptation of Vision-Language …

200 papers

Test-time adaptation (TTA) aims to address distribution shifts between source and target data by relying solely on target data during testing. In open-world scenarios, models often encounter noisy samples, i.e., samples outside the…

Machine Learning · Computer Science 2025-04-08 Chentao Cao , Zhun Zhong , Zhanke Zhou , Tongliang Liu , Yang Liu , Kun Zhang , Bo Han

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Despite remarkable progress in Vision-Language-Action models (VLAs) for robot manipulation, these large pre-trained models require fine-tuning to be deployed in specific environments. These fine-tuned models are highly sensitive to camera…

Robotics · Computer Science 2026-03-09 Hyeongjun Heo , Seungyeon Woo , Sang Min Kim , Junho Kim , Junho Lee , Yonghyeon Lee , Young Min Kim

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without…

Machine Learning · Computer Science 2025-08-08 Hao Dong , Lijun Sheng , Jian Liang , Ran He , Eleni Chatzi , Olga Fink

Tactile-vision-language (TVL) models are increasingly deployed in real-world robotic and multimodal perception tasks, where test-time distribution shifts are unavoidable. Existing test-time adaptation (TTA) methods provide filtering in…

Robotics · Computer Science 2026-02-19 Chuyang Ye , Haoxian Jing , Qinting Jiang , Yixi Lin , Qiang Li , Xing Tang , Jingyan Jiang

Vision-Language-Action models have recently emerged as a powerful paradigm for general-purpose robot learning, enabling agents to map visual observations and natural-language instructions into executable robotic actions. Though popular,…

Vision-Language Models (VLMs) such as CLIP enable strong zero-shot recognition but suffer substantial degradation under distribution shifts. Test-Time Adaptation (TTA) aims to improve robustness using only unlabeled test samples, yet most…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sanggeon Yun , Ryozo Masukawa , SungHeon Jeong , Wenjun Huang , Hanning Chen , Mohsen Imani

Vision-language models (VLMs) like CLIP exhibit strong zero-shot capabilities but often fail to generalize under distribution shifts. Test-time adaptation (TTA) allows models to update at inference time without labeled data, typically via…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Gustavo Adolfo Vargas Hakim , Clément Rambour , Christian Desrosier , Nicolas Thome

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

Vision-language models (VLMs) encounter considerable challenges when adapting to domain shifts stemming from changes in data distribution. Test-time adaptation (TTA) has emerged as a promising approach to enhance VLM performance under such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chenyu Zhang , Kunlun Xu , Zichen Liu , Yuxin Peng , Jiahuan Zhou

Medical vision-language models (VLMs) are strong zero-shot recognizers for medical imaging, but their reliability under domain shift hinges on calibrated uncertainty with guarantees. Split conformal prediction (SCP) offers finite-sample…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Behzad Bozorgtabar , Dwarikanath Mahapatra , Sudipta Roy , Muzammal Naseer , Imran Razzak , Zongyuan Ge

Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts. In response, we…

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Longhui Yuan , Binhui Xie , Shuang Li

Transductive zero-shot learning with vision-language models leverages image-image similarities within the dataset to achieve better classification accuracy compared to the inductive setting. However, there is little work that explores the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Oindrila Saha , Logan Lawrence , Grant Van Horn , Subhransu Maji

Vision-Language Models (VLMs) excel at zero-shot inference but often degrade under test-time domain shifts. For this reason, episodic test-time adaptation strategies have recently emerged as powerful techniques for adapting VLMs to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Konstantinos M. Dafnis , Dimitris N. Metaxas

Vision-Language Models seamlessly discriminate among arbitrary semantic categories, yet they still suffer from poor generalization when presented with challenging examples. For this reason, Episodic Test-Time Adaptation (TTA) strategies…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Matteo Farina , Gianni Franchi , Giovanni Iacca , Massimiliano Mancini , Elisa Ricci

One fascinating aspect of pre-trained vision-language models~(VLMs) learning under language supervision is their impressive zero-shot generalization capability. However, this ability is hindered by distribution shifts between the training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shuai Zhao , Xiaohan Wang , Linchao Zhu , Yi Yang

Small Vision-Language Models (VLMs) provide a computationally efficient alternative to larger models, at the cost of weaker generalization abilities and downstream task performance. These shortcomings could be addressed by test-time scaling…

Machine Learning · Computer Science 2026-02-17 Mehmet Onurcan Kaya , Desmond Elliott , Dim P. Papadopoulos

Large-scale Vision-Language Models (VLMs) exhibit strong zero-shot recognition, yet their real-world deployment is challenged by distribution shifts. While Test-Time Adaptation (TTA) can mitigate this, existing VLM-based TTA methods operate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Wei Luo , Yangfan Ou , Jin Deng , Zeshuai Deng , Xiquan Yan , Zhiquan Wen , Mingkui Tan