English
Related papers

Related papers: COLA: Context-aware Language-driven Test-time Adap…

200 papers

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Vision-Language Models seamlessly discriminate among arbitrary semantic categories, yet they still suffer from poor generalization when presented with challenging examples. For this reason, Episodic Test-Time Adaptation (TTA) strategies…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Matteo Farina , Gianni Franchi , Giovanni Iacca , Massimiliano Mancini , Elisa Ricci

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), cannot access the…

Computation and Language · Computer Science 2026-01-05 Tianlun Liu , Zhiliang Tian , Zhen Huang , Xingzhi Zhou , Wanlong Yu , Tianle Liu , Feng Liu , Dongsheng Li

Contrastive Language-Image Pretraining (CLIP) excels at learning generalizable image representations but often falls short in zero-shot inference on certain downstream datasets. Test-time adaptation (TTA) mitigates this issue by adjusting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zixin Wang , Dong Gong , Sen Wang , Zi Huang , Yadan Luo

Source-Free Domain Adaptation (SFDA) seeks to adapt a source model, which is pre-trained on a supervised source domain, for a target domain, with only access to unlabeled target training data. Relying on pseudo labeling and/or auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Song Tang , Yunxiang Bai , Wenxin Su , Mao Ye , Jianwei Zhang , Xiatian Zhu

Real-world application models are commonly deployed in dynamic environments, where the target domain distribution undergoes temporal changes. Continual Test-Time Adaptation (CTTA) has recently emerged as a promising technique to gradually…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shilei Cao , Juepeng Zheng , Yan Liu , Baoquan Zhao , Ziqi Yuan , Weijia Li , Runmin Dong , Haohuan Fu

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Generalizing Multimodal Large Language Models (MLLMs) to novel video domains is essential for real-world deployment but remains challenging due to the scarcity of labeled data. While In-Context Learning (ICL) offers a training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Ryo Fujii , Hideo Saito , Ryo Hachiuma

Test-time adaptation approaches have recently emerged as a practical solution for handling domain shift without access to the source domain data. In this paper, we propose and explore a new multi-modal extension of test-time adaptation for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Inkyu Shin , Yi-Hsuan Tsai , Bingbing Zhuang , Samuel Schulter , Buyu Liu , Sparsh Garg , In So Kweon , Kuk-Jin Yoon

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly understood. Through…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sarthak Kumar Maharana , Baoming Zhang , Leonid Karlinsky , Rogerio Feris , Yunhui Guo

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Vision-language models (VLMs) such as CLIP demonstrate strong generalization in zero-shot classification but remain highly vulnerable to adversarial perturbations. Existing methods primarily focus on adversarial fine-tuning or prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Shuo Wang , Kesen Zhao , Hanwang Zhang

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera

Test-time adaptation is a promising research direction that allows the source model to adapt itself to changes in data distribution without any supervision. Yet, current methods are usually evaluated on benchmarks that are only a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Damian Sójka , Sebastian Cygert , Bartłomiej Twardowski , Tomasz Trzciński

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

In dynamic environments, unfamiliar objects and distribution shifts are often encountered, which challenge the generalization abilities of the deployed trained models. This work addresses Incremental Test Time Adaptation of Vision Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Manogna Sreenivas , Soma Biswas

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Source-Free Domain Adaptation (SFDA) tackles the problem of adapting a pre-trained source model to an unlabeled target domain without accessing any source data, which is quite suitable for the field of data security. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shanshan Wang , Ziying Feng , Xiaozheng Shen , Xun Yang , Pichao Wang , Zhenwei He , Xingyi Zhang