English
Related papers

Related papers: VLOD-TTA: Test-Time Adaptation of Vision-Language …

200 papers

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

Vision-language pre-training (VLP) has recently proven highly effective for various uni- and multi-modal downstream applications. However, most existing end-to-end VLP methods use high-resolution image-text box data to perform well on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shraman Pramanick , Li Jing , Sayan Nag , Jiachen Zhu , Hardik Shah , Yann LeCun , Rama Chellappa

Learning discriminative 3D representations that generalize well to unknown testing categories is an emerging requirement for many real-world 3D applications. Existing well-established methods often struggle to attain this goal due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Zhichuan Wang , Yang Zhou , Jinhai Xiang , Yulong Wang , Xinwei He

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

Test-time adaptation (TTA) of 3D point clouds is crucial for mitigating discrepancies between training and testing samples in real-world scenarios, particularly when handling corrupted point clouds. LiDAR data, for instance, can be affected…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hamidreza Dastmalchi , Aijun An , Ali Cheraghian , Shafin Rahman , Sameera Ramasinghe

Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Gustavo Adolfo Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Vision-language models (VLMs) exhibit remarkable zero-shot capabilities but struggle with distribution shifts in downstream tasks when labeled data is unavailable, which has motivated the development of Test-Time Adaptation (TTA) to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yiwen Liang , Hui Chen , Yizhe Xiong , Zihan Zhou , Mengyao Lyu , Zijia Lin , Shuaicheng Niu , Sicheng Zhao , Jungong Han , Guiguang Ding

When deploying pre-trained video object detectors in real-world scenarios, the domain gap between training and testing data caused by adverse image conditions often leads to performance degradation. Addressing this issue becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Xingguang Zhang , Chih-Hsien Chou

Domain adaptive object detection (DAOD) aims to generalize detectors trained on an annotated source domain to an unlabelled target domain. As the visual-language models (VLMs) can provide essential general knowledge on unseen images,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Haochen Li , Rui Zhang , Hantao Yao , Xin Zhang , Yifan Hao , Xinkai Song , Xiaqing Li , Yongwei Zhao , Ling Li , Yunji Chen

Test-time adaptation (TTA) fine-tunes pre-trained deep neural networks for unseen test data. The primary challenge of TTA is limited access to the entire test dataset during online updates, causing error accumulation. To mitigate it, TTA…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jonghyun Lee , Dahuin Jung , Saehyung Lee , Junsung Park , Juhyeon Shin , Uiwon Hwang , Sungroh Yoon

The choice of input text prompt plays a critical role in the performance of Vision-Language Pretrained (VLP) models such as CLIP. We present APoLLo, a unified multi-modal approach that combines Adapter and Prompt learning for…

Machine Learning · Computer Science 2023-12-05 Sanjoy Chowdhury , Sayan Nag , Dinesh Manocha

Recent advances in test-time adaptation (TTA) for Vision-Language Models (VLMs) have garnered increasing attention, particularly through the use of multiple augmented views of a single image to boost zero-shot generalization. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Zhaohong Huang , Yuxin Zhang , Jingjing Xie , Fei Chao , Rongrong Ji

Recently, adapting Vision Language Models (VLMs) to zero-shot visual classification by tuning class embedding with a few prompts (Test-time Prompt Tuning, TPT) or replacing class names with generated visual samples (support-set) has shown…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Rui Yan , Jin Wang , Hongyu Qu , Xiaoyu Du , Dong Zhang , Jinhui Tang , Tieniu Tan

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), cannot access the…

Computation and Language · Computer Science 2026-01-05 Tianlun Liu , Zhiliang Tian , Zhen Huang , Xingzhi Zhou , Wanlong Yu , Tianle Liu , Feng Liu , Dongsheng Li

Test-Time Adaptation (TTA) is essential for enabling deep learning models to handle real-world data distribution shifts. However, current approaches face significant limitations: backpropagation-based methods are not suitable for low-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xingyu Wang , Tao Wang

Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth cannot be obtained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yeonguk Yu , Sungho Shin , Seunghyeok Back , Minhwan Ko , Sangjun Noh , Kyoobin Lee

Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yulu Gan , Yan Bai , Yihang Lou , Xianzheng Ma , Renrui Zhang , Nian Shi , Lin Luo

Adapting pre-trained models to open classes is a challenging problem in machine learning. Vision-language models fully explore the knowledge of text modality, demonstrating strong zero-shot recognition performance, which is naturally suited…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhengqing Gao , Xiang Ao , Xu-Yao Zhang , Cheng-Lin Liu