English
Related papers

Related papers: Subspace Alignment for Vision-Language Model Test-…

200 papers

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

Machine Learning · Computer Science 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee

With the increasing attention to pre-trained vision-language models (VLMs), \eg, CLIP, substantial efforts have been devoted to many downstream tasks, especially in test-time adaptation (TTA). However, previous works focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingyu Zhu , Shuo Wang , Beier Zhu , Miaoge Li , Yunfan Li , Junfeng Fang , Zhicai Wang , Dongsheng Wang , Hanwang Zhang

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging test-time…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yunhe Gao , Xingjian Shi , Yi Zhu , Hao Wang , Zhiqiang Tang , Xiong Zhou , Mu Li , Dimitris N. Metaxas

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Vision-language pre-training (VLP) has recently proven highly effective for various uni- and multi-modal downstream applications. However, most existing end-to-end VLP methods use high-resolution image-text box data to perform well on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shraman Pramanick , Li Jing , Sayan Nag , Jiachen Zhu , Hardik Shah , Yann LeCun , Rama Chellappa

Vision-language-action (VLA) models achieve strong in-distribution performance but degrade sharply under novel camera viewpoints and visual perturbations. We show that this brittleness primarily arises from misalignment in Spatial Modeling,…

Robotics · Computer Science 2026-04-01 Weiqi Li , Quande Zhang , Ruifeng Zhai , Liang Lin , Guangrun Wang

Vision-language models (VLMs) such as CLIP demonstrate strong performance but struggle when adapted to downstream tasks. Prompt learning has emerged as an efficient and effective strategy to adapt VLMs while preserving their pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Hao Wang , Huayu Li , Haiyu Wu , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Overfitting in RL has become one of the main obstacles to applications in reinforcement learning(RL). Existing methods do not provide explicit semantic constrain for the feature extractor, hindering the agent from learning a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Haihan Gao , Rui Zhang , Qi Yi , Hantao Yao , Haochen Li , Jiaming Guo , Shaohui Peng , Yunkai Gao , QiCheng Wang , Xing Hu , Yuanbo Wen , Zihao Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

Vision-Language Models (VLMs) have become essential backbones of modern multimodal intelligence, yet their outputs remain prone to hallucination-plausible text misaligned with visual inputs. Existing alignment approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kejia Chen , Jiawen Zhang , Jiacong Hu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

Vision-Language Models (VLMs), such as CLIP, have achieved significant zero-shot performance on downstream tasks with various fine-tuning adaptation methods. However, recent studies have proven that adversarial attacks can significantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Jia-Wei Hai , Yijun Wang , Xiu-Shen Wei

Vision-language foundation models have been incredibly successful in a wide range of downstream computer vision tasks using adaptation methods. However, due to the high cost of obtaining pre-training datasets, pairs with weak image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenshuo Peng , Kaipeng Zhang , Yue Yang , Hao Zhang , Yu Qiao

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adaptation (TTA) under…

Sound · Computer Science 2024-10-08 Hongfu Liu , Hengguan Huang , Ye Wang

Fully supervised Video Semantic Segmentation (VSS) relies heavily on densely annotated video data, limiting practical applicability. Alternatively, applying pre-trained Image Semantic Segmentation (ISS) models frame-by-frame avoids…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jihun Kim , Hoyong Kwon , Hyeokjun Kweon , Kuk-Jin Yoon

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

Test-time adaptation (TTA) aims to improve model robustness under distribution shifts by adapting to unlabeled test data, but most existing methods rely on backpropagation (BP), which is computationally costly and incompatible with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ronghao Zhang , Shuaicheng Niu , Qi Deng , Yanjie Dong , Jian Chen , Runhao Zeng