English
Related papers

Related papers: Flatness Guided Test-Time Adaptation for Vision-La…

200 papers

Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing TSF-TTA methods differ in how they utilize revealed targets, yet the resulting adaptation…

Machine Learning · Computer Science 2026-05-19 Haochun Wang , Ruichen Xu , Georgios Kementzidis , Karen Cho , Sebastian Ramirez Villarreal , Yuefan Deng

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

Vision Transformer (ViT) is becoming more popular in image processing. Specifically, we investigate the effectiveness of test-time adaptation (TTA) on ViT, a technique that has emerged to correct its prediction during test-time by itself.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot recognition by comparing image embeddings to text-derived class prototypes. However, under domain shift, they suffer from feature drift, class-prior mismatch, and severe…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Byunghyun Kim

Vision-language-action (VLA) models achieve strong in-distribution performance but degrade sharply under novel camera viewpoints and visual perturbations. We show that this brittleness primarily arises from misalignment in Spatial Modeling,…

Robotics · Computer Science 2026-04-01 Weiqi Li , Quande Zhang , Ruifeng Zhai , Liang Lin , Guangrun Wang

Vision-language object detectors (VLODs) such as YOLO-World and Grounding DINO exhibit strong zero-shot generalization, but their performance degrades under distribution shift. Test-time adaptation (TTA) offers a practical way to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Atif Belal , Heitor R. Medeiros , Marco Pedersoli , Eric Granger

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

Recently, test-time adaptation has attracted wide interest in the context of vision-language models for image classification. However, to the best of our knowledge, the problem is completely overlooked in dense prediction tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mehrdad Noori , David Osowiechi , Gustavo Adolfo Vargas Hakim , Ali Bahri , Moslem Yazdanpanah , Sahar Dastani , Farzad Beizaee , Ismail Ben Ayed , Christian Desrosiers

Vision-language models (VLMs) like CLIP exhibit strong zero-shot capabilities but often fail to generalize under distribution shifts. Test-time adaptation (TTA) allows models to update at inference time without labeled data, typically via…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Gustavo Adolfo Vargas Hakim , Clément Rambour , Christian Desrosier , Nicolas Thome

The zero-shot capabilities of Vision-Language Models (VLMs) have been widely leveraged to improve predictive performance. However, previous works on transductive or test-time adaptation (TTA) often make strong assumptions about the data…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Maxime Zanella , Clément Fuchs , Christophe De Vleeschouwer , Ismail Ben Ayed

Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad application potential in real-world scenarios. However, in this…

Machine Learning · Computer Science 2024-12-24 Qi Deng , Shuaicheng Niu , Ronghao Zhang , Yaofo Chen , Runhao Zeng , Jian Chen , Xiping Hu

Test-time prompt tuning for vision-language models (VLMs) is getting attention because of their ability to learn with unlabeled data without fine-tuning. Although test-time prompt tuning methods for VLMs can boost accuracy, the resulting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ashshak Sharifdeen , Muhammad Akhtar Munir , Sanoojan Baliah , Salman Khan , Muhammad Haris Khan

The ability to accurately comprehend natural language instructions and navigate to the target location is essential for an embodied agent. Such agents are typically required to execute user instructions in an online manner, leading us to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Junyu Gao , Xuan Yao , Changsheng Xu

Vision-language models (VLMs) such as CLIP and Grounding DINO have achieved remarkable success in object recognition and detection. However, their performance often degrades under real-world distribution shifts. Test-time adaptation (TTA)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Lihua Zhou , Mao Ye , Shuaifeng Li , Nianxin Li , Jinlin Wu , Xiatian Zhu , Lei Deng , Hongbin Liu , Jiebo Luo , Zhen Lei

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Weihan Wang , Zhen Yang , Bin Xu , Juanzi Li , Yankui Sun

Visual Foresight VLA (VF-VLA) has become a prominent architectural choice in the recent VLA due to its impressive performance. Nevertheless, the inherent design of VF-VLA makes it particularly vulnerable to out-of-distribution (OOD) shifts.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sangwu Park , Wonjoong Kim , Yeonjun In , Sein Kim , Hongseok Kang , Chanyoung Park

Deploying Vision-Language Models (VLMs) on edge devices is challenged by resource constraints and performance degradation under distribution shifts. While test-time adaptation (TTA) can counteract such shifts, existing methods are too…

Artificial Intelligence · Computer Science 2026-02-18 Xin Wang , Hong Jia , Hualin Zhou , Sheng Guang Wang , Yu Zhang , Ting Dang , Tao Gu

Textual prompt tuning has demonstrated significant performance improvements in adapting natural language processing models to a variety of downstream tasks by treating hand-engineered prompts as trainable parameters. Inspired by the success…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Jiachen Sun , Mark Ibrahim , Melissa Hall , Ivan Evtimov , Z. Morley Mao , Cristian Canton Ferrer , Caner Hazirbas