English
Related papers

Related papers: Test-Time Adaptation with Perturbation Consistency…

200 papers

Deep neural networks demonstrate strong performance under aligned training-test distributions. However, real-world test data often exhibit domain shifts. Test-Time Adaptation (TTA) addresses this challenge by adapting the model to test data…

Artificial Intelligence · Computer Science 2025-08-27 Byung-Joon Lee , Jin-Seop Lee , Jee-Hyong Lee

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence…

Machine Learning · Computer Science 2024-09-17 Afshar Shamsi , Rejisa Becirovic , Ahmadreza Argha , Ehsan Abbasnejad , Hamid Alinejad-Rokny , Arash Mohammadi

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

Machine Learning · Computer Science 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

Previous works on depression detection use datasets collected in similar environments to train and test the models. In practice, however, the train and test distributions cannot be guaranteed to be identical. Distribution shifts can be…

Machine Learning · Computer Science 2024-04-09 Sri Harsha Dumpala , Chandramouli Shama Sastry , Rudolf Uher , Sageev Oore

Test-Time Adaptation aims to adapt source domain model to testing data at inference stage with success demonstrated in adapting to unseen corruptions. However, these attempts may fail under more challenging real-world scenarios. Existing…

Machine Learning · Computer Science 2025-03-27 Yongyi Su , Xun Xu , Kui Jia

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

Machine Learning · Computer Science 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

Machine Learning · Computer Science 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

Test-time scaling paradigms have significantly advanced the capabilities of large language models (LLMs) on complex tasks. Despite their empirical success, theoretical understanding of the sample efficiency of various test-time strategies…

Machine Learning · Computer Science 2025-06-13 Baihe Huang , Shanda Li , Tianhao Wu , Yiming Yang , Ameet Talwalkar , Kannan Ramchandran , Michael I. Jordan , Jiantao Jiao

Recently, test-time adaptation has garnered attention as a method for tuning models without labeled data. The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time primarily focuses on tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Raza Imam , Asif Hanif , Jian Zhang , Khaled Waleed Dawoud , Yova Kementchedjhieva , Mohammad Yaqub

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Continual test-time adaptation (CTTA) has recently emerged to adapt a pre-trained source model to continuously evolving target distributions, which accommodates the dynamic nature of real-world environments. To mitigate the risk of…

Machine Learning · Computer Science 2024-12-13 Chaoran Cui , Yongrui Zhen , Shuai Gong , Chunyun Zhang , Hui Liu , Yilong Yin

Remote physiological measurement (RPM) has emerged as a promising non-invasive method for monitoring physiological signals using the non-contact device. Although various domain adaptation and generalization methods were proposed to promote…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiao Yang , Jiyao Wang , Yuxuan Fan , Can Liu , Houcheng Su , Weichen Guo , Zitong Yu , Dengbo He , Kaishun Wu

Continual Test-Time Adaptation (CTTA) aims to adapt a source pre-trained model to continually changing target domains during inference. As a fundamental principle, an ideal CTTA method should rapidly adapt to new domains (exploration) while…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Pinci Yang , Peisong Wen , Ke Ma , Qianqian Xu

Continual Learning (CL) seeks to enable neural networks to incrementally acquire new knowledge (plasticity) while retaining existing knowledge (stability). Although pre-trained models (PTMs) have provided a strong foundation for CL,…

Machine Learning · Computer Science 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Chunhui Ding , Yanan Sun

Vision-language models (VLMs), despite their extraordinary zero-shot capabilities, are vulnerable to distribution shifts. Test-time adaptation (TTA) emerges as a predominant strategy to adapt VLMs to unlabeled test data on the fly. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Zhichen Zeng , Wenxuan Bao , Xiao Lin , Ruizhong Qiu , Tianxin Wei , Xuying Ning , Yuchen Yan , Chen Luo , Monica Xiao Cheng , Jingrui He , Hanghang Tong

Large Language Models (LLMs), already shown to ace various unstructured text comprehension tasks, have also remarkably been shown to tackle table (structured) comprehension tasks without specific training. Building on earlier studies of…

Computation and Language · Computer Science 2025-08-27 Kushal Raj Bhandari , Sixue Xing , Soham Dan , Jianxi Gao

Pre-trained language models (PLMs) have become a prevalent technique in deep learning for code, utilizing a two-stage pre-training and fine-tuning procedure to acquire general knowledge about code and specialize in a variety of downstream…

Software Engineering · Computer Science 2024-01-05 Martin Weyssow , Xin Zhou , Kisub Kim , David Lo , Houari Sahraoui