English
Related papers

Related papers: Unsupervised Layer-Wise Dynamic Test Time Adaptati…

200 papers

The static ``train then deploy" paradigm fundamentally limits Large Language Models (LLMs) from dynamically adapting their weights in response to continuous streams of new information inherent in real-world tasks. Test-Time Training (TTT)…

Machine Learning · Computer Science 2026-04-08 Guhao Feng , Shengjie Luo , Kai Hua , Ge Zhang , Di He , Wenhao Huang , Tianle Cai

Test-time augmentation -- the aggregation of predictions across transformed examples of test inputs -- is an established technique to improve the performance of image classification models. Importantly, TTA can be used to improve model…

Machine Learning · Computer Science 2022-06-29 Helen Lu , Divya Shanmugam , Harini Suresh , John Guttag

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the…

Machine Learning · Computer Science 2022-11-24 Sachin Goyal , Mingjie Sun , Aditi Raghunathan , Zico Kolter

Test-time adaptation (TTA) offers a compelling remedy for machine learning (ML) models that degrade under domain shifts, improving generalisation on-the-fly with only unlabelled samples. This flexibility suits real deployments, yet…

Machine Learning · Computer Science 2026-02-09 Sudarshan Sreeram , Young D. Kwon , Cecilia Mascolo

One fascinating aspect of pre-trained Audio-Language Models (ALMs) learning is their impressive zero-shot generalization capability and test-time adaptation (TTA) methods aiming to improve domain performance without annotations. However,…

Sound · Computer Science 2024-12-24 Gongyu Chen , Haomin Zhang , Chaofan Ding , Zihao Chen , Xinhan Di

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xinru Meng , Han Sun , Jiamei Liu , Ningzhong Liu , Huiyu Zhou

Conventional test-time adaptation (TTA) approaches typically adapt the model using only a small fraction of test samples, often those with low-entropy predictions, thereby failing to fully leverage the available information in the test…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nam Nguyen Phuong , Duc Nguyen The Minh , Phi Le Nguyen , Ehsan Abbasnejad , Minh Hoai

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Test-Time Adaptation (TTA) allows to update pre-trained models to changing data distributions at deployment time. While early work tested these algorithms for individual fixed distribution shifts, recent work proposed and applied methods…

Machine Learning · Computer Science 2024-04-04 Ori Press , Steffen Schneider , Matthias Kümmerer , Matthias Bethge

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

Machine Learning · Computer Science 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Large language models (LLMs) are typically deployed with fixed parameters, and their performance is often improved by allocating more computation at inference time. While such test-time scaling can be effective, it cannot correct model…

Computation and Language · Computer Science 2026-05-15 Chaehee Song , Minseok Seo , Yeeun Seong , Doyi Kim , Changick Kim

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Tactile-vision-language (TVL) models are increasingly deployed in real-world robotic and multimodal perception tasks, where test-time distribution shifts are unavoidable. Existing test-time adaptation (TTA) methods provide filtering in…

Robotics · Computer Science 2026-02-19 Chuyang Ye , Haoxian Jing , Qinting Jiang , Yixi Lin , Qiang Li , Xing Tang , Jingyan Jiang

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad application potential in real-world scenarios. However, in this…

Machine Learning · Computer Science 2024-12-24 Qi Deng , Shuaicheng Niu , Ronghao Zhang , Yaofo Chen , Runhao Zeng , Jian Chen , Xiping Hu

Personalized federated learning algorithms have shown promising results in adapting models to various distribution shifts. However, most of these methods require labeled data on testing clients for personalization, which is usually…

Machine Learning · Computer Science 2023-10-31 Wenxuan Bao , Tianxin Wei , Haohan Wang , Jingrui He

Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging test-time…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yunhe Gao , Xingjian Shi , Yi Zhu , Hao Wang , Zhiqiang Tang , Xiong Zhou , Mu Li , Dimitris N. Metaxas

Test-time Adaptation (TTA) adapts a given model to testing domain data with potential domain shifts through online unsupervised learning, yielding impressive performance. However, to date, existing TTA methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Chang'an Yi , Xiaohui Deng , Guohao Chen , Yan Zhou , Qinghua Lu , Shuaicheng Niu