English
Related papers

Related papers: On Pitfalls of Test-Time Adaptation

200 papers

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Test-time adaptation (TTA) aims to adapt a pre-trained model to the target domain in a batch-by-batch manner during inference. While label distributions often exhibit imbalances in real-world scenarios, most previous TTA approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghyun Park , Seunghan Yang , Jaegul Choo , Sungrack Yun

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest. Numerous tricks and techniques have been proposed to ensure robust learning on arbitrary streams of unlabeled data.…

Machine Learning · Computer Science 2023-11-13 Saypraseuth Mounsaveng , Florent Chiaroni , Malik Boudiaf , Marco Pedersoli , Ismail Ben Ayed

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

The main challenge in domain generalization (DG) is to handle the distribution shift problem that lies between the training and test data. Recent studies suggest that test-time training (TTT), which adapts the learned model with test data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Liang Chen , Yong Zhang , Yibing Song , Ying Shan , Lingqiao Liu

Test-Time Adaptation (TTA) aims to adapt pre-trained models to the target domain during testing. In reality, this adaptability can be influenced by multiple factors. Researchers have identified various challenging scenarios and developed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Chaoqun Du , Yulin Wang , Jiayi Guo , Yizeng Han , Jie Zhou , Gao Huang

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a…

Machine Learning · Computer Science 2023-02-27 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

Conventional test-time adaptation (TTA) approaches typically adapt the model using only a small fraction of test samples, often those with low-entropy predictions, thereby failing to fully leverage the available information in the test…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nam Nguyen Phuong , Duc Nguyen The Minh , Phi Le Nguyen , Ehsan Abbasnejad , Minh Hoai

Test-time adaptation is a promising research direction that allows the source model to adapt itself to changes in data distribution without any supervision. Yet, current methods are usually evaluated on benchmarks that are only a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Damian Sójka , Sebastian Cygert , Bartłomiej Twardowski , Tomasz Trzciński

Test-time adaptation (TTA) has emerged as a viable solution to adapt pre-trained models to domain shifts using unlabeled test data. However, TTA faces challenges of adaptation failures due to its reliance on blind adaptation to unknown test…

Machine Learning · Computer Science 2024-04-03 Taeckyung Lee , Sorn Chottananurak , Taesik Gong , Sung-Ju Lee

Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering…

Machine Learning · Computer Science 2026-05-12 Hans Hao-Hsun Hsu , Shikun Liu , Han Zhao , Pan Li

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained…

Machine Learning · Computer Science 2025-11-20 Hyeongheon Cha , Dong Min Kim , Hye Won Chung , Taesik Gong , Sung-Ju Lee

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Test-Time Adaptation (TTA) addresses distribution shifts during testing by adapting a pretrained model without access to source data. In this work, we propose a novel TTA approach for 3D point cloud classification, combining sampling…

Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test…

Artificial Intelligence · Computer Science 2024-04-29 Guoliang Lin , Hanjiang Lai , Yan Pan , Jian Yin

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Test-time adaptation (TTA) offers a compelling remedy for machine learning (ML) models that degrade under domain shifts, improving generalisation on-the-fly with only unlabelled samples. This flexibility suits real deployments, yet…

Machine Learning · Computer Science 2026-02-09 Sudarshan Sreeram , Young D. Kwon , Cecilia Mascolo