English
Related papers

Related papers: Higher-Order Asymptotics of Test-Time Adaptation f…

200 papers

Test-time adaptation (TTA) has emerged as a viable solution to adapt pre-trained models to domain shifts using unlabeled test data. However, TTA faces challenges of adaptation failures due to its reliance on blind adaptation to unknown test…

Machine Learning · Computer Science 2024-04-03 Taeckyung Lee , Sorn Chottananurak , Taesik Gong , Sung-Ju Lee

Electroencephalography (EEG) foundation models have shown strong potential for learning generalizable representations from large-scale neural data, yet their clinical deployment is hindered by distribution shifts across clinical settings,…

Machine Learning · Computer Science 2026-04-21 Gabriel Jason Lee , Jathurshan Pradeepkumar , Jimeng Sun

Test-Time adaptation (TTA) aims to enhance model robustness against distribution shifts through rapid model adaptation during inference. While existing TTA methods often rely on entropy-based unsupervised training and achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zixuan Hu , Yichun Hu , Ling-Yu Duan

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

Machine Learning · Computer Science 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

Test-time adaptation (TTA) enables neural forecasters to adapt to distribution shifts in streaming time series, but existing methods apply the same adaptation intensity regardless of the nature of the shift. We propose Regime-Guided…

Machine Learning · Computer Science 2026-03-31 Indar Kumar , Akanksha Tiwari , Sai Krishna Jasti , Ankit Hemant Lade

We investigate saddlepoint approximations applied to the score test statistic in genome-wide association studies with binary phenotypes. The inaccuracy in the normal approximation of the score test statistic increases with increasing sample…

We present a simple and effective way to estimate the batch-norm statistics during test time, to fast adapt a source model to target test samples. Known as Test-Time Adaptation, most prior works studying this task follow two assumptions in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Xuefeng Hu , Gokhan Uzunbas , Sirius Chen , Rui Wang , Ashish Shah , Ram Nevatia , Ser-Nam Lim

With the rise of Deep Neural Networks, machine learning systems are nowadays ubiquitous in a number of real-world applications, which bears the need for highly reliable models. This requires a thorough look not only at the accuracy of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Tiago Barros , Rui L. Lopes , Cristiano Premebida , Urbano J. Nunes

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

Machine learning surrogates are increasingly used in engineering to accelerate costly simulations, yet distribution shifts between training and deployment often cause severe performance degradation (e.g., unseen geometries or…

Machine Learning · Computer Science 2026-02-18 Anna Zimmel , Paul Setinek , Gianluca Galletti , Johannes Brandstetter , Werner Zellinger

Test-time adaptation (TTA) has increasingly been an important topic to efficiently tackle the cross-domain distribution shift at test time for medical images from different institutions. Previous TTA methods have a common limitation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hongzheng Yang , Cheng Chen , Meirui Jiang , Quande Liu , Jianfeng Cao , Pheng Ann Heng , Qi Dou

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Continual Test-Time Adaptation (CTTA) task investigates effective domain adaptation under the scenario of continuous domain shifts during testing time. Due to the utilization of solely unlabeled samples, there exists significant uncertainty…

Machine Learning · Computer Science 2025-12-18 Fan Lyu , Kaile Du , Yuyang Li , Hanyu Zhao , Fuyuan Hu , Zhang Zhang , Guangcan Liu , Liang Wang

Multi-modal test-time adaptation (TTA) enhances the resilience of benchmark multi-modal models against distribution shifts by leveraging the unlabeled target data during inference. Despite the documented success, the advancement of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Jinglin Xu , Yi Li , Chuxiong Sun , Xiao Xu , Jiangmeng Li , Fanjiang Xu

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Test time adaptation (TTA) has emerged as a promising solution to adapt pre-trained models to new, unseen data distributions using unlabeled target domain data. However, most TTA methods are designed for independent data, often overlooking…

Machine Learning · Computer Science 2026-01-21 Ting Dang , Soumyajit Chatterjee , Hong Jia , Yu Wu , Flora Salim , Fahim Kawsar