English
Related papers

Related papers: On Pitfalls of Test-Time Adaptation

200 papers

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

Machine Learning · Computer Science 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

Prior to the deployment of robotic systems, pre-training the deep-recognition models on all potential visual cases is infeasible in practice. Hence, test-time adaptation (TTA) allows the model to adapt itself to novel environments and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junha Song , Kwanyong Park , InKyu Shin , Sanghyun Woo , Chaoning Zhang , In So Kweon

Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data. CTTA is prone to…

Machine Learning · Computer Science 2024-05-29 Ziqi Shi , Fan Lyu , Ye Liu , Fanhua Shang , Fuyuan Hu , Wei Feng , Zhang Zhang , Liang Wang

Deep learning-based medical image segmentation models often face performance degradation when deployed across various medical centers, largely due to the discrepancies in data distribution. Test Time Adaptation (TTA) methods, which adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Shishuai Hu , Zehui Liao , Zeyou Liu , Yong Xia

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

Machine Learning · Computer Science 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

On-device adapting to continual, unpredictable domain shifts is essential for mobile applications like autonomous driving and augmented reality to deliver seamless user experiences in evolving environments. Test-time adaptation (TTA)…

Machine Learning · Computer Science 2024-10-14 Cheng Fang , Sicong Liu , Zimu Zhou , Bin Guo , Jiaqi Tang , Ke Ma , Zhiwen Yu

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

Machine Learning · Computer Science 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

Machine Learning · Computer Science 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li

Machine learning surrogates are increasingly used in engineering to accelerate costly simulations, yet distribution shifts between training and deployment often cause severe performance degradation (e.g., unseen geometries or…

Machine Learning · Computer Science 2026-02-18 Anna Zimmel , Paul Setinek , Gianluca Galletti , Johannes Brandstetter , Werner Zellinger

Test-time adaptation (TTA) refers to adjusting the model during the testing phase to cope with changes in sample distribution and enhance the model's adaptability to new environments. In real-world scenarios, models often encounter samples…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziqiong Liu , Yushun Tang , Junyang Ji , Zhihai He

Traditional test-time adaptation (TTA) methods face significant challenges in adapting to dynamic environments characterized by continuously changing long-term target distributions. These challenges primarily stem from two factors:…

Machine Learning · Computer Science 2023-11-10 Fahim Faisal Niloy , Sk Miraj Ahmed , Dripta S. Raychaudhuri , Samet Oymak , Amit K. Roy-Chowdhury

Currently, pre-trained language models (PLMs) do not cope well with the distribution shift problem, resulting in models trained on the training set failing in real test scenarios. To address this problem, the test-time adaptation (TTA)…

Computation and Language · Computer Science 2023-04-26 Yi Su , Yixin Ji , Juntao Li , Hai Ye , Min Zhang

Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time. Although test-time training techniques have been explored to enable adaptation, current approaches rely on an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yuning Wang , Pu Zhang , Yuan He , Ke Wang , Jianru Xue

Evaluating robustness under temporal distribution shift remains an open challenge. Existing metrics quantify the average decline in performance, but fail to capture how models adapt to evolving data. As a result, temporal degradation is…

Machine Learning · Computer Science 2026-04-09 Lorenzo Iovine , Giacomo Ziffer , Emanuele Della Valle

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Test-time adaptation (TTA) has increasingly been an important topic to efficiently tackle the cross-domain distribution shift at test time for medical images from different institutions. Previous TTA methods have a common limitation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hongzheng Yang , Cheng Chen , Meirui Jiang , Quande Liu , Jianfeng Cao , Pheng Ann Heng , Qi Dou

Test-Time Adaptation aims to adapt source domain model to testing data at inference stage with success demonstrated in adapting to unseen corruptions. However, these attempts may fail under more challenging real-world scenarios. Existing…

Machine Learning · Computer Science 2025-03-27 Yongyi Su , Xun Xu , Kui Jia

While the design of blind image quality assessment (IQA) algorithms has improved significantly, the distribution shift between the training and testing scenarios often leads to a poor performance of these methods at inference time. This…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Subhadeep Roy , Shankhanil Mitra , Soma Biswas , Rajiv Soundararajan

Multimodal sentiment analysis (MSA) is an emerging research topic that aims to understand and recognize human sentiment or emotions through multiple modalities. However, in real-world dynamic scenarios, the distribution of target data is…

Machine Learning · Computer Science 2025-02-11 Zirun Guo , Tao Jin , Wenlong Xu , Wang Lin , Yangyang Wu