English
Related papers

Related papers: Neural Collapse in Test-Time Adaptation

200 papers

Continual Test-time adaptation (CTTA) continuously adapts the deployed model on every incoming batch of data. While achieving optimal accuracy, existing CTTA approaches present poor real-world applicability on resource-constrained edge…

Machine Learning · Computer Science 2026-04-21 Xiao Ma , Young D. Kwon , Dong Ma

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

Machine Learning · Computer Science 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

Since experiencing domain shifts during test-time is inevitable in practice, test-time adaption (TTA) continues to adapt the model after deployment. Recently, the area of continual and gradual test-time adaptation (TTA) emerged. In contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Mario Döbler , Robert A. Marsden , Bin Yang

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Powerful as they are, graph neural networks (GNNs) are known to be vulnerable to distribution shifts. Recently, test-time adaptation (TTA) has attracted attention due to its ability to adapt a pre-trained model to a target domain, without…

Machine Learning · Computer Science 2025-02-13 Wenxuan Bao , Zhichen Zeng , Zhining Liu , Hanghang Tong , Jingrui He

Test-time alignment (TTA) aims to adapt models to specific rewards during inference. However, existing methods tend to either under-optimise or over-optimise (reward hack) the target reward function. We propose Null-Text Test-Time Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Taehoon Kim , Henry Gouk , Timothy Hospedales

Test-time adaptation (TTA) enhances the zero-shot robustness under distribution shifts by leveraging unlabeled test data during inference. Despite notable advances, several challenges still limit its broader applicability. First, most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Youjia Zhang , Youngeun Kim , Young-Geun Choi , Hongyeob Kim , Huiling Liu , Sungeun Hong

Image-to-image translation has emerged as a powerful technique in medical imaging, enabling tasks such as image denoising and cross-modality conversion. However, it suffers from limitations in handling out-of-distribution samples without…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Irene Iele , Francesco Di Feola , Valerio Guarrasi , Paolo Soda

Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jingjie Guo , Weitong Zhang , Matthew Sinclair , Daniel Rueckert , Chen Chen

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Recurrent Neural Networks (RNNs) have emerged as an interesting alternative to conventional material modeling approaches, particularly for nonlinear path dependent materials. Remarkable computational enhancements are obtained using RNNs…

Computational Engineering, Finance, and Science · Computer Science 2024-09-05 Petter Uvdal , Mohsen Mirkhalaf

Continual test-time adaptation aims to continuously adapt a pre-trained model to a stream of target domain data without accessing source data. Without access to source domain data, the model focuses solely on the feature characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Wenting Yin , Han Sun , Xinru Meng , Ningzhong Liu , Huiyu Zhou

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Neural Collapse (NC) is a well-known phenomenon of deep neural networks in the terminal phase of training (TPT). It is characterized by the collapse of features and classifier into a symmetrical structure, known as simplex equiangular tight…

Machine Learning · Computer Science 2023-10-13 Peifeng Gao , Qianqian Xu , Yibo Yang , Peisong Wen , Huiyang Shao , Zhiyong Yang , Bernard Ghanem , Qingming Huang

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Deep learning models often struggle with generalization when deploying on real-world data, due to the common distributional shift to the training data. Test-time adaptation (TTA) is an emerging scheme used at inference time to address this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mingxi Lei , Chunwei Ma , Meng Ding , Yufan Zhou , Ziyun Huang , Jinhui Xu

With the ever-increasing complexity of large-scale pre-trained models coupled with a shortage of labeled data for downstream training, transfer learning has become the primary approach in many fields, including natural language processing,…

Machine Learning · Computer Science 2024-07-22 Xiao Li , Sheng Liu , Jinxin Zhou , Xinyu Lu , Carlos Fernandez-Granda , Zhihui Zhu , Qing Qu

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad