中文
相关论文

相关论文: Neural Collapse in Test-Time Adaptation

200 篇论文

Continual Test-time adaptation (CTTA) continuously adapts the deployed model on every incoming batch of data. While achieving optimal accuracy, existing CTTA approaches present poor real-world applicability on resource-constrained edge…

机器学习 · 计算机科学 2026-04-21 Xiao Ma , Young D. Kwon , Dong Ma

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

机器学习 · 计算机科学 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

Since experiencing domain shifts during test-time is inevitable in practice, test-time adaption (TTA) continues to adapt the model after deployment. Recently, the area of continual and gradual test-time adaptation (TTA) emerged. In contrast…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Mario Döbler , Robert A. Marsden , Bin Yang

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

机器学习 · 计算机科学 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Powerful as they are, graph neural networks (GNNs) are known to be vulnerable to distribution shifts. Recently, test-time adaptation (TTA) has attracted attention due to its ability to adapt a pre-trained model to a target domain, without…

机器学习 · 计算机科学 2025-02-13 Wenxuan Bao , Zhichen Zeng , Zhining Liu , Hanghang Tong , Jingrui He

Test-time alignment (TTA) aims to adapt models to specific rewards during inference. However, existing methods tend to either under-optimise or over-optimise (reward hack) the target reward function. We propose Null-Text Test-Time Alignment…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Taehoon Kim , Henry Gouk , Timothy Hospedales

Test-time adaptation (TTA) enhances the zero-shot robustness under distribution shifts by leveraging unlabeled test data during inference. Despite notable advances, several challenges still limit its broader applicability. First, most…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Youjia Zhang , Youngeun Kim , Young-Geun Choi , Hongyeob Kim , Huiling Liu , Sungeun Hong

Image-to-image translation has emerged as a powerful technique in medical imaging, enabling tasks such as image denoising and cross-modality conversion. However, it suffers from limitations in handling out-of-distribution samples without…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Irene Iele , Francesco Di Feola , Valerio Guarrasi , Paolo Soda

Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Jingjie Guo , Weitong Zhang , Matthew Sinclair , Daniel Rueckert , Chen Chen

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Recurrent Neural Networks (RNNs) have emerged as an interesting alternative to conventional material modeling approaches, particularly for nonlinear path dependent materials. Remarkable computational enhancements are obtained using RNNs…

计算工程、金融与科学 · 计算机科学 2024-09-05 Petter Uvdal , Mohsen Mirkhalaf

Continual test-time adaptation aims to continuously adapt a pre-trained model to a stream of target domain data without accessing source data. Without access to source domain data, the model focuses solely on the feature characteristics of…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Wenting Yin , Han Sun , Xinru Meng , Ningzhong Liu , Huiyu Zhou

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

机器学习 · 计算机科学 2025-02-06 Minguk Jang , Hye Won Chung

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Neural Collapse (NC) is a well-known phenomenon of deep neural networks in the terminal phase of training (TPT). It is characterized by the collapse of features and classifier into a symmetrical structure, known as simplex equiangular tight…

机器学习 · 计算机科学 2023-10-13 Peifeng Gao , Qianqian Xu , Yibo Yang , Peisong Wen , Huiyang Shao , Zhiyong Yang , Bernard Ghanem , Qingming Huang

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Deep learning models often struggle with generalization when deploying on real-world data, due to the common distributional shift to the training data. Test-time adaptation (TTA) is an emerging scheme used at inference time to address this…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Mingxi Lei , Chunwei Ma , Meng Ding , Yufan Zhou , Ziyun Huang , Jinhui Xu

With the ever-increasing complexity of large-scale pre-trained models coupled with a shortage of labeled data for downstream training, transfer learning has become the primary approach in many fields, including natural language processing,…

机器学习 · 计算机科学 2024-07-22 Xiao Li , Sheng Liu , Jinxin Zhou , Xinyu Lu , Carlos Fernandez-Granda , Zhihui Zhu , Qing Qu

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

计算机视觉与模式识别 · 计算机科学 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad