English
Related papers

Related papers: Neural Collapse in Test-Time Adaptation

200 papers

Human Activity Recognition (HAR) models often suffer from performance degradation in real-world applications due to distribution shifts in activity patterns across individuals. Test-Time Adaptation (TTA) is an emerging learning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Shuoyuan Wang , Jindong Wang , HuaJun Xi , Bob Zhang , Lei Zhang , Hongxin Wei

Test-Time Adaptation (TTA) addresses distribution shifts during testing by adapting a pretrained model without access to source data. In this work, we propose a novel TTA approach for 3D point cloud classification, combining sampling…

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Recent studies on Neural Collapse (NC) reveal that, under class-balanced conditions, the class feature means and classifier weights spontaneously align into a simplex equiangular tight frame (ETF). In long-tailed regimes, however, severe…

Machine Learning · Computer Science 2025-12-10 Jinping Wang , Zhiqiang Gao , Zhiwu Xie

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Prior to the deployment of robotic systems, pre-training the deep-recognition models on all potential visual cases is infeasible in practice. Hence, test-time adaptation (TTA) allows the model to adapt itself to novel environments and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junha Song , Kwanyong Park , InKyu Shin , Sanghyun Woo , Chaoning Zhang , In So Kweon

Continual Test Time Adaptation (CTTA) has emerged as a critical approach for bridging the domain gap between the controlled training environments and the real-world scenarios, enhancing model adaptability and robustness. Existing CTTA…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Hyewon Park , Hyejin Park , Jueun Ko , Dongbo Min

Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering…

Machine Learning · Computer Science 2026-05-12 Hans Hao-Hsun Hsu , Shikun Liu , Han Zhao , Pan Li

Test-Time Adaptation (TTA) aims to enhance the generalization of deep learning models when faced with test data that exhibits distribution shifts from the training data. In this context, only a pre-trained model and unlabeled test data are…

Machine Learning · Computer Science 2025-05-19 Linjing You , Jiabao Lu , Xiayuan Huang , Xiangli Nie

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

Graph neural networks (GNNs) have become increasingly popular for classification tasks on graph-structured data. Yet, the interplay between graph topology and feature evolution in GNNs is not well understood. In this paper, we focus on…

Machine Learning · Computer Science 2023-10-27 Vignesh Kothapalli , Tom Tirer , Joan Bruna

Vision-language models (VLMs) like CLIP exhibit strong zero-shot capabilities but often fail to generalize under distribution shifts. Test-time adaptation (TTA) allows models to update at inference time without labeled data, typically via…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Gustavo Adolfo Vargas Hakim , Clément Rambour , Christian Desrosier , Nicolas Thome

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Test-time adaptation (TTA) refers to adapting a classifier for the test data when the probability distribution of the test data slightly differs from that of the training data of the model. To the best of our knowledge, most of the existing…

Machine Learning · Computer Science 2026-01-19 Sravan Danda , Aditya Challa , Shlok Mehendale , Snehanshu Saha

Test-time adaptation (TTA) has increasingly been an important topic to efficiently tackle the cross-domain distribution shift at test time for medical images from different institutions. Previous TTA methods have a common limitation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hongzheng Yang , Cheng Chen , Meirui Jiang , Quande Liu , Jianfeng Cao , Pheng Ann Heng , Qi Dou

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimated pseudo-labels.…

Machine Learning · Computer Science 2024-01-26 Guowei Wang , Changxing Ding , Wentao Tan , Mingkui Tan