English
Related papers

Related papers: A Layer Selection Approach to Test Time Adaptation

200 papers

Recently, test time adaptation (TTA) has attracted increasing attention due to its power of handling the distribution shift issue in the real world. Unlike what has been developed for convolutional neural networks (CNNs) for image data, TTA…

Machine Learning · Computer Science 2022-08-22 Guanzi Chen , Jiying Zhang , Xi Xiao , Yang Li

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

A robot's deployment environment often involves perceptual changes that differ from what it has experienced during training. Standard practices such as data augmentation attempt to bridge this gap by augmenting source images in an effort to…

Machine Learning · Computer Science 2022-05-18 Takuma Yoneda , Ge Yang , Matthew R. Walter , Bradly Stadie

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

Training on test-time data enables deep learning models to adapt to dynamic environmental changes, enhancing their practical applicability. Online adaptation from source to target domains is promising but it remains highly reliant on the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jisu Han , Jihee Park , Dongyoon Han , Wonjun Hwang

Continual Test-Time Adaptation (CTTA) aims to adapt a pre-trained model to a sequence of target domains during the test phase without accessing the source data. To adapt to unlabeled data from unknown domains, existing methods rely on…

Machine Learning · Computer Science 2024-07-15 Jiayao Tan , Fan Lyu , Chenggong Ni , Tingliang Feng , Fuyuan Hu , Zhang Zhang , Shaochuang Zhao , Liang Wang

Many recent machine learning tasks focus to develop models that can generalize to unseen distributions. Domain generalization (DG) has become one of the key topics in various fields. Several literatures show that DG can be arbitrarily hard…

Machine Learning · Computer Science 2023-05-11 Yi-Fan Zhang , Xue Wang , Kexin Jin , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

Domain shift is a prominent problem in Deep Learning, causing a model pre-trained on a source dataset to suffer significant performance degradation on test datasets. This research aims to address the issue of audio classification under…

Machine Learning · Computer Science 2025-07-22 Weichuang Shao , Iman Yi Liao , Tomas Henrique Bode Maul , Tissa Chandesa

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zishu Zhou , Zaipeng Xie , Xuanyao Jie

Distribution shifts between sites can seriously degrade model performance since models are prone to exploiting unstable correlations. Thus, many methods try to find features that are stable across sites and discard unstable features.…

Machine Learning · Computer Science 2024-09-11 Minh Nguyen , Alan Q. Wang , Heejong Kim , Mert R. Sabuncu

Test Time Adaptation (TTA) is a pivotal concept in machine learning, enabling models to perform well in real-world scenarios, where test data distribution differs from training. In this work, we propose a novel approach called pseudo Source…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Manogna Sreenivas , Goirik Chakrabarty , Soma Biswas

Continual Test-Time Adaptation (CTTA) aims to adapt a source pre-trained model to continually changing target domains during inference. As a fundamental principle, an ideal CTTA method should rapidly adapt to new domains (exploration) while…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Pinci Yang , Peisong Wen , Ke Ma , Qianqian Xu

Test-time adaptation (TTA) has emerged as a promising paradigm to handle the domain shifts at test time for medical images from different institutions without using extra training data. However, existing TTA solutions for segmentation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Chuyan Zhang , Hao Zheng , Xin You , Yefeng Zheng , Yun Gu

Domain alignment (DA) has been widely used in unsupervised domain adaptation. Many existing DA methods assume that a low source risk, together with the alignment of distributions of source and target, means a low target risk. In this paper,…

Machine Learning · Computer Science 2020-06-12 Yueming Yin , Zhen Yang , Haifeng Hu , Xiaofu Wu

Continual test-time domain adaptation (CTTA) aims to adjust pre-trained source models to perform well over time across non-stationary target environments. While previous methods have made considerable efforts to optimize the adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yanshuo Wang , Xuesong Li , Jinguang Tong , Jie Hong , Jun Lan , Weiqiang Wang , Huijia Zhu , Haoxing Chen

Current visual detectors, though impressive within their training distribution, often fail to parse out-of-distribution scenes into their constituent entities. Recent test-time adaptation methods use auxiliary self-supervised losses to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Mihir Prabhudesai , Anirudh Goyal , Sujoy Paul , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gaurav Aggarwal , Thomas Kipf , Deepak Pathak , Katerina Fragkiadaki

Although debiased large language models (LLMs) excel at handling known or low-bias prompts, they often fail on unfamiliar and high-bias prompts. We demonstrate via out-of-distribution (OOD) detection that these high-bias prompts cause a…

Computation and Language · Computer Science 2026-04-20 Hanwen Shen , Ting Ying , Jiajie Lu , Shanshan Wang

Test-time adaptation (TTA) enables efficient adaptation of deployed models, yet it often leads to poorly calibrated predictive uncertainty - a critical issue in high-stakes domains such as autonomous driving, finance, and healthcare.…

Machine Learning · Computer Science 2025-12-09 Gilhyun Nam , Taewon Kim , Joonhyun Jeong , Eunho Yang

Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth cannot be obtained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yeonguk Yu , Sungho Shin , Seunghyeok Back , Minhwan Ko , Sangjun Noh , Kyoobin Lee