English
Related papers

Related papers: Efficient Test-Time Adaptation through Latent Subs…

200 papers

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

We study the domain adaptation problem with label shift in this work. Under the label shift context, the marginal distribution of the label varies across the training and testing datasets, while the conditional distribution of features…

Machine Learning · Statistics 2023-05-31 Qinglong Tian , Xin Zhang , Jiwei Zhao

Test-time adaptation (TTA) aims to mitigate performance degradation under distribution shifts by updating model parameters during inference. Existing approaches have primarily framed adaptation around affine modulation, focusing on…

Machine Learning · Computer Science 2026-03-30 Hyeongyu Kim , Geonhui Han , Dosik Hwang

Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions, addressing real-world dynamism. Existing CTTA methods mainly rely on entropy minimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Ran Xu , Senqiao Yang , Renrui Zhang , Qizhe Zhang , Zehui Chen , Yandong Guo , Shanghang Zhang

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimated pseudo-labels.…

Machine Learning · Computer Science 2024-01-26 Guowei Wang , Changxing Ding , Wentao Tan , Mingkui Tan

Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift. While most TTA research focuses on the adaptation objective, practical streams also depend critically on the memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Shyma Alhuwaider , Yasmeen Alsaedy , Merey Ramazanova , Silvio Giancola , Bernard Ghanem

Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced label distribution shifts. This is often a key obstacle…

Machine Learning · Computer Science 2025-09-08 Shuaicheng Niu , Guohao Chen , Deyu Chen , Yifan Zhang , Jiaxiang Wu , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Chunyan Miao , Mingkui Tan

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li

Test-Time Adaptation (TTA) aims to mitigate distributional shifts between training and test domains during inference time. However, existing TTA methods fall short in the realistic scenario where models face both continually changing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yingkai Yang , Chaoqi Chen , Hui Huang

The Efficient Adaptive Transformer (EAT) framework unifies three adaptive efficiency techniques - progressive token pruning, sparse attention, and dynamic early exiting - into a single, reproducible architecture for input-adaptive…

Computation and Language · Computer Science 2025-10-16 Jan Miller

Vision-Language Models (VLMs) such as CLIP enable strong zero-shot recognition but suffer substantial degradation under distribution shifts. Test-Time Adaptation (TTA) aims to improve robustness using only unlabeled test samples, yet most…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sanggeon Yun , Ryozo Masukawa , SungHeon Jeong , Wenjun Huang , Hanning Chen , Mohsen Imani

Open-set test-time adaptation (OSTTA) addresses the challenge of adapting models to new environments where out-of-distribution (OOD) samples coexist with in-distribution (ID) samples affected by distribution shifts. In such settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Wenjie Zhao , Jia Li , Xin Dong , Yapeng Tian , Yu Xiang , Yunhui Guo

Accurately predicting traffic accidents in real-time is a critical challenge in autonomous driving, particularly in resource-constrained environments. Existing solutions often suffer from high computational overhead or fail to adequately…

Computational Engineering, Finance, and Science · Computer Science 2025-04-11 Jiaxun Zhang , Yanchen Guan , Chengyue Wang , Haicheng Liao , Guohui Zhang , Zhenning Li

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

On-device training is an emerging approach in machine learning where models are trained on edge devices, aiming to enhance privacy protection and real-time performance. However, edge devices typically possess restricted computational power…

Machine Learning · Computer Science 2023-12-27 Ziyu Lin , Enzo Tartaglione , Van-Tam Nguyen

Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest. Numerous tricks and techniques have been proposed to ensure robust learning on arbitrary streams of unlabeled data.…

Machine Learning · Computer Science 2023-11-13 Saypraseuth Mounsaveng , Florent Chiaroni , Malik Boudiaf , Marco Pedersoli , Ismail Ben Ayed

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Test-time adaptation (TTA) of 3D point clouds is crucial for mitigating discrepancies between training and testing samples in real-world scenarios, particularly when handling corrupted point clouds. LiDAR data, for instance, can be affected…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hamidreza Dastmalchi , Aijun An , Ali Cheraghian , Shafin Rahman , Sameera Ramasinghe

The ability to accurately comprehend natural language instructions and navigate to the target location is essential for an embodied agent. Such agents are typically required to execute user instructions in an online manner, leading us to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Junyu Gao , Xuan Yao , Changsheng Xu

Continual Test-Time Adaptation (CTTA) generalizes conventional Test-Time Adaptation (TTA) by assuming that the target domain is dynamic over time rather than stationary. In this paper, we explore Multi-Modal Continual Test-Time Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haozhi Cao , Yuecong Xu , Jianfei Yang , Pengyu Yin , Shenghai Yuan , Lihua Xie