English
Related papers

Related papers: Evaluation of Test-Time Adaptation Under Computati…

200 papers

Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced label distribution shifts. This is often a key obstacle…

Machine Learning · Computer Science 2025-09-08 Shuaicheng Niu , Guohao Chen , Deyu Chen , Yifan Zhang , Jiaxiang Wu , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Chunyan Miao , Mingkui Tan

Currently, pre-trained language models (PLMs) do not cope well with the distribution shift problem, resulting in models trained on the training set failing in real test scenarios. To address this problem, the test-time adaptation (TTA)…

Computation and Language · Computer Science 2023-04-26 Yi Su , Yixin Ji , Juntao Li , Hai Ye , Min Zhang

Test-time adaptation (TTA) refers to adapting a classifier for the test data when the probability distribution of the test data slightly differs from that of the training data of the model. To the best of our knowledge, most of the existing…

Machine Learning · Computer Science 2026-01-19 Sravan Danda , Aditya Challa , Shlok Mehendale , Snehanshu Saha

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

Test time Adaptation is a promising approach for mitigating domain shift in medical image segmentation; however, current evaluations remain limited in terms of modality coverage, task diversity, and methodological consistency. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Wenjing Yu , Shuo Jiang , Yifei Chen , Shuo Chang , Yuanhan Wang , Beining Wu , Jie Dong , Mingxuan Liu , Shenghao Zhu , Feiwei Qin , Changmiao Wang , Qiyuan Tian

This paper proposes a novel test-time adaptation strategy that adjusts the model pre-trained on the source domain using only unlabeled online data from the target domain to alleviate the performance degradation due to the distribution shift…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Sungha Choi , Seunghan Yang , Seokeon Choi , Sungrack Yun

Test-Time Adaptation (TTA) aims to adapt pre-trained models to the target domain during testing. In reality, this adaptability can be influenced by multiple factors. Researchers have identified various challenging scenarios and developed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Chaoqun Du , Yulin Wang , Jiayi Guo , Yizeng Han , Jie Zhou , Gao Huang

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

Test-time augmentation -- the aggregation of predictions across transformed examples of test inputs -- is an established technique to improve the performance of image classification models. Importantly, TTA can be used to improve model…

Machine Learning · Computer Science 2022-06-29 Helen Lu , Divya Shanmugam , Harini Suresh , John Guttag

Current visual detectors, though impressive within their training distribution, often fail to parse out-of-distribution scenes into their constituent entities. Recent test-time adaptation methods use auxiliary self-supervised losses to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Mihir Prabhudesai , Anirudh Goyal , Sujoy Paul , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gaurav Aggarwal , Thomas Kipf , Deepak Pathak , Katerina Fragkiadaki

Test-time adaptation (TTA) methods, which generally rely on the model's predictions (e.g., entropy minimization) to adapt the source pretrained model to the unlabeled target domain, suffer from noisy signals originating from 1) incorrect or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jungsoo Lee , Debasmit Das , Jaegul Choo , Sungha Choi

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while neglecting semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhengqing Gao , Xu-Yao Zhang , Cheng-Lin Liu

Asynchronous methods are fundamental for parallelizing computations in distributed machine learning. They aim to accelerate training by fully utilizing all available resources. However, their greedy approach can lead to inefficiencies using…

Machine Learning · Computer Science 2025-05-23 Artavazd Maranjyan , El Mehdi Saad , Peter Richtárik , Francesco Orabona

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adaptation (TTA) under…

Sound · Computer Science 2024-10-08 Hongfu Liu , Hengguan Huang , Ye Wang

Since distribution shifts are likely to occur after a model's deployment and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model during test-time, leveraging the current test…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Mario Döbler , Florian Marencke , Robert A. Marsden , Bin Yang

Recent video reasoning models have shown strong results on temporal and multimodal understanding, yet they depend on large-scale supervised data and multi-stage training pipelines, making them costly to train and difficult to adapt to new…

In this study, we introduce an intelligent Test Time Augmentation (TTA) algorithm designed to enhance the robustness and accuracy of image classification models against viewpoint variations. Unlike traditional TTA methods that…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Efe Ozturk , Mohit Prabhushankar , Ghassan AlRegib

Video editing is a critical component of content creation that transforms raw footage into coherent works aligned with specific visual and narrative objectives. Existing approaches face two major challenges: temporal inconsistencies due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Jianhui Wang , Yinda Chen , Yangfan He , Xinyuan Song , Yi Xin , Dapeng Zhang , Zhongwei Wan , Bin Li , Rongchao Zhang