English
Related papers

Related papers: Adaptive Debiasing Tsallis Entropy for Test-Time A…

200 papers

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a…

Machine Learning · Computer Science 2023-02-27 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

In an earlier study, we showed that Tsallis relative entropy (TRE), which is the generalization of Kullback-Leibler relative entropy (KLRE) to non-extensive systems, can be used as a possible risk measure in constructing risk optimal…

Statistical Finance · Quantitative Finance 2022-05-30 Sandhya Devi , Sherman Page

Test-time adaptation aims to adapt pre-trained deep neural networks using solely online unlabelled test data during inference. Although TTA has shown promise in visual applications, its potential in time series contexts remains largely…

Machine Learning · Computer Science 2025-01-06 Peiliang Gong , Mohamed Ragab , Min Wu , Zhenghua Chen , Yongyi Su , Xiaoli Li , Daoqiang Zhang

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

Test-Time adaptation (TTA) aims to enhance model robustness against distribution shifts through rapid model adaptation during inference. While existing TTA methods often rely on entropy-based unsupervised training and achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zixuan Hu , Yichun Hu , Ling-Yu Duan

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimated pseudo-labels.…

Machine Learning · Computer Science 2024-01-26 Guowei Wang , Changxing Ding , Wentao Tan , Mingkui Tan

Self-training methods have been explored in recent years and have exhibited great performance in improving semi-supervised learning. This work presents a Simple instance-Adaptive self-Training method (SAT) for semi-supervised text…

Computation and Language · Computer Science 2022-10-25 Hui Chen , Wei Han , Soujanya Poria

Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth cannot be obtained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yeonguk Yu , Sungho Shin , Seunghyeok Back , Minhwan Ko , Sangjun Noh , Kyoobin Lee

Vision-language models (VLMs) such as CLIP exhibit strong Out-of-distribution (OOD) detection capabilities by aligning visual and textual representations. Recent CLIP-based test-time adaptation methods further improve detection performance…

Computation and Language · Computer Science 2026-04-20 Jinlun Ye , Jiang Liao , Runhe Lai , Xinhua Lu , Jiaxin Zhuang , Zhiyong Gan , Ruixuan Wang

Test-time adaptation (TTA) fine-tunes pre-trained deep neural networks for unseen test data. The primary challenge of TTA is limited access to the entire test dataset during online updates, causing error accumulation. To mitigate it, TTA…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jonghyun Lee , Dahuin Jung , Saehyung Lee , Junsung Park , Juhyeon Shin , Uiwon Hwang , Sungroh Yoon

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Automatic speech recognition (ASR) models are frequently exposed to data distribution shifts in many real-world scenarios, leading to erroneous predictions. To tackle this issue, an existing test-time adaptation (TTA) method has recently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Changhun Kim , Joonhyung Park , Hajin Shim , Eunho Yang

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adaptation (TTA) under…

Sound · Computer Science 2024-10-08 Hongfu Liu , Hengguan Huang , Ye Wang

Attacking semantic segmentation models is significantly harder than image classification models because an attacker must flip thousands of pixel predictions simultaneously. Standard pixel-wise cross-entropy (CE) is ill-suited to this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Alexander Matyasko , Xin Lou , Indriyati Atmosukarto , Wei Zhang