English
Related papers

Related papers: Rethinking Entropy Minimization in Test-Time Adapt…

200 papers

Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad application potential in real-world scenarios. However, in this…

Machine Learning · Computer Science 2024-12-24 Qi Deng , Shuaicheng Niu , Ronghao Zhang , Yaofo Chen , Runhao Zeng , Jian Chen , Xiping Hu

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Despite progress in end-to-end ASR, real-world domain mismatches still cause performance drops, which Test-Time Adaptation (TTA) aims to mitigate by adjusting models during inference. Recent work explores combining TTA with external…

Computation and Language · Computer Science 2025-06-16 Wei-Ping Huang , Guan-Ting Lin , Hung-yi Lee

Text classification is a fundamental task for natural language processing, and adapting text classification models across domains has broad applications. Self-training generates pseudo-examples from the model's predictions and iteratively…

Computation and Language · Computer Science 2023-08-08 Menglong Lu , Zhen Huang , Zhiliang Tian , Yunxiang Zhao , Xuanyu Fei , Dongsheng Li

Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced label distribution shifts. This is often a key obstacle…

Machine Learning · Computer Science 2025-09-08 Shuaicheng Niu , Guohao Chen , Deyu Chen , Yifan Zhang , Jiaxiang Wu , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Chunyan Miao , Mingkui Tan

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adaptation (TTA) under…

Sound · Computer Science 2024-10-08 Hongfu Liu , Hengguan Huang , Ye Wang

Although deep learning-based end-to-end Automatic Speech Recognition (ASR) has shown remarkable performance in recent years, it suffers severe performance regression on test samples drawn from different data distributions. Test-time…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Guan-Ting Lin , Shang-Wen Li , Hung-yi Lee

A model must adapt itself to generalize to new and different data during testing. In this setting of fully test-time adaptation the model has only the test data and its own parameters. We propose to adapt by test entropy minimization…

Machine Learning · Computer Science 2021-03-19 Dequan Wang , Evan Shelhamer , Shaoteng Liu , Bruno Olshausen , Trevor Darrell

Since experiencing domain shifts during test-time is inevitable in practice, test-time adaption (TTA) continues to adapt the model after deployment. Recently, the area of continual and gradual test-time adaptation (TTA) emerged. In contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Mario Döbler , Robert A. Marsden , Bin Yang

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Pretrained vision-language models (VLMs) like CLIP show strong zero-shot performance but struggle with generalization under distribution shifts. Test-Time Adaptation (TTA) addresses this by adapting VLMs to unlabeled test data in new…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Hamidreza Dastmalchi , Aijun An , Ali cheraghian

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Reliable long-term decoding of surface electromyography (EMG) is hindered by signal drift caused by electrode shifts, muscle fatigue, and posture changes. While state-of-the-art models achieve high intra-session accuracy, their performance…

Machine Learning · Computer Science 2026-01-08 Nia Touko , Matthew O A Ellis , Cristiano Capone , Alessio Burrello , Elisa Donati , Luca Manneschi

Entropy minimization (EM) trains the model to concentrate even more probability mass on its most confident outputs. We show that this simple objective alone, without any labeled data, can substantially improve large language models' (LLMs)…

Machine Learning · Computer Science 2025-05-22 Shivam Agarwal , Zimin Zhang , Lifan Yuan , Jiawei Han , Hao Peng

Keyword spotting (KWS) identifies words for voice assistants, but environmental noise frequently reduces accuracy. Standard adaptation fixes this issue and strictly requires original or labeled audio. Test time adaptation (TTA) solves this…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Hanyu Ding , Yang Xiao , Jiaheng Dong , Ting Dang

Test-time adaptation (TTA) updates models during inference to reduce error on distribution shifts. While entropy minimization over the output distribution has proven effective as a TTA loss, we study using the intermediate distributions…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yash Mali , Evan Shelhamer

Test-time adaptation (TTA) is a task that continually adapts a pre-trained source model to the target domain during inference. One popular approach involves fine-tuning model with cross-entropy loss according to estimated pseudo-labels.…

Machine Learning · Computer Science 2024-01-26 Guowei Wang , Changxing Ding , Wentao Tan , Mingkui Tan

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li