English
Related papers

Related papers: ZOTTA: Test-Time Adaptation with Gradient-Free Zer…

200 papers

Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift. While most TTA research focuses on the adaptation objective, practical streams also depend critically on the memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Shyma Alhuwaider , Yasmeen Alsaedy , Merey Ramazanova , Silvio Giancola , Bernard Ghanem

Test Time Adaptation (TTA) addresses the problem of distribution shift by adapting a pretrained model to a new domain during inference. When faced with challenging shifts, most methods collapse and perform worse than the original pretrained…

Machine Learning · Computer Science 2025-02-25 Sabyasachi Sahoo , Mostafa ElAraby , Jonas Ngnawe , Yann Pequignot , Frederic Precioso , Christian Gagne

Fine-tuning large language models (LLMs) has achieved remarkable success across various NLP tasks, but the substantial memory overhead during backpropagation remains a critical bottleneck, especially as model scales grow. Zeroth-order (ZO)…

Computation and Language · Computer Science 2026-01-09 Feihu Jin , Shipeng Cen , Ying Tan

Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad application potential in real-world scenarios. However, in this…

Machine Learning · Computer Science 2024-12-24 Qi Deng , Shuaicheng Niu , Ronghao Zhang , Yaofo Chen , Runhao Zeng , Jian Chen , Xiping Hu

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Real-world systems often encounter new data over time, which leads to experiencing target domain shifts. Existing Test-Time Adaptation (TTA) methods tend to apply computationally heavy and memory-intensive backpropagation-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yanshuo Wang , Ali Cheraghian , Zeeshan Hayder , Jie Hong , Sameera Ramasinghe , Shafin Rahman , David Ahmedt-Aristizabal , Xuesong Li , Lars Petersson , Mehrtash Harandi

Zeroth-order (ZO) optimization is popular in real-world applications that accessing the gradient information is expensive or unavailable. Recently, adaptive ZO methods that normalize gradient estimators by the empirical standard deviation…

Optimization and Control · Mathematics 2026-02-03 Haishan Ye , Luo Luo

The practical utility of Speech Emotion Recognition (SER) systems is undermined by their fragility to domain shifts, such as speaker variability, the distinction between acted and naturalistic emotions, and cross-corpus variations. While…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Jiaheng Dong , Hong Jia , Ting Dang

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li

In Test-time Adaptation (TTA), given a source model, the goal is to adapt it to make better predictions for test instances from a different distribution than the source. Crucially, TTA assumes no access to the source data or even any…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Ansh Khurana , Sujoy Paul , Piyush Rai , Soma Biswas , Gaurav Aggarwal

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

Machine Learning · Computer Science 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

This paper introduces a class of model-free feedback methods for solving generic constrained optimization problems where the specific mathematical forms of the objective and constraint functions are not available. The proposed methods,…

Optimization and Control · Mathematics 2025-02-13 Xin Chen , Jorge I. Poveda , Na Li

Test-Time Adaptation (TTA) offers a practical solution for deploying image segmentation models under domain shift without accessing source data or retraining. Among existing TTA strategies, pseudo-label-based methods have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Jianghao Wu , Xiangde Luo , Yubo Zhou , Lianming Wu , Guotai Wang , Shaoting Zhang

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Continual Test-Time Adaptation (CTTA) aims to enable models to adapt online to unlabeled data streams under distribution shift without accessing source data. Existing CTTA methods face an efficiency-generalization trade-off: updating more…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Guannan Lai , Da-Wei Zhou , Zhenguo Li , Han-Jia Ye

This paper proposes a novel online evaluation protocol for Test Time Adaptation (TTA) methods, which penalizes slower methods by providing them with fewer samples for adaptation. TTA methods leverage unlabeled data at test time to adapt to…

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

Machine Learning · Computer Science 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

While there are many advantages to deploying machine learning models on edge devices, the resource constraints of mobile platforms, the dynamic nature of the environment, and differences between the distribution of training versus…

Machine Learning · Computer Science 2025-03-21 Cynthia Dong , Hong Jia , Young D. Kwon , Georgios Rizos , Cecilia Mascolo