English
Related papers

Related papers: Mitigating Cache Noise in Test-Time Adaptation for…

200 papers

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

Open-Domain Table Question Answering (TQA) involves retrieving relevant tables from a large corpus to answer natural language queries. Traditional dense retrieval models such as DTR and DPR incur high computational costs for large-scale…

Computation and Language · Computer Science 2026-04-23 Adarsh Singh , Kushal Raj Bhandari , Jianxi Gao , Soham Dan , Vivek Gupta

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Test-time adaptation (TTA) is crucial for mitigating performance degradation caused by distribution shifts in 3D point cloud classification. In this work, we introduce Token Purging (PG), a novel backpropagation-free approach that removes…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Moslem Yazdanpanah , Ali Bahri , Mehrdad Noori , Sahar Dastani , Gustavo Adolfo Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly understood. Through…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sarthak Kumar Maharana , Baoming Zhang , Leonid Karlinsky , Rogerio Feris , Yunhui Guo

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Continual graph learning (CGL) is purposed to continuously update a graph model with graph data being fed in a streaming manner. Since the model easily forgets previously learned knowledge when training with new-coming data, the…

Machine Learning · Computer Science 2023-09-20 Yilun Liu , Ruihong Qiu , Zi Huang

Consider a two-class classification problem where the number of features is much larger than the sample size. The features are masked by Gaussian noise with mean zero and covariance matrix $\Sigma$, where the precision matrix…

Machine Learning · Statistics 2013-11-21 Yingying Fan , Jiashun Jin , Zhigang Yao

Real-world systems often encounter new data over time, which leads to experiencing target domain shifts. Existing Test-Time Adaptation (TTA) methods tend to apply computationally heavy and memory-intensive backpropagation-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yanshuo Wang , Ali Cheraghian , Zeeshan Hayder , Jie Hong , Sameera Ramasinghe , Shafin Rahman , David Ahmedt-Aristizabal , Xuesong Li , Lars Petersson , Mehrtash Harandi

Recent advances in large-scale vision-language models have achieved impressive performance in various zero-shot image classification tasks. While prior studies have demonstrated significant improvements by introducing few-shot labelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Eman Ali , Muhammad Haris Khan

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Numerical simulation is powerful to study nonlinear solid mechanics problems. However, mesh-based or particle-based numerical methods suffer from the common shortcoming of being time-consuming, particularly for complex problems with…

Machine Learning · Statistics 2024-09-18 Ming-Jian Li , Yanping Lian , Zhanshan Cheng , Lehui Li , Zhidong Wang , Ruxin Gao , Daining Fang

The practical utility of Speech Emotion Recognition (SER) systems is undermined by their fragility to domain shifts, such as speaker variability, the distinction between acted and naturalistic emotions, and cross-corpus variations. While…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-26 Jiaheng Dong , Hong Jia , Ting Dang

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a…

Machine Learning · Computer Science 2023-02-27 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan

Continual Test-time adaptation (CTTA) continuously adapts the deployed model on every incoming batch of data. While achieving optimal accuracy, existing CTTA approaches present poor real-world applicability on resource-constrained edge…

Machine Learning · Computer Science 2026-04-21 Xiao Ma , Young D. Kwon , Dong Ma

Test-Time Adaptation (TTA) allows to update pre-trained models to changing data distributions at deployment time. While early work tested these algorithms for individual fixed distribution shifts, recent work proposed and applied methods…

Machine Learning · Computer Science 2024-04-04 Ori Press , Steffen Schneider , Matthias Kümmerer , Matthias Bethge

Test-time adaptation with pre-trained vision-language models has attracted increasing attention for tackling distribution shifts during the test time. Though prior studies have achieved very promising performance, they involve intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Adilbek Karmanov , Dayan Guan , Shijian Lu , Abdulmotaleb El Saddik , Eric Xing

We present a comprehensive framework for enhancing Retrieval-Augmented Generation (RAG) systems through dynamic retrieval strategies and reinforcement fine-tuning. This approach significantly improves large language models on…

Machine Learning · Computer Science 2025-05-21 Sakhinana Sagar Srinivas , Akash Das , Shivam Gupta , Venkataramana Runkana

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang