English
Related papers

Related papers: Test-Time Model Adaptation with Only Forward Passe…

200 papers

Test-Time Adaptation (TTA) methods are often computationally expensive, require a large amount of data for effective adaptation, or are brittle to hyperparameters. Based on a theoretical foundation of the geometry of the latent space, we…

Machine Learning · Computer Science 2026-05-12 Alexander Murphy , Michal Danilowski , Soumyajit Chatterjee , Abhirup Ghosh

Test-time adaptation (TTA) of Vision-Language Models (VLMs) has emerged as a technique for tackling distribution shifts during the test time. Recent research indicates that the test-time adaptation is intrinsically linked to the model's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Aodi Li , Liansheng Zhuang , Xiao Long , Houqiang Li , Shafei Wang

Large Language Models (LLMs) have demonstrated remarkable performance in real-world applications. However, adapting LLMs to novel tasks via fine-tuning often requires substantial training data and computational resources that are…

Machine Learning · Computer Science 2025-05-27 Boyan Gao , Xin Wang , Yibo Yang , David Clifton

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Deep classifiers may encounter significant performance degradation when processing unseen testing data from varying centers, vendors, and protocols. Ensuring the robustness of deep models against these domain shifts is crucial for their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuhao Huang , Xin Yang , Xiaoqiong Huang , Xinrui Zhou , Haozhe Chi , Haoran Dou , Xindi Hu , Jian Wang , Xuedong Deng , Dong Ni

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Test-time adaptation with pre-trained vision-language models (VLMs) has attracted increasing attention for tackling the issue of distribution shift during the test phase. While prior methods have shown effectiveness in addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Baoshun Tong , Kaiyu Song , Hanjiang Lai

We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Johanna P. Müller , Bernhard Kainz

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Deep neural networks demonstrate strong performance under aligned training-test distributions. However, real-world test data often exhibit domain shifts. Test-Time Adaptation (TTA) addresses this challenge by adapting the model to test data…

Artificial Intelligence · Computer Science 2025-08-27 Byung-Joon Lee , Jin-Seop Lee , Jee-Hyong Lee

Vision-language models (VLMs) such as CLIP and Grounding DINO have achieved remarkable success in object recognition and detection. However, their performance often degrades under real-world distribution shifts. Test-time adaptation (TTA)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Lihua Zhou , Mao Ye , Shuaifeng Li , Nianxin Li , Jinlin Wu , Xiatian Zhu , Lei Deng , Hongbin Liu , Jiebo Luo , Zhen Lei

Source-free domain adaptation has become popular because of its practical usefulness and no need to access source data. However, the adaptation process still takes a considerable amount of time and is predominantly based on optimization…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ondrej Bohdal , Da Li , Timothy Hospedales

Transfer learning has become a popular task adaptation method in the era of foundation models. However, many foundation models require large storage and computing resources, which makes off-the-shelf deployment impractical. Post-training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jung Hwan Heo , Seyedarmin Azizi , Arash Fayyazi , Massoud Pedram

Test-time adaptation (TTA) has recently emerged as a promising approach for improving time series forecasting (TSF) under distribution shift. Existing TSF-TTA methods differ in how they utilize revealed targets, yet the resulting adaptation…

Machine Learning · Computer Science 2026-05-19 Haochun Wang , Ruichen Xu , Georgios Kementzidis , Karen Cho , Sebastian Ramirez Villarreal , Yuefan Deng

Test-time adaptation (TTA) has emerged as a promising paradigm for vision-language models (VLMs) to bridge the distribution gap between pre-training and test data. Recent works have focused on backpropagation-free TTA methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhaohong Huang , Yuxin Zhang , Wenjing Liu , Fei Chao , Rongrong Ji

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

We propose Quick Feedforward (QF) Learning, a novel knowledge consolidation framework for transformer-based models that enables efficient transfer of instruction derived knowledge into model weights through feedforward activations without…

Machine Learning · Computer Science 2025-07-08 Feng Qi

Test-Time Adaptation (TTA) for black-box models accessible only via APIs remains a largely unexplored challenge. Existing approaches such as post-hoc output refinement offer limited adaptive capacity, while Zeroth-Order Optimization (ZOO)…

Machine Learning · Computer Science 2026-04-20 Yunbei Zhang , Shuaicheng Niu , Chengyi Cai , Feng Liu , Jihun Hamm

The goal of this paper is to enhance face recognition performance by augmenting head poses during the testing phase. Existing methods often rely on training on frontalised images or learning pose-invariant representations, yet both…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jaemin Jung , Youngjoon Jang , Joon Son Chung

Real-world systems often encounter new data over time, which leads to experiencing target domain shifts. Existing Test-Time Adaptation (TTA) methods tend to apply computationally heavy and memory-intensive backpropagation-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yanshuo Wang , Ali Cheraghian , Zeeshan Hayder , Jie Hong , Sameera Ramasinghe , Shafin Rahman , David Ahmedt-Aristizabal , Xuesong Li , Lars Petersson , Mehrtash Harandi