English
Related papers

Related papers: Tent: Fully Test-time Adaptation by Entropy Minimi…

200 papers

We describe a simple and general neural network weight compression approach, in which the network parameters (weights and biases) are represented in a "latent" space, amounting to a reparameterization. This space is equipped with a learned…

Machine Learning · Computer Science 2020-02-18 Deniz Oktay , Johannes Ballé , Saurabh Singh , Abhinav Shrivastava

Test-Time Adaptation (TTA) has emerged as an effective solution for adapting Vision Transformers (ViT) to distribution shifts without additional training data. However, existing TTA methods often incur substantial computational overhead,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yizhe Xiong , Zihan Zhou , Yiwen Liang , Hui Chen , Zijia Lin , Tianxiang Hao , Fan Zhang , Jungong Han , Guiguang Ding

The lack of out-of-domain generalization is a critical weakness of deep networks for semantic segmentation. Previous studies relied on the assumption of a static model, i. e., once the training process is complete, model parameters remain…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sherwin Bahmani , Oliver Hahn , Eduard Zamfir , Nikita Araslanov , Daniel Cremers , Stefan Roth

Mainstream Test-Time Adaptation (TTA) methods for adapting vision-language models, e.g., CLIP, typically rely on Shannon Entropy (SE) at test time to measure prediction uncertainty and inconsistency. However, since CLIP has a built-in bias…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xiangyu Wu , Dongming Jiang , Feng Yu , Yueying Tian , Jiaqi Tang , Qing-Guo Chen , Yang Yang , Jianfeng Lu

Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging test-time…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yunhe Gao , Xingjian Shi , Yi Zhu , Hao Wang , Zhiqiang Tang , Xiong Zhou , Mu Li , Dimitris N. Metaxas

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

Machine Learning · Computer Science 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yulu Gan , Yan Bai , Yihang Lou , Xianzheng Ma , Renrui Zhang , Nian Shi , Lin Luo

Speech recognisers usually perform optimally only in a specific environment and need to be adapted to work well in another. For adaptation to a new speaker, there is often too little data for fine-tuning to be robust, and that data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Rogier C. van Dalen , Shucong Zhang , Titouan Parcollet , Sourav Bhattacharya

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

Machine Learning · Computer Science 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

End-to-end deep trainable models are about to exceed the performance of the traditional handcrafted compression techniques on videos and images. The core idea is to learn a non-linear transformation, modeled as a deep neural network,…

Image and Video Processing · Electrical Eng. & Systems 2022-09-05 Muhammet Balcilar , Bharath Damodaran , Pierre Hellier

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xinru Meng , Han Sun , Jiamei Liu , Ningzhong Liu , Huiyu Zhou

Online adaptation to distribution shifts in satellite image segmentation stands as a crucial yet underexplored problem. In this paper, we address source-free and online domain adaptation, i.e., test-time adaptation (TTA), for satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fahim Faisal Niloy , Kishor Kumar Bhaumik , Simon S. Woo

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been proposed to adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siqi Luo , Yi Xin , Yuntao Du , Tao Tan , Guangtao Zhai , Xiaohong Liu

Test-time task adaptation in few-shot learning aims to adapt a pre-trained task-agnostic model for capturing taskspecific knowledge of the test task, rely only on few-labeled support samples. Previous approaches generally focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Ji Zhang , Lianli Gao , Xu Luo , Hengtao Shen , Jingkuan Song

Visual-language models (VLMs) like CLIP exhibit strong generalization but struggle with distribution shifts at test time. Existing training-free test-time adaptation (TTA) methods operate strictly within CLIP's original feature space,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jizhou Han , Chenhao Ding , SongLin Dong , Yuhang He , Xinyuan Gao , Yihong Gong

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), cannot access the…

Computation and Language · Computer Science 2026-01-05 Tianlun Liu , Zhiliang Tian , Zhen Huang , Xingzhi Zhou , Wanlong Yu , Tianle Liu , Feng Liu , Dongsheng Li

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Encountering shifted data at test time is a ubiquitous challenge when deploying predictive models. Test-time adaptation (TTA) methods address this issue by continuously adapting a deployed model using only unlabeled test data. While TTA can…

Machine Learning · Computer Science 2025-11-11 Mona Schirmer , Metod Jazbec , Christian A. Naesseth , Eric Nalisnick