English
Related papers

Related papers: Panda: Test-Time Adaptation with Negative Data Aug…

200 papers

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Source-free domain adaptation (SFDA) involves adapting a model originally trained using a labeled dataset ({\em source domain}) to perform effectively on an unlabeled dataset ({\em target domain}) without relying on any source data during…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jing Wang , Wonho Bae , Jiahong Chen , Kuangen Zhang , Leonid Sigal , Clarence W. de Silva

Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Gustavo Adolfo Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Data Augmentation (DA) -- enriching training data by adding synthetic samples -- is a technique widely adopted in Computer Vision (CV) and Natural Language Processing (NLP) tasks to improve models performance. Yet, DA has struggled to gain…

Machine Learning · Computer Science 2024-01-24 Chao Wang , Alessandro Finamore , Pietro Michiardi , Massimo Gallo , Dario Rossi

Medical image segmentation is critical for clinical diagnosis, treatment planning, and monitoring, yet segmentation models often struggle with uncertainties stemming from occlusions, ambiguous boundaries, and variations in imaging devices.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Xiao Ma , Yuhui Tao , Zetian Zhang , Yuhan Zhang , Xi Wang , Sheng Zhang , Zexuan Ji , Yizhe Zhang , Qiang Chen , Guang Yang

Recent work has demonstrated that using parameter efficient tuning techniques such as prefix tuning (or P-tuning) on pretrained language models can yield performance that is comparable or superior to fine-tuning while dramatically reducing…

Computation and Language · Computer Science 2023-06-30 Stephen Obadinma , Hongyu Guo , Xiaodan Zhu

Test-time augmentation (TTA) is a well-known technique employed during the testing phase of computer vision tasks. It involves aggregating multiple augmented versions of input data. Combining predictions using a simple average formulation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zeinab Sherkatghanad , Moloud Abdar , Mohammadreza Bakhtyari , Pawel Plawiak , Vladimir Makarenkov

Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuang Li , Longhui Yuan , Binhui Xie , Tao Yang

The advancements in generative modeling, particularly the advent of diffusion models, have sparked a fundamental question: how can these models be effectively used for discriminative tasks? In this work, we find that generative models can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Mihir Prabhudesai , Tsung-Wei Ke , Alexander C. Li , Deepak Pathak , Katerina Fragkiadaki

Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced label distribution shifts. This is often a key obstacle…

Machine Learning · Computer Science 2025-09-08 Shuaicheng Niu , Guohao Chen , Deyu Chen , Yifan Zhang , Jiaxiang Wu , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Chunyan Miao , Mingkui Tan

In contrast to close-set scenarios that restore images from a predefined set of degradations, open-set image restoration aims to handle the unknown degradations that were unforeseen during the pretraining phase, which is less-touched as far…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yuanbiao Gou , Haiyu Zhao , Boyun Li , Xinyan Xiao , Xi Peng

Active learning effectively collects data instances for training deep learning models when the labeled dataset is limited and the annotation cost is high. Besides active learning, data augmentation is also an effective technique to enlarge…

Machine Learning · Computer Science 2020-11-18 Yoon-Yeong Kim , Kyungwoo Song , JoonHo Jang , Il-Chul Moon

The development of large vision-language models, notably CLIP, has catalyzed research into effective adaptation techniques, with a particular focus on soft prompt tuning. Conjointly, test-time augmentation, which utilizes multiple augmented…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maxime Zanella , Ismail Ben Ayed

In recent years, one of the most popular techniques in the computer vision community has been the deep learning technique. As a data-driven technique, deep model requires enormous amounts of accurately labelled training data, which is often…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zihan Yang , Richard O. Sinnott , James Bailey , Qiuhong Ke

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Vision-language models suffer performance degradation under domain shift, limiting real-world applicability. Existing test-time adaptation methods are computationally intensive, rely on back-propagation, and often focus on single…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Yi Zhang , Chun-Wun Cheng , Angelica I. Aviles-Rivero , Zhihai He , Liang-Jie Zhang

Test-time adaptation (TTA) refers to adapting a classifier for the test data when the probability distribution of the test data slightly differs from that of the training data of the model. To the best of our knowledge, most of the existing…

Machine Learning · Computer Science 2026-01-19 Sravan Danda , Aditya Challa , Shlok Mehendale , Snehanshu Saha

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Large-scale Vision-Language Models (VLMs) exhibit strong zero-shot recognition, yet their real-world deployment is challenged by distribution shifts. While Test-Time Adaptation (TTA) can mitigate this, existing VLM-based TTA methods operate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Wei Luo , Yangfan Ou , Jin Deng , Zeshuai Deng , Xiquan Yan , Zhiquan Wen , Mingkui Tan

Test-time adaptation (TTA) methods have gained significant attention for enhancing the performance of vision-language models (VLMs) such as CLIP during inference, without requiring additional labeled data. However, current TTA researches…

Machine Learning · Computer Science 2025-10-14 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan