English
Related papers

Related papers: Dynamic Prompt Allocation and Tuning for Continual…

200 papers

We introduce \`A-la-carte Prompt Tuning (APT), a transformer-based scheme to tune prompts on distinct data so that they can be arbitrarily composed at inference time. The individual prompts can be trained in isolation, possibly on different…

The visual prompts have provided an efficient manner in addressing visual cross-domain problems. In previous works, Visual Domain Prompt (VDP) first introduces domain prompts to tackle the classification Test-Time Adaptation (TTA) problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Senqiao Yang , Jiarui Wu , Jiaming Liu , Xiaoqi Li , Qizhe Zhang , Mingjie Pan , Yulu Gan , Zehui Chen , Shanghang Zhang

Domain Adaptation (DA) techniques are important for overcoming the domain shift between the source domain used for training and the target domain where testing takes place. However, current DA methods assume that the entire target domain is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Abu Md Niamul Taufique , Chowdhury Sadman Jahan , Andreas Savakis

Test-time domain adaptation effectively adjusts the source domain model to accommodate unseen domain shifts in a target domain during inference. However, the model performance can be significantly impaired by continuous distribution changes…

Machine Learning · Computer Science 2024-01-29 Xingzhi Zhou , Zhiliang Tian , Ka Chun Cheung , Simon See , Nevin L. Zhang

Existing test-time prompt tuning (TPT) methods focus on single-modality data, primarily enhancing images and using confidence ratings to filter out inaccurate images. However, while image generation models can produce visually diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chun-Mei Feng , Yuanyang He , Jian Zou , Salman Khan , Huan Xiong , Zhen Li , Wangmeng Zuo , Rick Siow Mong Goh , Yong Liu

Though vision transformers (ViTs) have exhibited impressive ability for representation learning, we empirically find that they cannot generalize well to unseen domains with previous domain generalization algorithms. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Zangwei Zheng , Xiangyu Yue , Kai Wang , Yang You

Vision-language models have showcased impressive zero-shot classification capabilities when equipped with suitable text prompts. Previous studies have shown the effectiveness of test-time prompt tuning; however, these methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuhan Zhu , Guozhen Zhang , Chen Xu , Haocheng Shen , Xiaoxin Chen , Gangshan Wu , Limin Wang

Currently, pre-trained language models (PLMs) do not cope well with the distribution shift problem, resulting in models trained on the training set failing in real test scenarios. To address this problem, the test-time adaptation (TTA)…

Computation and Language · Computer Science 2023-04-26 Yi Su , Yixin Ji , Juntao Li , Hai Ye , Min Zhang

Fine-tuning large language models is becoming ever more impractical due to their rapidly-growing scale. This motivates the use of parameter-efficient adaptation methods such as prompt tuning (PT), which adds a small number of tunable…

Computation and Language · Computer Science 2023-02-23 Simeng Sun , Yang Liu , Dan Iter , Chenguang Zhu , Mohit Iyyer

Conventional Unsupervised Domain Adaptation (UDA) strives to minimize distribution discrepancy between domains, which neglects to harness rich semantics from data and struggles to handle complex domain shifts. A promising technique is to…

Artificial Intelligence · Computer Science 2024-03-06 Zhekai Du , Xinyao Li , Fengling Li , Ke Lu , Lei Zhu , Jingjing Li

Test-time adaptation (TTA) aims to transfer knowledge from a source model to unknown test data with potential distribution shifts in an online manner. Many existing TTA methods rely on entropy as a confidence metric to optimize the model.…

Machine Learning · Computer Science 2025-10-07 Chang'an Yi , Xiaohui Deng , Shuaicheng Niu , Yan Zhou

Training models dedicated to semantic segmentation requires a large amount of pixel-wise annotated data. Due to their costly nature, these annotations might not be available for the task at hand. To alleviate this problem, unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Fei Pan , Francois Rameau , Junsik Kim , In So Kweon

Test-time adaptation (TTA) enhances model robustness by enabling adaptation to target distributions that differ from training distributions, improving real-world generalizability. However, most existing TTA approaches focus on adjusting the…

Machine Learning · Computer Science 2026-05-05 Yewon Han , Seoyun Yang , Taesup Kim

Remote physiological measurement (RPM) has emerged as a promising non-invasive method for monitoring physiological signals using the non-contact device. Although various domain adaptation and generalization methods were proposed to promote…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiao Yang , Jiyao Wang , Yuxuan Fan , Can Liu , Houcheng Su , Weichen Guo , Zitong Yu , Dengbo He , Kaishun Wu

One fascinating aspect of pre-trained Audio-Language Models (ALMs) learning is their impressive zero-shot generalization capability and test-time adaptation (TTA) methods aiming to improve domain performance without annotations. However,…

Sound · Computer Science 2024-12-24 Gongyu Chen , Haomin Zhang , Chaofan Ding , Zihao Chen , Xinhan Di

Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth cannot be obtained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yeonguk Yu , Sungho Shin , Seunghyeok Back , Minhwan Ko , Sangjun Noh , Kyoobin Lee

Active domain adaptation (ADA) aims to improve the model adaptation performance by incorporating active learning (AL) techniques to label a maximally-informative subset of target samples. Conventional AL methods do not consider the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Duojun Huang , Jichang Li , Weikai Chen , Junshi Huang , Zhenhua Chai , Guanbin Li

Experiencing domain shifts during test-time is nearly inevitable in practice and likely results in a severe performance degradation. To overcome this issue, test-time adaptation continues to update the initial source model during…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Robert A. Marsden , Mario Döbler , Bin Yang

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

Recent advances in unsupervised domain adaptation have significantly improved the recognition accuracy of CNNs by alleviating the domain shift between (labeled) source and (unlabeled) target data distributions. While the problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Le Thanh Nguyen-Meidine , Madhu Kiran , Marco Pedersoli , Jose Dolz , Louis-Antoine Blais-Morin , Eric Granger