English
Related papers

Related papers: Visual Prompt Tuning for Test-time Domain Adaptati…

200 papers

Recent works have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing (NLP) tasks. However, to the best of our knowledge, existing works focus on prompt-tuning…

Computation and Language · Computer Science 2022-05-24 Yuan Yao , Bowen Dong , Ao Zhang , Zhengyan Zhang , Ruobing Xie , Zhiyuan Liu , Leyu Lin , Maosong Sun , Jianyong Wang

Prior Unsupervised Domain Adaptation (UDA) methods often aim to train a domain-invariant feature extractor, which may hinder the model from learning sufficiently discriminative features. To tackle this, a line of works based on prompt…

Machine Learning · Computer Science 2025-04-02 Hoang Phan , Lam Tran , Quyen Tran , Trung Le

Vision-language models (VLMs) encounter considerable challenges when adapting to domain shifts stemming from changes in data distribution. Test-time adaptation (TTA) has emerged as a promising approach to enhance VLM performance under such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chenyu Zhang , Kunlun Xu , Zichen Liu , Yuxin Peng , Jiahuan Zhou

Source-free domain generalization (SFDG) tackles the challenge of adapting models to unseen target domains without access to source domain data. To deal with this challenging task, recent advances in SFDG have primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Haoran Zhang , Shuanghao Bai , Wanqi Zhou , Jingwen Fu , Badong Chen

The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time involves tuning learnable prompts, ie, test-time prompt tuning. This paper introduces Test-Time Low-rank adaptation (TTL) as an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Raza Imam , Hanan Gani , Muhammad Huzaifa , Karthik Nandakumar

Time series domain adaptation stands as a pivotal and intricate challenge with diverse applications, including but not limited to human activity recognition, sleep stage classification, and machine fault diagnosis. Despite the numerous…

Machine Learning · Computer Science 2024-06-11 Junxiang Wang , Guangji Bai , Wei Cheng , Zhengzhang Chen , Liang Zhao , Haifeng Chen

Domain adaptation assumes that samples from source and target domains are freely accessible during a training phase. However, such an assumption is rarely plausible in the real-world and possibly causes data-privacy issues, especially when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Youngeun Kim , Donghyeon Cho , Kyeongtak Han , Priyadarshini Panda , Sungeun Hong

Recently, test-time adaptation has garnered attention as a method for tuning models without labeled data. The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time primarily focuses on tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Raza Imam , Asif Hanif , Jian Zhang , Khaled Waleed Dawoud , Yova Kementchedjhieva , Mohammad Yaqub

Prompt tuning, a recently emerging paradigm, enables the powerful vision-language pre-training models to adapt to downstream tasks in a parameter -- and data -- efficient way, by learning the ``soft prompts'' to condition frozen…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Juncheng Li , Minghe Gao , Longhui Wei , Siliang Tang , Wenqiao Zhang , Mengze Li , Wei Ji , Qi Tian , Tat-Seng Chua , Yueting Zhuang

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

Distribution shift is a common challenge in medical images obtained from different clinical centers, significantly hindering the deployment of pre-trained semantic segmentation models in real-world applications across multiple domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Lingrui Li , Yanfeng Zhou , Nan Pu , Xin Chen , Zhun Zhong

Prompt tuning is a parameter-efficient tuning (PETuning) method for utilizing pre-trained models (PTMs) that simply prepends a soft prompt to the input and only optimizes the prompt to adapt PTMs to downstream tasks. Although it is…

Computation and Language · Computer Science 2022-10-24 Xiangyang Liu , Tianxiang Sun , Xuanjing Huang , Xipeng Qiu

Real-world systems often encounter new data over time, which leads to experiencing target domain shifts. Existing Test-Time Adaptation (TTA) methods tend to apply computationally heavy and memory-intensive backpropagation-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yanshuo Wang , Ali Cheraghian , Zeeshan Hayder , Jie Hong , Sameera Ramasinghe , Shafin Rahman , David Ahmedt-Aristizabal , Xuesong Li , Lars Petersson , Mehrtash Harandi

Visual Parameter-Efficient Fine-Tuning (PEFT) has become a powerful alternative for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only tunes a small number of parameters while freezing the vast…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Haoyu He , Jianfei Cai , Jing Zhang , Dacheng Tao , Bohan Zhuang

Visual Prompt Tuning (VPT) adapts a frozen Vision Transformer (ViT) to downstream tasks by inserting a small number of learnable prompt tokens into the token sequence at each layer. However, we observe that existing VPT variants often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Junze Wang , Lei Fan , Dezheng Zhang , Weipeng Jing , Donglin Di , Yang Song , Sidong Liu , Cong Cong

Unsupervised Domain Adaptation (UDA) methods facilitate knowledge transfer from a labeled source domain to an unlabeled target domain, navigating the obstacle of domain shift. While Convolutional Neural Networks (CNNs) are a staple in UDA,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Gauransh Sawhney , Daksh Dave , Adeel Ahmed , Jiechao Gao , Khalid Saleem

This paper introduces Dynamic Embeddings with Task-Oriented prompting (DETOT), a novel approach aimed at improving the adaptability and efficiency of machine learning models by implementing a flexible embedding layer. Unlike traditional…

Computation and Language · Computer Science 2024-06-25 Allmin Balloccu , Jack Zhang

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

Test-time adaptive (TTA) semantic segmentation adapts a source pre-trained image semantic segmentation model to unlabeled batches of target domain test images, different from real-world, where samples arrive one-by-one in an online fashion.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Debasmit Das , Shubhankar Borse , Hyojin Park , Kambiz Azarian , Hong Cai , Risheek Garrepalli , Fatih Porikli

Test-Time Adaptation (TTA) enables pre-trained models to adjust to distribution shift by learning from unlabeled test-time streams. However, existing methods typically treat these streams as independent samples, overlooking the supervisory…

Machine Learning · Computer Science 2026-01-30 Young Kyung Kim , Oded Schlesinger , Qiangqiang Wu , J. Matías Di Martino , Guillermo Sapiro