English
Related papers

Related papers: Embedded Visual Prompt Tuning

200 papers

With the advent of large pre-trained transformer models, fine-tuning these models for various downstream tasks is a critical problem. Paucity of training data, the existence of data silos, and stringent privacy constraints exacerbate this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Naif Alkhunaizi , Faris Almalik , Rouqaiah Al-Refai , Muzammal Naseer , Karthik Nandakumar

Prompt tuning is a promising method to fine-tune a pre-trained language model without retraining its large-scale parameters. Instead, it attaches a soft prompt to the input text, whereby downstream tasks can be well adapted by merely…

Computation and Language · Computer Science 2024-12-12 Pengxiang Lan , Enneng Yang , Yuting Liu , Guibing Guo , Jianzhe Zhao , Xingwei Wang

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

Parameter-efficient fine-tuning (PEFT) has attracted significant attention due to the growth of pre-trained model sizes and the need to fine-tune (FT) them for superior downstream performance. Despite a surge in new PEFT methods, a…

Machine Learning · Computer Science 2025-03-26 Zheda Mai , Ping Zhang , Cheng-Hao Tu , Hong-You Chen , Li Zhang , Wei-Lun Chao

Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raman Dutt , Linus Ericsson , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

The rise of deep learning has marked significant progress in fields such as computer vision, natural language processing, and medical imaging, primarily through the adaptation of pre-trained models for specific tasks. Traditional…

Machine Learning · Computer Science 2024-04-25 Charith Chandra Sai Balne , Sreyoshi Bhaduri , Tamoghna Roy , Vinija Jain , Aman Chadha

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

Visual Parameter-Efficient Fine-Tuning (PEFT) has become a powerful alternative for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only tunes a small number of parameters while freezing the vast…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Haoyu He , Jianfei Cai , Jing Zhang , Dacheng Tao , Bohan Zhuang

The popularity of pre-trained large models has revolutionized downstream tasks across diverse fields, such as language, vision, and multi-modality. To minimize the adaption cost for downstream tasks, many Parameter-Efficient Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yiwen Tang , Ray Zhang , Zoey Guo , Dong Wang , Zhigang Wang , Bin Zhao , Xuelong Li

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

Parameter-efficient fine-tuning (PEFT) has emerged as the predominant technique for fine-tuning in the era of large language models. However, existing PEFT methods still have inadequate training efficiency. Firstly, the utilization of…

Computation and Language · Computer Science 2024-06-07 Naibin Gu , Peng Fu , Xiyu Liu , Bowen Shen , Zheng Lin , Weiping Wang

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

Machine Learning · Computer Science 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

Prompt tuning (PT), where a small amount of trainable soft (continuous) prompt vectors is affixed to the input of language models (LM), has shown promising results across various tasks and models for parameter-efficient fine-tuning (PEFT).…

Computation and Language · Computer Science 2024-02-20 Zhengxiang Shi , Aldo Lipani

The rapid expansion of large foundation models within the pre-training and fine-tuning framework has underscored that larger models often yield better results. However, the scaling up of large foundation models has led to soaring costs in…

Machine Learning · Computer Science 2024-12-30 Chongjie Si , Xiaokang Yang , Wei Shen

Parameter-efficient fine-tuning (PEFT) has emerged as a crucial approach for adapting large vision transformers to downstream tasks without the prohibitive computational costs of full fine-tuning. While existing visual prompt tuning (VPT)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xi Xiao , Yunbei Zhang , Yanshuh Li , Xingjian Li , Tianyang Wang , Jihun Hamm , Xiao Wang , Min Xu

Parameter-efficient fine-tuning (PEFT) that was initially developed for exploiting pre-trained large language models has recently emerged as an effective approach to perform transfer learning on computer vision tasks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenyu Lian , Hong-Yu Zhou , Yizhou Yu , Liansheng Wang

Pre-trained models (PTMs) have achieved great success in various Software Engineering (SE) downstream tasks following the ``pre-train then fine-tune'' paradigm. As fully fine-tuning all parameters of PTMs can be computationally expensive, a…

Software Engineering · Computer Science 2023-12-27 Wentao Zou , Qi Li , Jidong Ge , Chuanyi Li , Xiaoyu Shen , Liguo Huang , Bin Luo

Pre-trained vision models (PVMs) have demonstrated remarkable adaptability across a wide range of downstream vision tasks, showcasing exceptional performance. However, as these models scale to billions or even trillions of parameters,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yi Xin , Jianjiang Yang , Siqi Luo , Yuntao Du , Qi Qin , Kangrui Cen , Yangfan He , Zhiwei Zhang , Bin Fu , Xiaokang Yang , Guangtao Zhai , Ming-Hsuan Yang , Xiaohong Liu
‹ Prev 1 2 3 10 Next ›