English
Related papers

Related papers: Parameter-Efficient Fine-Tuning for Pre-Trained Vi…

200 papers

Federated learning (FL) has emerged as a promising paradigm for enabling the collaborative training of models without centralized access to the raw data on local devices. In the typical FL paradigm (e.g., FedAvg), model weights are sent to…

Machine Learning · Computer Science 2024-12-25 Guangyu Sun , Umar Khalid , Matias Mendieta , Pu Wang , Chen Chen

With the growing size of pre-trained models, full fine-tuning and storing all the parameters for various downstream tasks is costly and infeasible. In this paper, we propose a new parameter-efficient fine-tuning method, Gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Zhang , Qizhe Zhang , Zijun Gao , Renrui Zhang , Ekaterina Shutova , Shiji Zhou , Shanghang Zhang

Parameter Efficient Fine-Tuning (PEFT) is a key technique for adapting a large pretrained model to downstream tasks by fine-tuning only a small number of parameters. Recent methods based on Fourier transforms have further reduced the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Baoquan Zhang , Zhehao Yu , Lisai Zhang , Kenghong Lin , Tianran Chen , Yuxi Sun , Yunming Ye , Yao He

Parameter-efficient fine-tuning methods have emerged as a promising solution for adapting pre-trained models to various downstream tasks. While these methods perform well in single-task learning, extending them to multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Neeraj Gangwar , Anshuka Rangi , Rishabh Deshmukh , Holakou Rahmanian , Yesh Dattatreya , Nickvash Kani

Parameter-Efficient Fine-Tuning (PEFT) has become a dominant paradigm for deploying LLMs in multi-task scenarios due to its extreme parameter efficiency. While Mixture-of-Experts (MoE) based LoRA variants have achieved promising results by…

Computation and Language · Computer Science 2026-03-16 Jia-Chen Zhang , Zhen-Wei Yan , Yu-Jie Xiong , Chun-Ming Xia

As the size of transformer-based models continues to grow, fine-tuning these large-scale pretrained vision models for new tasks has become increasingly parameter-intensive. Parameter-efficient learning has been developed to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Cheng Han , Qifan Wang , Yiming Cui , Zhiwen Cao , Wenguan Wang , Siyuan Qi , Dongfang Liu

As the cost of training ever larger language models has grown, so has the interest in reusing previously learnt knowledge. Transfer learning methods have shown how reusing non-task-specific knowledge can help in subsequent task-specific…

Computation and Language · Computer Science 2024-01-26 Mohammed Sabry , Anya Belz

Parameter-efficient fine-tuning (PEFT) aims to adapt pre-trained vision models to downstream tasks. Among PEFT paradigms, sparse tuning achieves remarkable performance by adjusting only the weights most relevant to downstream tasks, rather…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Shufan Shen , Junshu Sun , Shuhui Wang , Qingming Huang

Vision Foundation Models (VFMs) have demonstrated impressive representational capabilities. However, adapting them to downstream tasks via full fine-tuning incurs prohibitive computational and storage overhead. Parameter-Efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Lingyu Xiong , Jinjin Shi , Xuran Xu , Cong Luo , Runyu Shi , Ying Huang

A prevalent approach in Parameter-Efficient Fine-Tuning (PEFT) of pre-trained Vision Transformers (ViT) involves freezing the majority of the backbone parameters and solely learning low-rank adaptation weight matrices to accommodate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yiting Yang , Hao Luo , Yuan Sun , Qingsen Yan , Haokui Zhang , Wei Dong , Guoqing Wang , Peng Wang , Yang Yang , Hengtao Shen

Large pretrained language models are widely used in downstream NLP tasks via task-specific fine-tuning, but such procedures can be costly. Recently, Parameter-Efficient Fine-Tuning (PEFT) methods have achieved strong task performance while…

Computation and Language · Computer Science 2024-01-30 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen

Training large foundation models from scratch for domain-specific applications is almost impossible due to data limits and long-tailed distributions -- taking remote sensing (RS) as an example. Fine-tuning natural image pre-trained models…

Machine Learning · Computer Science 2026-03-03 Zichen Tian , Yaoyao Liu , Qianru Sun

The workflow of pretraining and fine-tuning has emerged as a popular paradigm for solving various NLP and V&L (Vision-and-Language) downstream tasks. With the capacity of pretrained models growing rapidly, how to perform parameter-efficient…

Computation and Language · Computer Science 2022-03-09 Zhengkun Zhang , Wenya Guo , Xiaojun Meng , Yasheng Wang , Yadao Wang , Xin Jiang , Qun Liu , Zhenglu Yang

Parameter-efficient finetuning (PEFT) methods seek to adapt large neural models via updates to a small number of weights. However, much prior interpretability work has shown that representations encode rich semantic information, suggesting…

Computation and Language · Computer Science 2024-05-24 Zhengxuan Wu , Aryaman Arora , Zheng Wang , Atticus Geiger , Dan Jurafsky , Christopher D. Manning , Christopher Potts

Automated code smell detection faces persistent challenges due to the subjectivity of heuristic rules and the limited performance of traditional ML/DL models. While Large Language Models (LLMs) offer a promising alternative, their adoption…

Software Engineering · Computer Science 2026-03-30 Beiqi Zhang , Peng Liang , Xin Zhou , Xiyu Zhou , David Lo , Qiong Feng , Zengyang Li , Lin Li

The Segment Anything Model (SAM), a vision foundation model, exhibits impressive zero-shot capabilities in general tasks but struggles in specialized domains. Parameter-efficient fine-tuning (PEFT) is a promising approach to unleash the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yuanhong Zhang , Muyao Yuan , Weizhan Zhang , Tieliang Gong , Wen Wen , Jiangyong Ying , Weijie Shi

Large Language Models (LLMs) have shown extraordinary success across various text generation tasks; however, their potential for simple yet essential text classification remains underexplored, as LLM pre-training tends to emphasize…

Computation and Language · Computer Science 2025-10-02 Zhexiong Liu , Diane Litman

Visual Prompt Tuning (VPT) has become a promising solution for Parameter-Efficient Fine-Tuning (PEFT) approach for Vision Transformer (ViT) models by partially fine-tuning learnable tokens while keeping most model parameters frozen. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Li Ren , Chen Chen , Liqiang Wang , Kien Hua

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

Pre-trained language models (PLMs) have ignited a surge in demand for effective fine-tuning techniques, particularly in low-resource domains and languages. Active learning (AL), a set of algorithms designed to decrease labeling costs by…

Computation and Language · Computer Science 2023-10-24 Josip Jukić , Jan Šnajder