English
Related papers

Related papers: S2FT: Parameter-Efficient Fine-Tuning in Sparse Sp…

200 papers

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen

Popular parameter-efficient fine-tuning (PEFT) methods, such as LoRA and its variants, freeze pre-trained model weights \(W\) and inject learnable matrices \(\Delta W\). These \(\Delta W\) matrices are structured for efficient…

Recent developments in Parameter-Efficient Fine-Tuning (PEFT) methods for pretrained deep neural networks have captured widespread interest. In this work, we study the enhancement of current PEFT methods by incorporating the spectral…

Machine Learning · Computer Science 2024-11-05 Fangzhao Zhang , Mert Pilanci

Efficiently adapting large foundation models is critical, especially with tight compute and memory budgets. Parameter-Efficient Fine-Tuning (PEFT) methods such as LoRA offer limited granularity and effectiveness in few-parameter regimes. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ahmet Bilican , M. Akın Yılmaz , A. Murat Tekalp , R. Gökberk Cinbiş

Parameter-efficient fine-tuning (PEFT) of pre-trained language models has recently demonstrated remarkable achievements, effectively matching the performance of full fine-tuning while utilizing significantly fewer trainable parameters, and…

Computation and Language · Computer Science 2023-05-29 Baohao Liao , Yan Meng , Christof Monz

Current PEFT methods for LLMs can achieve either high quality, efficient training, or scalable serving, but not all three simultaneously. To address this limitation, we investigate sparse fine-tuning and observe a remarkable improvement in…

Machine Learning · Computer Science 2024-12-20 Xinyu Yang , Jixuan Leng , Geyang Guo , Jiawei Zhao , Ryumei Nakada , Linjun Zhang , Huaxiu Yao , Beidi Chen

Large-scale foundation models have demonstrated remarkable versatility across a wide range of downstream tasks. However, fully fine-tuning these models incurs prohibitive computational costs, motivating the development of…

Machine Learning · Computer Science 2025-05-30 Chongjie Si , Xuankun Yang , Muqing Liu , Yadao Wang , Xiaokang Yang , Wenbo Su , Bo Zheng , Wei Shen

Visual Parameter-Efficient Fine-Tuning (PEFT) has become a powerful alternative for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only tunes a small number of parameters while freezing the vast…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Haoyu He , Jianfei Cai , Jing Zhang , Dacheng Tao , Bohan Zhuang

Parameter-efficient fine-tuning (PEFT) aims to adapt pre-trained vision models to downstream tasks. Among PEFT paradigms, sparse tuning achieves remarkable performance by adjusting only the weights most relevant to downstream tasks, rather…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Shufan Shen , Junshu Sun , Shuhui Wang , Qingming Huang

Parameter-Efficient Fine-Tuning (PEFT) has gained prominence through low-rank adaptation methods like LoRA. In this paper, we focus on sparsity-based PEFT (SPEFT), which introduces trainable sparse adaptations to the weight matrices in the…

Computation and Language · Computer Science 2025-06-30 Xinxin Liu , Aaron Thomas , Cheng Zhang , Jianyi Cheng , Yiren Zhao , Xitong Gao

Pretrained Foundation Models (PFMs) have transformed numerous applications by enabling efficient adaptation to customized tasks. Parameter-Efficient Fine-Tuning (PEFT) has emerged as a resource-efficient alternative to full fine-tuning,…

Machine Learning · Computer Science 2025-06-16 Baoquan Zhang , Guangning Xu , Michael. K. Ng

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods, sparse tuning achieves superior performance by only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shufan Shen , Junshu Sun , Xiangyang Ji , Qingming Huang , Shuhui Wang

With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost…

Machine Learning · Computer Science 2024-06-11 Weixi Song , Zuchao Li , Lefei Zhang , Hai Zhao , Bo Du

The rapid expansion of large foundation models within the pre-training and fine-tuning framework has underscored that larger models often yield better results. However, the scaling up of large foundation models has led to soaring costs in…

Machine Learning · Computer Science 2024-12-30 Chongjie Si , Xiaokang Yang , Wei Shen

Full fine-tuning of large language models for alignment and task adaptation has become prohibitively expensive as models have grown in size. Parameter-Efficient Fine-Tuning (PEFT) methods aim at significantly reducing the computational and…

Computation and Language · Computer Science 2025-09-22 Jesus Rios , Pierre Dognin , Ronny Luss , Karthikeyan N. Ramamurthy

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

Parameter-efficient fine-tuning (PEFT) has emerged as a popular solution for adapting pre-trained Vision Transformer (ViT) models to downstream applications by updating only a small subset of parameters. While current PEFT methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ting Liu , Xuyang Liu , Liangtao Shi , Zunnan Xu , Yue Hu , Siteng Huang , Yi Xin , Bineng Zhong , Donglin Wang

Parameter-efficient fine-tuning (PEFT) has attracted significant attention due to the growth of pre-trained model sizes and the need to fine-tune (FT) them for superior downstream performance. Despite a surge in new PEFT methods, a…

Machine Learning · Computer Science 2025-03-26 Zheda Mai , Ping Zhang , Cheng-Hao Tu , Hong-You Chen , Li Zhang , Wei-Lun Chao

The success of Large Vision Models (LVMs) is accompanied by vast data volumes, which are prohibitively expensive in medical diagnosis.To address this, recent efforts exploit Parameter-Efficient Fine-Tuning (PEFT), which trains a small…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Mingyuan Liu , Lu Xu , Shengnan Liu , Jicong Zhang

Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on complex, knowledge-intensive tasks is limited due to the…

Computation and Language · Computer Science 2024-06-10 Jitai Hao , WeiWei Sun , Xin Xin , Qi Meng , Zhumin Chen , Pengjie Ren , Zhaochun Ren
‹ Prev 1 2 3 10 Next ›