English
Related papers

Related papers: Parameters as Experts: Adapting Vision Models with…

200 papers

Recent efforts to scale Transformer models have demonstrated rapid progress across a wide range of tasks (Wei et al., 2022). However, fine-tuning these models for downstream tasks is expensive due to their large parameter counts.…

Parameter-Efficient Fine-Tuning (PEFT) of text-to-image models has become an increasingly popular technique with many applications. Among the various PEFT methods, Low-Rank Adaptation (LoRA) and its variants have gained significant…

Machine Learning · Computer Science 2025-08-01 Zerui Tao , Yuhta Takida , Naoki Murata , Qibin Zhao , Yuki Mitsufuji

Popular PEFT methods reduce trainable parameter count for fine-tuning by parameterizing new low-rank or sparse trainable weights in parallel to the frozen pre-trained weights $W$. However, these weights are trained from scratch, and there…

Machine Learning · Computer Science 2025-08-15 Suhas G Hegde , Shilpy Kaur , Aruna Tiwari

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

Parameter-efficient fine-tuning (PEFT) has emerged as a crucial paradigm for adapting large language models (LLMs) under constrained computational budgets. However, standard PEFT methods often struggle in multi-task fine-tuning settings,…

Machine Learning · Computer Science 2026-04-03 Juyong Jiang , Fan Wang , Hong Qi , Sunghun Kim , Jing Tang

Parameter-efficient fine-tuning methods (PEFTs) offer the promise of adapting large pre-trained models while only tuning a small number of parameters. They have been shown to be competitive with full model fine-tuning for many downstream…

Computation and Language · Computer Science 2022-10-25 Ahmet Üstün , Asa Cooper Stickland

Recent studies integrate Low-Rank Adaptation (LoRA) and Mixture-of-Experts (MoE) to further enhance the performance of parameter-efficient fine-tuning (PEFT) methods in Large Language Model (LLM) applications. Existing methods employ…

Computation and Language · Computer Science 2026-01-21 Jie Cao , Tianwei Lin , Bo Yuan , Rolan Yan , Hongyang He , Wenqiao Zhang , Juncheng Li , Dongping Zhang , Siliang Tang , Yueting Zhuang

Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters. Despite the success, most existing methods independently…

Computation and Language · Computer Science 2023-11-14 Hao Zhao , Jie Fu , Zhaofeng He

Parameter-efficient fine-tuning (PEFT) that was initially developed for exploiting pre-trained large language models has recently emerged as an effective approach to perform transfer learning on computer vision tasks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenyu Lian , Hong-Yu Zhou , Yizhou Yu , Liansheng Wang

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

With the rise of cloud-edge collaboration, recommendation services are increasingly trained in distributed environments. Federated Recommendation (FR) enables such multi-end collaborative training while preserving privacy by sharing model…

Machine Learning · Computer Science 2025-12-17 Haochen Yuan , Yang Zhang , Xiang He , Quan Z. Sheng , Zhongjie Wang

Mixture-of-Experts (MoE) layers have emerged as an important tool in scaling up modern neural networks by decoupling total trainable parameters from activated parameters in the forward pass for each token. However, sparse MoEs add…

Machine Learning · Computer Science 2026-05-22 Tianze Jiang , Blake Bordelon , Cengiz Pehlevan , Boris Hanin

Parameter-efficient fine-tuning techniques like Low-Rank Adaptation (LoRA) have revolutionized the adaptation of large language models (LLMs) to diverse tasks. Recent efforts have explored mixtures of LoRA modules for multi-task settings.…

Computation and Language · Computer Science 2024-08-06 Lin Ning , Harsh Lara , Meiqi Guo , Abhinav Rastogi

Adapting Vision Language Segmentation Models (VLSMs) to medical imaging domains requires significant computational overhead when using conventional fine-tuning approaches. Existing Parameter-Efficient Fine-Tuning (PEFT) methods apply…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ujjwal Mishra , Vinita Shukla , Praful Hambarde , Amit Shukla

While recent advances in machine learning have equipped Weather Foundation Models (WFMs) with substantial generalization capabilities across diverse downstream tasks, the escalating computational requirements associated with their expanding…

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

Parameter-efficient fine-tuning (PEFT) has become a popular way to adapt large pre-trained models to new tasks. Most PEFT methods update only a small subset of parameters while freezing the rest, avoiding redundant computation. As they…

Machine Learning · Computer Science 2025-08-25 Sungmin Kang , Jisoo Kim , Salman Avestimehr , Sunwoo Lee

Parameter Recombination (PR) methods aim to efficiently compose the weights of a neural network for applications like Parameter-Efficient FineTuning (PEFT) and Model Compression (MC), among others. Most methods typically focus on one…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nazia Tasnim , Shrimai Prabhumoye , Bryan A. Plummer

In the realm of parameter-efficient fine-tuning (PEFT) methods, while options like LoRA are available, there is a persistent demand in the industry for a PEFT approach that excels in both efficiency and performance within the context of…

Computation and Language · Computer Science 2025-02-04 Zequan Liu , Yi Zhao , Ming Tan , Wei Zhu , Aaron Xuxiang Tian

Parameter-efficient fine-tuning has demonstrated promising results across various visual adaptation tasks, such as classification and segmentation. Typically, prompt tuning techniques have harnessed knowledge from a single pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Shentong Mo , Xufang Luo , Dongsheng Li