English
Related papers

Related papers: Higher Layers Need More LoRA Experts

200 papers

LoRA-MoE has emerged as an effective paradigm for parameter-efficient fine-tuning, combining the low training cost of LoRA with the increased adaptation capacity of Mixture-of-Experts (MoE). However, existing LoRA-MoE frameworks typically…

Machine Learning · Computer Science 2026-04-30 Weihang Li , Jianchun Liu , Hongli Xu

Low-Rank Adaptation (LoRA) has emerged as one of the most widely used parameter-efficient fine-tuning (PEFT) methods for adapting large language models (LLMs) to downstream tasks. While highly effective in single-task settings, it struggles…

Computation and Language · Computer Science 2025-10-14 Bo Cheng , Xu Wang , Jinda Liu , Yi Chang , Yuan Wu

While Parameter-Efficient Fine-Tuning (PEFT) methods like LoRA have effectively addressed GPU memory constraints during fine-tuning, their performance often falls short, especially in multidimensional task scenarios. To address this issue,…

Computation and Language · Computer Science 2024-08-20 Tianwei Lin , Jiang Liu , Wenqiao Zhang , Zhaocheng Li , Yang Dai , Haoyuan Li , Zhelun Yu , Wanggui He , Juncheng Li , Hao Jiang , Siliang Tang , Yueting Zhuang

Low Rank Adaptation (LoRA) is a popular Parameter Efficient Fine Tuning (PEFT) method that effectively adapts large pre-trained models for downstream tasks. LoRA parameterizes model updates using low-rank matrices at each layer,…

Computation and Language · Computer Science 2025-02-04 Ignacio Hounie , Charilaos Kanatsoulis , Arnuv Tandon , Alejandro Ribeiro

Full fine-tuning of large language models for alignment and task adaptation has become prohibitively expensive as models have grown in size. Parameter-Efficient Fine-Tuning (PEFT) methods aim at significantly reducing the computational and…

Computation and Language · Computer Science 2025-09-22 Jesus Rios , Pierre Dognin , Ronny Luss , Karthikeyan N. Ramamurthy

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

Multi-modal models excel in cross-modal tasks but are computationally expensive due to their billions of parameters. Parameter-efficient fine-tuning (PEFT) offers a solution by adding small trainable components while freezing pre-trained…

Machine Learning · Computer Science 2025-03-27 Sashuai Zhou , Hai Huang , Yan Xia

As the number of model parameters increases, parameter-efficient fine-tuning (PEFT) has become the go-to choice for tailoring pre-trained large language models. Low-rank Adaptation (LoRA) uses a low-rank update method to simulate full…

Machine Learning · Computer Science 2026-05-21 Yongkang Liu , Xing Li , Mengjie Zhao , Shanru Zhang , Zijing Wang , Qian Li , Shi Feng , Feiliang Ren , Daling Wang , Hinrich Schütze

Mixture-of-Experts (MoE) benefits from a dynamic routing mechanism among their specialized experts, which existing Parameter- Efficient Fine-Tuning (PEFT) strategies fail to leverage. This motivates us to investigate whether adaptation…

Machine Learning · Computer Science 2025-08-05 Yilun Liu , Yunpu Ma , Yuetian Lu , Shuo Chen , Zifeng Ding , Volker Tresp

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), but it still incurs notable overhead and suffers from parameter interference in complex datasets. While recent…

Computation and Language · Computer Science 2025-12-19 Chunlin Tian , Xuyang Wei , Huanrong Liu , Zhijiang Guo , Li Li

Parameter-efficient fine-tuning (PEFT) techniques have unlocked the potential to cheaply and easily specialize large pretrained models. However, the most prominent approaches, like low-rank adapters (LoRA), depend on heuristics or…

Machine Learning · Computer Science 2025-04-08 Wenxuan Tan , Nicholas Roberts , Tzu-Heng Huang , Jitian Zhao , John Cooper , Samuel Guo , Chengyu Duan , Frederic Sala

As FMs drive progress toward Artificial General Intelligence (AGI), fine-tuning them under privacy and resource constraints has become increasingly critical particularly when highquality training data resides on distributed edge devices.…

Machine Learning · Computer Science 2025-08-27 Gang Hu , Yinglei Teng , Pengfei Wu , Nan Wang

The Mixture of Experts (MoE) is a widely known neural architecture where an ensemble of specialized sub-models optimizes overall performance with a constant computational cost. However, conventional MoEs pose challenges at scale due to the…

Computation and Language · Computer Science 2023-09-12 Ted Zadouri , Ahmet Üstün , Arash Ahmadian , Beyza Ermiş , Acyr Locatelli , Sara Hooker

Parameter-efficient fine-tuning (PEFT) methods reduce the computational costs of updating deep learning models by minimizing the number of additional parameters used to adapt a model to a down- stream task. While extensively researched in…

Machine Learning · Computer Science 2025-08-01 Georg Slamanig , Francesco Corti , Olga Saukh

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

LoRA has become a universal Parameter-Efficient Fine-Tuning (PEFT) technique that equips Large Language Models (LLMs) to adapt quickly to new tasks. However, when these models are scaled up, even the latest LoRA variants still introduce…

Computation and Language · Computer Science 2026-02-25 Xindian Ma , Rundong Kong , Peng Zhang , Ruoxiang Huang , Yongyu Jiang

Low-Rank Adaptation (LoRA) is currently the most commonly used Parameter-efficient fine-tuning (PEFT) method, it introduces auxiliary parameters for each layer to fine-tune the pre-trained model under limited computing resources. However,…

Machine Learning · Computer Science 2024-06-19 Hongyun Zhou , Xiangyu Lu , Wang Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Parameter-efficient fine-tuning (PEFT) has become a practical route for adapting large language models to downstream tasks, with LoRA-style methods being particularly attractive because they are inexpensive to train and easy to deploy. Most…

Machine Learning · Computer Science 2026-05-12 Yihang Peng , Peng Jin , Jie Gong , Xingyuan Chen , Lingjiao Xu , Ning Su , Yan Ran

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

Machine Learning · Computer Science 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Large-scale pre-training of deep models, followed by fine-tuning them, has become the cornerstone of natural language processing (NLP). The prevalence of data coupled with computational resources has led to large models with a considerable…

Computation and Language · Computer Science 2025-03-17 Rachel S. Y. Teo , Tan M. Nguyen