English
Related papers

Related papers: S-LoRA: Serving Thousands of Concurrent LoRA Adapt…

200 papers

Low-Rank Adaptation (LoRA) has become a widely adopted parameter-efficient fine-tuning method for large language models, with its effectiveness largely influenced by the allocation of ranks and scaling factors, as well as initialization.…

Computation and Language · Computer Science 2026-04-21 Weicheng Lin , Yi Zhang , Jiawei Dang , Liang-Jie Zhang

This paper introduces Standard Basis LoRA (SBoRA), a novel parameter-efficient fine-tuning approach for Large Language Models that builds upon the pioneering works of Low-Rank Adaptation (LoRA) and Orthogonal Adaptation. SBoRA reduces the…

Artificial Intelligence · Computer Science 2024-10-10 Lai-Man Po , Yuyang Liu , Haoxuan Wu , Tianqi Zhang , Wing-Yin Yu , Zhuohan Wang , Zeyu Jiang , Kun Li

Fine-tuning helps large language models (LLM) recover degraded information and enhance task performance. Although Low-Rank Adaptation (LoRA) is widely used and effective for fine-tuning, we have observed that its scaling factor can limit or…

Machine Learning · Computer Science 2025-01-14 Jun Liu , Zhenglun Kong , Peiyan Dong , Changdi Yang , Xuan Shen , Pu Zhao , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Xue Lin , Dong Huang , Yanzhi Wang

Pre-trained large language models (LLMs) often need specialization for domain-specific tasks. Low-Rank Adaptation (LoRA) is a popular approach that adapts a base model to multiple tasks by adding lightweight trainable adapters. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Suyi Li , Hanfeng Lu , Tianyuan Wu , Minchen Yu , Qizhen Weng , Xusheng Chen , Yizhou Shan , Binhang Yuan , Wei Wang

Fine-tuning Large Language Models (LLMs) is a common practice to adapt pre-trained models for specific applications. While methods like LoRA have effectively addressed GPU memory constraints during fine-tuning, their performance often falls…

Computation and Language · Computer Science 2024-07-23 Dengchun Li , Yingzi Ma , Naizheng Wang , Zhengmao Ye , Zhiyuan Cheng , Yinghao Tang , Yan Zhang , Lei Duan , Jie Zuo , Cal Yang , Mingjie Tang

Fine-tuning large language models (LLMs) with high parameter efficiency for downstream tasks has become a new paradigm. Low-Rank Adaptation (LoRA) significantly reduces the number of trainable parameters for fine-tuning. Although it has…

Computation and Language · Computer Science 2024-08-14 Jia-Chen Zhang , Yu-Jie Xiong , He-Xi Qiu , Dong-Hai Zhu , Chun-Ming Xia

The pretrain+fine-tune paradigm is foundational for deploying large language models (LLMs) across various downstream applications. Within this framework, Low-Rank Adaptation (LoRA) stands out for its parameter-efficient fine-tuning (PEFT),…

Computation and Language · Computer Science 2024-10-10 Jingwei Xu , Junyu Lai , Yunpeng Huang

Low-rank Adaption (LoRA) has been the de-facto parameter-efficient fine-tuning technique for large language models. We present HeteroLoRA, a light-weight search algorithm that leverages zero-cost proxies to allocate the limited LoRA…

Machine Learning · Computer Science 2024-06-24 Zixi Zhang , Cheng Zhang , Xitong Gao , Robert D. Mullins , George A. Constantinides , Yiren Zhao

Low-Rank Adaptation (LoRA) has recently gained attention for fine-tuning foundation models by incorporating trainable low-rank matrices, thereby reducing the number of trainable parameters. While LoRA offers numerous advantages, its…

Machine Learning · Computer Science 2024-04-29 Yeming Wen , Swarat Chaudhuri

We present a data-adaptive method for parameter-efficient fine-tuning of large neural networks. Standard low-rank adaptation methods improve efficiency by restricting each layer update to a fixed low-rank form, but this static…

Machine Learning · Computer Science 2026-05-12 Omatharv Bharat Vaidya , Connor T. Jerzak , Nhat Ho , Chandrajit Bajaj

Fine-tuning large language models (LLMs) is computationally expensive, and Low-Rank Adaptation (LoRA) provides a cost-effective solution by approximating weight updates through low-rank matrices. In real-world scenarios, LLMs are fine-tuned…

Machine Learning · Computer Science 2025-06-03 Jinda Liu , Yi Chang , Yuan Wu

The widespread utilization of language models in modern applications is inconceivable without Parameter-Efficient Fine-Tuning techniques, such as low-rank adaptation ($\texttt{LoRA}$), which adds trainable adapters to selected layers.…

Machine Learning · Computer Science 2025-10-17 Andrey Veprikov , Vladimir Solodkin , Alexander Zyl , Andrey Savchenko , Aleksandr Beznosikov

Large Language Models (LLMs) have demonstrated remarkable effectiveness in adapting to downstream tasks through fine-tuning. Federated Learning (FL) extends this capability by enabling collaborative fine-tuning across distributed clients…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-20 Zikai Zhang , Rui Hu , Jiahao Xu

Low-Rank Adaptation (LoRA) has significantly advanced parameter-efficient fine-tuning of large pretrained models. LoRA augments the pre-trained weights of a model by adding the product of two smaller matrices that together form a low-rank…

Artificial Intelligence · Computer Science 2025-07-09 David Bensaïd , Noam Rotstein , Roy Velich , Daniel Bensaïd , Ron Kimmel

Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). LoRA essentially describes the projection of an input space into a low-dimensional output space, with the…

Computation and Language · Computer Science 2025-10-28 Shiwei Li , Xiandi Luo , Haozhao Wang , Xing Tang , Ziqiang Cui , Dugang Liu , Yuhua Li , Xiuqiang He , Ruixuan Li

Low-Rank Adaptation (LoRA) is a standard tool for parameter-efficient finetuning of large models. While it induces a small memory footprint, its training dynamics can be surprisingly complex as they depend on several hyperparameters such as…

Machine Learning · Computer Science 2026-02-09 Nan Chen , Soledad Villar , Soufiane Hayou

Low-rank adaptation (LoRA) has emerged as a leading parameter-efficient fine-tuning technique for adapting large foundation models, yet it often locks adapters into suboptimal minima near their initialization. This hampers model…

Machine Learning · Computer Science 2025-07-29 Zhan Zhuang , Xiequn Wang , Wei Li , Yulong Zhang , Qiushi Huang , Shuhao Chen , Xuehao Wang , Yanbin Wei , Yuhe Nie , Kede Ma , Yu Zhang , Ying Wei

The growth of large language models underscores the need for parameter-efficient fine-tuning. Despite its popularity, LoRA encounters storage and computational challenges when deploying multiple task- or user-specific modules. To address…

Machine Learning · Computer Science 2025-08-21 Klaudia Bałazy , Mohammadreza Banaei , Karl Aberer , Jacek Tabor

Large Language Models (LLMs) have gained significant attention due to their versatility across a wide array of applications. Fine-tuning LLMs with parameter-efficient adapters, such as Low-Rank Adaptation (LoRA), enables these models to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-03 Zheyu Shen , Yexiao He , Ziyao Wang , Yuning Zhang , Guoheng Sun , Wanghao Ye , Ang Li

Fine-tuning adapts a pre-trained model to downstream tasks using a small amount of labeled data. Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that reduces memory and computation costs while often achieving performance close…

Machine Learning · Computer Science 2026-05-20 Ali Zindari , Rotem Mulayoff , Sebastian U. Stich