English
Related papers

Related papers: EELE: Exploring Efficient and Extensible LoRA Inte…

200 papers

Supervised fine-tuning is the most common method to adapt large language models (LLMs) to downstream tasks, but full fine-tuning LLMs requires massive computational resources. Recently, parameter-efficient fine-tuning (PEFT) methods have…

Computation and Language · Computer Science 2024-02-27 Xiangdi Meng , Damai Dai , Weiyao Luo , Zhe Yang , Shaoxiang Wu , Xiaochen Wang , Peiyi Wang , Qingxiu Dong , Liang Chen , Zhifang Sui

Low-Rank Adaptation (LoRA) is a popular technique for efficient fine-tuning of foundation models. However, applying LoRA in federated learning environments, where data is distributed across multiple clients, presents unique challenges.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-01 Raghav Singhal , Kaustubh Ponkshe , Praneeth Vepakomma

Fine-tuning is the primary methodology for tailoring pre-trained large language models to specific tasks. As the model's scale and the diversity of tasks expand, parameter-efficient fine-tuning methods are of paramount importance. One of…

Machine Learning · Computer Science 2024-01-10 Wenhan Xia , Chengwei Qin , Elad Hazan

Advancements in emotion aware language processing increasingly shape vital NLP applications ranging from conversational AI and affective computing to computational psychology and creative content generation. Existing emotion datasets either…

Computation and Language · Computer Science 2025-04-14 Vishal Gandhi , Sagar Gandhi

Low-Rank Adaptation (LoRA) has emerged as a widely used technique for adapting large language models (LLMs) to new domains, due to its modular design and broad availability on platforms such as HuggingFace. This availability has motivated…

Machine Learning · Computer Science 2025-10-15 Ziyi Han , Huanyu Wang , Zeyu Zhang , Xiangxiang Dai , Xutong Liu , John C. S. Lui

Fine-tuning large-scale pre-trained models is prohibitively expensive in terms of computation and memory costs. Low-Rank Adaptation (LoRA), a popular Parameter-Efficient Fine-Tuning (PEFT) method, offers an efficient solution by optimizing…

Machine Learning · Computer Science 2025-05-27 Tao Li , Zhengbao He , Yujun Li , Yasheng Wang , Lifeng Shang , Xiaolin Huang

This paper presents a novel methodology of fine-tuning for large language models-dynamic LoRA. Building from the standard Low-Rank Adaptation framework, this methodology further adds dynamic adaptation mechanisms to improve efficiency and…

Computation and Language · Computer Science 2025-01-28 Xiaoxuan Liao , Chihang Wang , Shicheng Zhou , Jiacheng Hu , Hongye Zheng , Jia Gao

Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performance, but collecting large-scale multimodal data and…

Low-Rank Adaptation (LoRA) has emerged as a popular parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), yet it still incurs notable overhead and suffers from parameter interference in multi-task scenarios. We…

Machine Learning · Computer Science 2025-08-05 Juzheng Zhang , Jiacheng You , Ashwinee Panda , Tom Goldstein

This review examines recent advances in Parameter-Efficient Fine-Tuning (PEFT), with a focus on Low-Rank Adaptation (LoRA), to optimize Retrieval-Augmented Generation (RAG) systems like Qwen3, DeepSeek, and Kimi. These systems face…

Computation and Language · Computer Science 2025-08-13 David Santandreu Calonge , Linda Smail

Although the advancements of pre-trained Large Language Models have significantly accelerated recent progress in NLP, their ever-increasing size poses significant challenges for conventional fine-tuning, especially in memory-intensive…

Computation and Language · Computer Science 2024-04-02 Chenxi Whitehouse , Fantine Huot , Jasmijn Bastings , Mostafa Dehghani , Chu-Cheng Lin , Mirella Lapata

Low-Rank Adaptation (LoRA) offers a cost-effective solution for fine-tuning large language models (LLMs), but it often produces overconfident predictions in data-scarce few-shot settings. To address this issue, several classical statistical…

Machine Learning · Computer Science 2025-10-31 Amir Hossein Rahmati , Sanket Jantre , Weifeng Zhang , Yucheng Wang , Byung-Jun Yoon , Nathan M. Urban , Xiaoning Qian

Existing low-rank adaptation (LoRA) methods face challenges on sparse large language models (LLMs) due to the inability to maintain sparsity. Recent works introduced methods that maintain sparsity by augmenting LoRA techniques with…

Computation and Language · Computer Science 2025-01-16 Yuxuan Hu , Jing Zhang , Xiaodong Chen , Zhe Zhao , Cuiping Li , Hong Chen

Continual learning in Neural Machine Translation (NMT) faces the dual challenges of catastrophic forgetting and the high computational cost of retraining. This study establishes Low-Rank Adaptation (LoRA) as a parameter-efficient framework…

Computation and Language · Computer Science 2025-12-11 Salvador Carrión , Francisco Casacuberta

Sparse autoencoders (SAEs) decompose language model representations into a sparse set of linear latent vectors. Recent works have improved SAEs using language model gradients, but these techniques require many expensive backward passes…

Machine Learning · Computer Science 2025-05-28 Matthew Chen , Joshua Engels , Max Tegmark

The scaling law of Large Language Models (LLMs) reveals a power-law relationship, showing diminishing return on performance as model scale increases. While training LLMs from scratch is resource-intensive, fine-tuning a pre-trained model…

Computation and Language · Computer Science 2025-05-22 Yiyun Zhou , Chang Yao , Jingyuan Chen

Low-Rank Adaptation (LoRA) is the leading parameter-efficient fine-tuning method for Large Language Models (LLMs), but it still suffers from catastrophic forgetting. Recent work has shown that specialized LoRA initialization can alleviate…

Computation and Language · Computer Science 2026-01-13 Pengwei Tang , Xiaolin Hu , Yong Liu , Lizhong Ding , Dongjie Zhang , Xing Wu , Debing Zhang

Low-Rank Adaptation (LoRA) is a popular technique for parameter-efficient fine-tuning of Large Language Models (LLMs). We study how different LoRA modules can be merged to achieve skill composition -- testing the performance of the merged…

Computation and Language · Computer Science 2024-12-03 Akshara Prabhakar , Yuanzhi Li , Karthik Narasimhan , Sham Kakade , Eran Malach , Samy Jelassi

Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). It approximates the update of a pretrained weight matrix $W\in\mathbb{R}^{m\times n}$ by the product of two low-rank…

Machine Learning · Computer Science 2025-08-12 Shiwei Li , Xiandi Luo , Haozhao Wang , Xing Tang , Ziqiang Cui , Dugang Liu , Yuhua Li , Xiuqiang He , Ruixuan Li

Low-Rank Adaptation (LoRA) dominates parameter-efficient fine-tuning (PEFT). However, it faces a ``linear ceiling'': increasing the rank yields diminishing returns in expressive capacity due to intrinsic linear constraints. We introduce…

Machine Learning · Computer Science 2026-04-06 Hung-Hsuan Chen