English
Related papers

Related papers: Decentralized Low-Rank Fine-Tuning of Large Langua…

200 papers

Federated Learning has recently been utilized to collaboratively fine-tune foundation models across multiple clients. Notably, federated low-rank adaptation LoRA-based fine-tuning methods have recently gained attention, which allows clients…

Machine Learning · Computer Science 2025-06-17 Zikai Zhang , Ping Liu , Jiahao Xu , Rui Hu

In recent years, large language models (LLMs) have significantly advanced the field of natural language processing (NLP). By fine-tuning LLMs with data from specific scenarios, these foundation models can better adapt to various downstream…

Computation and Language · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Yuzhe Yang , Yijiang Li , Shiyue Hou , Rui Jing , Zehua Wang , Wei Chen , Zijian Tian

Large language models (LLMs) show amazing performance on many domain-specific tasks after fine-tuning with some appropriate data. However, many domain-specific data are privately distributed across multiple owners. Thus, this dilemma raises…

Machine Learning · Computer Science 2024-06-26 Feijie Wu , Zitao Li , Yaliang Li , Bolin Ding , Jing Gao

Low-Rank Adaptation (LoRA) offers a cost-effective solution for fine-tuning large language models (LLMs), but it often produces overconfident predictions in data-scarce few-shot settings. To address this issue, several classical statistical…

Machine Learning · Computer Science 2025-10-31 Amir Hossein Rahmati , Sanket Jantre , Weifeng Zhang , Yucheng Wang , Byung-Jun Yoon , Nathan M. Urban , Xiaoning Qian

With the rapid development of Large Language Models (LLMs), Parameter-Efficient Fine-Tuning (PEFT) methods have gained significant attention, which aims to achieve efficient fine-tuning of LLMs with fewer parameters. As a representative…

Machine Learning · Computer Science 2025-05-30 Dacao Zhang , Kun Zhang , Shimao Chu , Le Wu , Xin Li , Si Wei

Federated Learning (FL) facilitates the fine-tuning of Foundation Models (FMs) using distributed data sources, with Low-Rank Adaptation (LoRA) gaining popularity due to its low communication costs and strong performance. While recent work…

Machine Learning · Computer Science 2025-05-27 Zihao Peng , Jiandian Zeng , Boyuan Li , Guo Li , Shengbo Chen , Tian Wang

This study explores the fine-tuning (FT) of the Open Pre-trained Transformer (OPT-125M) for grammatical acceptability tasks using the CoLA dataset. By comparing Vanilla-Fine-Tuning (VFT), Pattern-Based-Fine-Tuning (PBFT), and…

Computation and Language · Computer Science 2025-01-15 Shobhit Ratan , Farley Knight , Ghada Jerfel , Sze Chung Ho

Large language models (LLMs) have demonstrated remarkable performance across various downstream tasks. However, the high computational and memory requirements of LLMs are a major bottleneck. To address this, parameter-efficient fine-tuning…

Computation and Language · Computer Science 2024-10-29 Rambod Azimi , Rishav Rishav , Marek Teichmann , Samira Ebrahimi Kahou

Parameter-efficient fine-tuning (PEFT) is essential for adapting large language models (LLMs), with low-rank adaptation (LoRA) being the most popular approach. However, LoRA suffers from slow convergence, and some recent LoRA variants, such…

Computation and Language · Computer Science 2025-02-21 Chenlu Guo , Yuan Wu , Yi Chang

Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performance, but collecting large-scale multimodal data and…

Transfer learning, by leveraging knowledge from pre-trained models, has significantly enhanced the performance of target tasks. However, as deep neural networks scale up, full fine-tuning introduces substantial computational and storage…

Image and Video Processing · Electrical Eng. & Systems 2025-10-01 Guanghua He , Wangang Cheng , Hancan Zhu , Xiaohao Cai , Gaohang Yu

Fine-tuning large language models (LLMs) is computationally expensive, and Low-Rank Adaptation (LoRA) provides a cost-effective solution by approximating weight updates through low-rank matrices. In real-world scenarios, LLMs are fine-tuned…

Machine Learning · Computer Science 2025-06-03 Jinda Liu , Yi Chang , Yuan Wu

This review surveys the rapid evolution of Meta AI's LLaMA (Large Language Model Meta AI) series - from LLaMA 1 through LLaMA 4 and the specialized parameter-efficient fine-tuning (PEFT) methods developed for these models. We first describe…

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

Addressing the challenges of deploying large language models in wireless communication networks, this paper combines low-rank adaptation technology (LoRA) with the splitfed learning framework to propose the federated split learning for…

Networking and Internet Architecture · Computer Science 2024-07-15 Kai Zhao , Zhaohui Yang , Chongwen Huang , Xiaoming Chen , Zhaoyang Zhang

Parameter-efficient fine-tuning (PEFT) methods, which fine-tune only a subset of model parameters, offer a promising solution by reducing the computational costs of tuning large language models (LLMs) while maintaining their performance.…

Software Engineering · Computer Science 2025-11-25 André Storhaug , Jingyue Li

Parameter-efficient fine-tuning (PEFT) has emerged as a crucial approach for adapting large foundational models to specific tasks, particularly as model sizes continue to grow exponentially. Among PEFT methods, Low-Rank Adaptation (LoRA)…

Machine Learning · Computer Science 2025-08-07 Igor Sokolov , Abdurakhmon Sadiev , Yury Demidovich , Fawaz S Al-Qahtani , Peter Richtárik

Low-rank adaptation (LoRA) is a popular method for fine-tuning large-scale pre-trained models in downstream tasks by learning low-rank incremental matrices. Though LoRA and its variants effectively reduce the number of trainable parameters…

Machine Learning · Computer Science 2024-03-21 Rushi Qiang , Ruiyi Zhang , Pengtao Xie

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

Recent advancements in Large Language Models (LLMs) have achieved robust performance across diverse tasks, but fine-tuning these models for specific domains remains resource-intensive. Parameter-Efficient Fine-Tuning (PEFT) methods like…

Computation and Language · Computer Science 2025-02-19 Yuxuan Zhang , Ruizhe Li