English
Related papers

Related papers: HSplitLoRA: A Heterogeneous Split Parameter-Effici…

200 papers

Large language models (LLMs) have demonstrated remarkable success across various tasks, accompanied by a continuous increase in their parameter size. Parameter-efficient fine-tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA),…

Machine Learning · Computer Science 2025-02-07 Peizhuang Cong , Wenpu Liu , Wenhan Yu , Haochen Zhao , Tong Yang

In recent years, Large Language Models (LLMs) through Transformer structures have dominated many machine learning tasks, especially text processing. However, these models require massive amounts of data for training and induce high resource…

Machine Learning · Computer Science 2025-04-17 Kilian Pfeiffer , Mohamed Aboelenien Ahmed , Ramin Khalili , Jörg Henkel

Fine-tuning pre-trained large language models (LLMs) has become a common practice for personalized natural language understanding (NLU) applications on downstream tasks and domain-specific datasets. However, there are two main challenges:…

Parameter-efficient fine-tuning (PEFT) is a popular method for tailoring pre-trained large language models (LLMs), especially as the models' scale and the diversity of tasks increase. Low-rank adaptation (LoRA) is based on the idea that the…

Computation and Language · Computer Science 2025-05-27 Pengjie Ren , Chengshun Shi , Shiguang Wu , Mengqi Zhang , Zhaochun Ren , Maarten de Rijke , Zhumin Chen , Jiahuan Pei

Addressing the challenges of deploying large language models in wireless communication networks, this paper combines low-rank adaptation technology (LoRA) with the splitfed learning framework to propose the federated split learning for…

Networking and Internet Architecture · Computer Science 2024-07-15 Kai Zhao , Zhaohui Yang , Chongwen Huang , Xiaoming Chen , Zhaoyang Zhang

Fine-tuning large vision models (LVMs) and large language models (LLMs) under differentially private federated learning (DPFL) is hindered by a fundamental privacy-utility trade-off. Low-Rank Adaptation (LoRA), a promising…

Machine Learning · Computer Science 2026-04-21 Jin Liu , Yinbin Miao , Ning Xi , Junkang Liu

With the proliferation of large pre-trained language models (PLMs), fine-tuning all model parameters becomes increasingly inefficient, particularly when dealing with numerous downstream tasks that entail substantial training and storage…

Computation and Language · Computer Science 2024-01-23 Nadav Benedek , Lior Wolf

Fine-tuning a large language model (LLM) using the local data of edge users can enable personalized services and applications. For privacy protection, the prevalent solution adopts distributed learning for fine-tuning and integrates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Songge Zhang , Guoliang Cheng , Zuguang Li , Wen Wu

Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language Models (LLMs) are trained on data from a single device or client. However, real-world scenarios often require fine-tuning these models on private data…

Machine Learning · Computer Science 2025-06-03 Sajjad Ghiasvand , Yifan Yang , Zhiyu Xue , Mahnoosh Alizadeh , Zheng Zhang , Ramtin Pedarsani

In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of each client's model and enables a learning scheme that…

Machine Learning · Computer Science 2024-10-22 Ahmed Elbakary , Chaouki Ben Issaid , Tamer ElBatt , Karim Seddik , Mehdi Bennis

Large Language Models (LLMs) are pivotal in natural language processing. The impracticality of full fine-tuning has prompted Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA), optimizing low-rank matrices A and…

Machine Learning · Computer Science 2026-03-10 Jiayu Huang , Xiaohu Wu , Tiantian He , Qicheng Lao

Fine-tuning Large Language Models (LLMs) typically involves either full fine-tuning, which updates all model parameters, or Parameter-Efficient Fine-Tuning (PEFT), which adjusts a small subset of parameters. However, both approaches have…

Artificial Intelligence · Computer Science 2026-04-14 Shaocong Ma , Peiran Yu , Heng Huang

Parameter-Efficient Fine-Tuning (PEFT) is essential for adapting Large Language Models (LLMs). In practice, LLMs are often required to handle a diverse set of tasks from multiple domains, a scenario naturally addressed by multi-task…

Computation and Language · Computer Science 2025-08-08 Jinda Liu , Bo Cheng , Yi Chang , Yuan Wu

Pre-trained Language Models (PLMs) have demonstrated their superiority and versatility in modern Natural Language Processing (NLP), effectively adapting to various downstream tasks through further fine-tuning. Federated Parameter-Efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-19 Fei Wu , Jia Hu , Geyong Min , Shiqiang Wang

Federated fine-tuning (FedFT) has been proposed to fine-tune the pre-trained language models in a distributed manner. However, there are two critical challenges for efficient FedFT in practical applications, i.e., resource constraints and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu , Jianchun Liu , Chen Qian

We study the task of personalized federated fine-tuning with heterogeneous data in the context of language models, where clients collaboratively fine-tune a language model (e.g., BERT, GPT) without sharing their local data, achieving…

Machine Learning · Computer Science 2025-03-07 Jie Hao , Yuman Wu , Ali Payani , Myungjin Lee , Mingrui Liu

Federated Learning (FL) offers a decentralized framework for training and fine-tuning Large Language Models (LLMs) by leveraging computational resources across organizations while keeping sensitive data on local devices. It addresses…

Cryptography and Security · Computer Science 2026-05-20 Md Jueal Mia , M. Hadi Amini

Large Language Models (LLMs) have become indispensable in numerous real-world applications. However, fine-tuning these models at scale, especially in federated settings where data privacy and communication efficiency are critical, presents…

Machine Learning · Computer Science 2025-06-10 Yao Shu , Wenyang Hu , See-Kiong Ng , Bryan Kian Hsiang Low , Fei Richard Yu

Foundation models (FMs) adapt well to specific domains or tasks with fine-tuning, and federated learning (FL) enables the potential for privacy-preserving fine-tuning of the FMs with on-device local data. For federated fine-tuning of FMs,…

Machine Learning · Computer Science 2024-02-22 Yae Jee Cho , Luyang Liu , Zheng Xu , Aldi Fahrezi , Gauri Joshi

Federated fine-tuning of pre-trained Large Language Models (LLMs) enables task-specific adaptation across diverse datasets while preserving privacy. However, challenges such as high computational and memory demands, heterogeneous client…

Machine Learning · Computer Science 2025-05-19 Yang Su , Na Yan , Yansha Deng , Mischa Dohler , Robert Schober