English
Related papers

Related papers: Federated Knowledge Transfer Fine-tuning Large Ser…

200 papers

The widespread adoption of Federated Learning (FL), a privacy-preserving distributed learning methodology, has been impeded by the challenge of high communication overheads, typically arising from the transmission of large-scale models.…

Machine Learning · Computer Science 2023-10-05 Zihao Zhao , Yuzhu Mao , Zhenpeng Shi , Yang Liu , Tian Lan , Wenbo Ding , Xiao-Ping Zhang

Federated Learning (FL) allows multiple distributed devices to jointly train a shared model without centralizing data, but communication cost remains a major bottleneck, especially in resource-constrained environments. This paper introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Ahmad Alhonainy , Praveen Rao

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

Federated learning is a promising collaborative and privacy-preserving machine learning approach in data-rich smart cities. Nevertheless, the inherent heterogeneity of these urban environments presents a significant challenge in selecting…

Computer Science and Game Theory · Computer Science 2024-05-02 Osama Wehbi , Sarhad Arisdakessian , Mohsen Guizani , Omar Abdel Wahab , Azzam Mourad , Hadi Otrok , Hoda Al khzaimi , Bassem Ouni

Federated learning enables multiple decentralized clients to learn collaboratively without sharing the local training data. However, the expensive annotation cost to acquire data labels on local clients remains an obstacle in utilizing…

Machine Learning · Computer Science 2023-10-03 Yu-Tong Cao , Ye Shi , Baosheng Yu , Jingya Wang , Dacheng Tao

Transfer learning via fine-tuning pre-trained transformer models has gained significant success in delivering state-of-the-art results across various NLP tasks. In the absence of centralized data, Federated Learning (FL) can benefit from…

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Industrial Internet of Things (IIoT) lays a new paradigm for the concept of Industry 4.0 and paves an insight for new industrial era. Nowadays smart machines and smart factories use machine learning/deep learning based models for incurring…

Networking and Internet Architecture · Computer Science 2021-01-05 Parimala M , Swarna Priya R M , Quoc-Viet Pham , Kapal Dev , Praveen Kumar Reddy Maddikunta , Thippa Reddy Gadekallu , Thien Huynh-The

Large Language Models (LLMs) have revolutionized intelligent services by enabling logical reasoning, tool use, and interaction with external systems as agents. The advancement of LLMs is frequently hindered by the scarcity of high-quality…

Machine Learning · Computer Science 2024-12-12 Panlong Wu , Kangshuo Li , Junbao Nan , Fangxin Wang

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

Machine Learning · Computer Science 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated learning obtains a central model on the server by aggregating models trained locally on clients. As a result, federated learning does not require clients to upload their data to the server, thereby preserving the data privacy of…

Machine Learning · Computer Science 2020-08-31 Yang Chen , Xiaoyan Sun , Yaochu Jin

The Internet of Things (IoT) is penetrating many facets of our daily life with the proliferation of intelligent services and applications empowered by artificial intelligence (AI). Traditionally, AI techniques require centralized data…

Signal Processing · Electrical Eng. & Systems 2021-04-28 Dinh C. Nguyen , Ming Ding , Pubudu N. Pathirana , Aruna Seneviratne , Jun Li , H. Vincent Poor

Federated learning (FL) for large language models (LLMs) offers a privacy-preserving scheme, enabling clients to collaboratively fine-tune locally deployed LLMs or smaller language models (SLMs) without exchanging raw data. While…

Machine Learning · Computer Science 2025-10-02 Xinlu Zhang , Na Yan , Yang Su , Yansha Deng , Toktam Mahmoodi

The vast increase of Internet of Things (IoT) technologies and the ever-evolving attack vectors have increased cyber-security risks dramatically. A common approach to implementing AI-based Intrusion Detection systems (IDSs) in distributed…

Cryptography and Security · Computer Science 2023-08-07 Othmane Belarbi , Theodoros Spyridopoulos , Eirini Anthi , Ioannis Mavromatis , Pietro Carnelli , Aftab Khan

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Federated learning (FL) is beneficial for enabling the training…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-22 Pengchao Han , Shiqiang Wang , Yang Jiao , Jianwei Huang

Federated learning (FL) enables wireless terminals to collaboratively learn a shared parameter model while keeping all the training data on devices per se. Parameter sharing consists of synchronous and asynchronous ways: the former…

Information Theory · Computer Science 2024-01-17 Haihui Xie , Minghua Xia , Peiran Wu , Shuai Wang , Kaibin Huang

Federated learning enables collaborative model training across numerous edge devices without requiring participants to share data; however, memory and communication constraints on these edge devices may preclude their participation in…

Machine Learning · Computer Science 2025-09-04 Gwen Legate , Irina Rish , Eugene Belilovsky