English
Related papers

Related papers: Efficient Federated Learning Tiny Language Models …

200 papers

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated Learning (FL) is an emerging learning framework that enables edge devices to collaboratively train ML models without sharing their local data. FL faces, however, a significant challenge due to the high amount of information that…

Machine Learning · Computer Science 2025-08-12 Mohamad Assaad , Zeinab Nehme , Merouane Debbah

The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by partitioning the large model and offloading the primary…

Machine Learning · Computer Science 2026-04-09 Zehang Lin , Miao Yang , Haihan Zhu , Zheng Lin , Jianhao Huang , Jing Yang , Guangjin Pan , Dianxin Luan , Zihan Fang , Shunzhi Zhu , Wei Ni , John Thompson

Federated learning (FL) has emerged as a promising paradigm for training models on decentralized data while safeguarding data privacy. Most existing FL systems, however, assume that all machine learning models are of the same type, although…

Machine Learning · Computer Science 2024-06-17 Yingchao Yu , Yuping Yan , Jisong Cai , Yaochu Jin

Federated Learning (FL) faces major challenges regarding communication overhead and model privacy when training large language models (LLMs), especially in healthcare applications. To address these, we introduce Selective Attention…

Computation and Language · Computer Science 2025-04-22 Yue Li , Lihong Zhang

Real-time monitoring of power consumption in cities and micro-grids through the Internet of Things (IoT) can help forecast future demand and optimize grid operations. But moving all consumer-level usage data to the cloud for predictions and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-04 Roopkatha Banerjee , Sampath Koti , Gyanendra Singh , Anirban Chakraborty , Gurunath Gurrala , Bhushan Jagyasi , Yogesh Simmhan

Federated learning (FL) is a popular paradigm for private and collaborative model training on the edge. In centralized FL, the parameters of a global architecture (such as a deep neural network) are maintained and distributed by a central…

Wireless traffic prediction plays an indispensable role in cellular networks to achieve proactive adaptation for communication systems. Along this line, Federated Learning (FL)-based wireless traffic prediction at the edge attracts enormous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Chuanting Zhang , Haixia Zhang , Shuping Dang , Basem Shihada , Mohamed-Slim Alouini

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

Federated learning (FL) has emerged as a widely adopted paradigm for enabling edge learning with distributed data while ensuring data privacy. However, the traditional FL with deep neural networks trained via backpropagation can hardly meet…

Machine Learning · Computer Science 2025-11-05 Jierui Zhang , Jianhao Huang , Kaibin Huang

Federated Learning (FL) enables distributed clients to collaboratively train models without exposing their private data. However, it is difficult to implement efficient FL due to limited resources. Most existing works compress the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Jiaming Yan , Jianchun Liu , Shilong Wang , Hongli Xu , Haifeng Liu , Jianhua Zhou

Federated Learning (FL) is an exciting new paradigm that enables training a global model from data generated locally at the client nodes, without moving client data to a centralized server. Performance of FL in a multi-access edge computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-11 Saurav Prakash , Sagar Dhakal , Mustafa Akdeniz , A. Salman Avestimehr , Nageen Himayat

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

Federated learning (FL) has proven essential for privacy-preserving, collaborative training across distributed clients. Our prior work, TransFed, introduced a robust transformer-based FL framework that leverages a learn-to-adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tajamul Ashraf , Iqra Altaf Gillani

Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge…

Machine Learning · Computer Science 2022-12-06 Shiqi He , Qifan Yan , Feijie Wu , Lanjun Wang , Mathias Lécuyer , Ivan Beschastnikh

Personalized Federated Learning (PFL) enables a collection of agents to collaboratively learn individual models without sharing raw data. We propose a new PFL approach in which each agent optimizes a weighted combination of all agents'…

Machine Learning · Computer Science 2026-03-04 Jean-Baptiste Fermanian , Batiste Le Bars , Aurélien Bellet
‹ Prev 1 3 4 5 6 7 10 Next ›