English
Related papers

Related papers: Communication and Energy Efficient Slimmable Feder…

200 papers

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

Federated Learning (FL) has emerged to allow multiple clients to collaboratively train machine learning models on their private data at the network edge. However, training and deploying large-scale models on resource-constrained devices is…

Machine Learning · Computer Science 2024-08-05 Yang Xu , Yunming Liao , Hongli Xu , Zhipeng Sun , Liusheng Huang , Chunming Qiao

Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Ji Liu , Tianshi Che , Yang Zhou , Ruoming Jin , Huaiyu Dai , Dejing Dou , Patrick Valduriez

Training with huge datasets and a large number of participating devices leads to bottlenecks in federated learning (FL). Furthermore, the challenges of heterogeneity between multiple FL clients affect the overall performance of the system.…

Machine Learning · Computer Science 2025-06-06 Dev Gurung , Shiva Raj Pokhrel

Collaboratively fine-tuning (FT) large language models (LLMs) over heterogeneous mobile devices fosters immense potential applications of personalized intelligence. However, such a vision faces critical system challenges. Conventional…

Machine Learning · Computer Science 2025-08-12 Xingke Yang , Liang Li , Sicong Li , Liwei Guan , Hao Wang , Xiaoqi Qi , Jiang Liu , Xin Fu , Miao Pan

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Federated learning is a privacy-preserving training method which consists of training from a plurality of clients but without sharing their confidential data. However, previous work on federated learning do not explore suitable neural…

Machine Learning · Computer Science 2023-11-16 Shuhei Nitta , Taiji Suzuki , Albert Rodríguez Mulet , Atsushi Yaguchi , Ryusuke Hirai

Although Federated Learning (FL) is promising to enable collaborative learning among Artificial Intelligence of Things (AIoT) devices, it suffers from the problem of low classification performance due to various heterogeneity factors (e.g.,…

Machine Learning · Computer Science 2024-04-10 Chentao Jia , Ming Hu , Zekai Chen , Yanxin Yang , Xiaofei Xie , Yang Liu , Mingsong Chen

Federated learning (FL) has emerged as a promising paradigm for training models on decentralized data while safeguarding data privacy. Most existing FL systems, however, assume that all machine learning models are of the same type, although…

Machine Learning · Computer Science 2024-06-17 Yingchao Yu , Yuping Yan , Jisong Cai , Yaochu Jin

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

In order to meet the extremely heterogeneous requirements of the next generation wireless communication networks, research community is increasingly dependent on using machine learning solutions for real-time decision-making and radio…

Signal Processing · Electrical Eng. & Systems 2022-01-11 Debaditya Shome , Omer Waqar , Wali Ullah Khan

Federated Learning (FL) enables distributed training of machine learning models while keeping personal data on user devices private. While we witness increasing applications of FL in the area of mobile sensing, such as human activity…

Machine Learning · Computer Science 2022-09-22 Hyunsung Cho , Akhil Mathur , Fahim Kawsar

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Federated learning (FL) is a decentralized machine learning paradigm in which multiple clients collaboratively train a global model by exchanging only model updates with the central server without sharing the local data of the clients. Due…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jonas Klotz , Barış Büyüktaş , Begüm Demir

Federated Learning (FL) revolutionizes collaborative machine learning among Internet of Things (IoT) devices by enabling them to train models collectively while preserving data privacy. FL algorithms fall into two primary categories:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Liangkun Yu , Xiang Sun , Rana Albelaihi , Chaeeun Park , Sihua Shao

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor

Federated learning (FL) ameliorates privacy concerns in settings where a central server coordinates learning from data distributed across many clients. The clients train locally and communicate the models they learn to the server;…

Machine Learning · Computer Science 2020-10-16 Monica Ribero , Haris Vikalo

This paper studies the joint device selection and power control scheme for wireless federated learning (FL), considering both the downlink and uplink communications between the parameter server (PS) and the terminal devices. In each round…

Information Theory · Computer Science 2022-05-20 Wei Guo , Ran Li , Chuan Huang , Xiaoqi Qin , Kaiming Shen , Wei Zhang