English
Related papers

Related papers: Distributed Learning in Heterogeneous Environment:…

200 papers

The key premise of federated learning (FL) is to train ML models across a diverse set of data-owners (clients), without exchanging local data. An overarching challenge to this date is client heterogeneity, which may arise not only from…

Federated learning (FL) is a popular collaborative distributed machine learning paradigm across mobile devices. However, practical FL over resource constrained mobile devices confronts multiple challenges, e.g., the local on-device training…

Networking and Internet Architecture · Computer Science 2022-05-24 Rui Chen , Liang Li , Kaiping Xue , Chi Zhang , Miao Pan , Yuguang Fang

Many emerging AI applications request distributed machine learning (ML) among edge systems (e.g., IoT devices and PCs at the edge of the Internet), where data cannot be uploaded to a central venue for model training, due to their large…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-19 Hanpeng Hu , Dan Wang , Chuan Wu

Secure model aggregation across many users is a key component of federated learning systems. The state-of-the-art protocols for secure model aggregation, which are based on additive masking, require all users to quantize their model updates…

Information Theory · Computer Science 2021-11-17 Ahmed Roushdy Elkordy , A. Salman Avestimehr

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational…

Machine Learning · Computer Science 2025-03-11 Chuan Chen , Tianchi Liao , Xiaojun Deng , Zihou Wu , Sheng Huang , Zibin Zheng

Federated learning (FL) was recently proposed to securely train models with data held over multiple locations (``clients'') under the coordination of a central server. Prolonged training times caused by slow clients may hinder the…

Machine Learning · Computer Science 2025-10-07 Charikleia Iakovidou , Kibaek Kim

While federated learning leverages distributed client resources, it faces challenges due to heterogeneous client capabilities. This necessitates allocating models suited to clients' resources and careful parameter aggregation to accommodate…

Machine Learning · Computer Science 2024-10-04 Yujin Shin , Kichang Lee , Sungmin Lee , You Rim Choi , Hyung-Sin Kim , JeongGil Ko

Federated learning (FL) faces critical challenges, particularly in heterogeneous environments where non-independent and identically distributed data across clients can lead to unfair and inefficient model performance. In this work, we…

Machine Learning · Computer Science 2025-05-22 Mounssif Krouka , Chaouki Ben Issaid , Mehdi Bennis

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

In Federated Learning (FL), devices that participate in the training usually have heterogeneous resources, i.e., energy availability. In current deployments of FL, devices that do not fulfill certain hardware requirements are often dropped…

Hardware Architecture · Computer Science 2024-12-03 Kilian Pfeiffer , Konstantinos Balaskas , Kostas Siozios , Jörg Henkel

Federated learning (FL) commonly involves clients with diverse communication and computational capabilities. Such heterogeneity can significantly distort the optimization dynamics and lead to objective inconsistency, where the global model…

Machine Learning · Computer Science 2026-02-24 Shudi Weng , Chao Ren , Ming Xiao , Mikael Skoglund

Federated learning (FL) is recognized as a key enabling technology to support distributed artificial intelligence (AI) services in future 6G. By supporting decentralized data training and collaborative model training among devices, FL…

Signal Processing · Electrical Eng. & Systems 2021-11-02 Shaoming Huang , Pengfei Zhang , Yijie Mao , Lixiang Lian , Yuanming Shi

Federated adversarial training can effectively complement adversarial robustness into the privacy-preserving federated learning systems. However, the high demand for memory capacity and computing power makes large-scale federated…

Machine Learning · Computer Science 2023-04-27 Minxue Tang , Jianyi Zhang , Mingyuan Ma , Louis DiValentin , Aolin Ding , Amin Hassanzadeh , Hai Li , Yiran Chen

Federated learning (FL) has become a promising answer to facilitating privacy-preserving collaborative learning in distributed IoT devices. However, device heterogeneity is a key challenge because IoT networks include devices with very…

Networking and Internet Architecture · Computer Science 2026-02-17 Ali Salimi , Saadat Izadi , Mahmood Ahmadi , Hadi Tabatabaee Malazi

Various IoT applications demand resource-constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real-time computer vision, etc. This necessitates us to…

Machine Learning · Computer Science 2020-11-09 Gautham Krishna Gudur , Bala Shyamala Balaji , Satheesh K. Perepu

Collaborative learning across heterogeneous model architectures presents significant challenges in ensuring interoperability and preserving privacy. We propose a communication-efficient distributed learning framework that supports model…

Machine Learning · Computer Science 2025-09-30 Mounssif Krouka , Mehdi Bennis

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

Networking and Internet Architecture · Computer Science 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

Federated Learning is a training framework that enables multiple participants to collaboratively train a shared model while preserving data privacy and minimizing communication overhead. The heterogeneity of devices and networking resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Rahul Mishra , Hari Prabhat Gupta , Garvit Banga

With the rapid advancement of 5G networks, billions of smart Internet of Things (IoT) devices along with an enormous amount of data are generated at the network edge. While still at an early age, it is expected that the evolving 6G network…

Machine Learning · Computer Science 2023-03-16 Bing Luo , Xiaomin Ouyang , Peng Sun , Pengchao Han , Ningning Ding , Jianwei Huang