English
Related papers

Related papers: Helios: Heterogeneity-Aware Federated Learning wit…

200 papers

Heterogeneity in federated learning (FL) is a critical and challenging aspect that significantly impacts model performance and convergence. In this paper, we propose a novel framework by formulating heterogeneous FL as a hierarchical…

Optimization and Control · Mathematics 2025-09-11 Yuyang Qiu , Kibaek Kim , Farzad Yousefian

Personalized Federated Learning (PFL) is a new Federated Learning (FL) approach to address the heterogeneity issue of the datasets generated by distributed user equipments (UEs). However, most existing PFL implementations rely on…

Machine Learning · Computer Science 2022-09-28 Chaoqun You , Daquan Feng , Kun Guo , Howard H. Yang , Tony Q. S. Quek

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

Federated Learning (FL) is a machine learning paradigm that enables the training of a shared global model across distributed clients while keeping the training data local. While most prior work on designing systems for FL has focused on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-21 Mohamed Elzohairy , Mohak Chadha , Anshul Jindal , Andreas Grafberger , Jianfeng Gu , Michael Gerndt , Osama Abboud

Federated Learning (FL) enables learning a shared model across many clients without violating the privacy requirements. One of the key attributes in FL is the heterogeneity that exists in both resource and data due to the differences in…

Machine Learning · Computer Science 2020-01-28 Zheng Chai , Ahsan Ali , Syed Zawad , Stacey Truex , Ali Anwar , Nathalie Baracaldo , Yi Zhou , Heiko Ludwig , Feng Yan , Yue Cheng

Federated Learning (FL) enables distributed clients to collaboratively train models without exposing their private data. However, it is difficult to implement efficient FL due to limited resources. Most existing works compress the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Jiaming Yan , Jianchun Liu , Shilong Wang , Hongli Xu , Haifeng Liu , Jianhua Zhou

Federated Learning has become an important learning paradigm due to its privacy and computational benefits. As the field advances, two key challenges that still remain to be addressed are: (1) system heterogeneity - variability in the…

Machine Learning · Computer Science 2022-06-02 Disha Makhija , Nhat Ho , Joydeep Ghosh

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Wentao Gao , Omid Tavallaie , Shuaijun Chen , Albert Zomaya

Federated learning (FL) and federated distillation (FD) are distributed learning paradigms that train UE models with enhanced privacy, each offering different trade-offs between noise robustness and learning speed. To mitigate their…

Machine Learning · Computer Science 2026-01-09 Yongjun Kim , Hyeongjun Park , Hwanjin Kim , Junil Choi

Training latency is critical for the success of numerous intrigued applications ignited by federated learning (FL) over heterogeneous mobile devices. By revolutionarily overlapping local gradient transmission with continuous local…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-21 Jiaxiang Geng , Boyu Li , Xiaoqi Qin , Yixuan Li , Liang Li , Yanzhao Hou , Miao Pan

Training large language models (LLMs) increasingly relies on geographically distributed accelerators, causing prohibitive communication costs across regions and uneven utilization of heterogeneous hardware. We propose HALoS, a hierarchical…

Machine Learning · Computer Science 2025-06-06 Geon-Woo Kim , Junbo Li , Shashidhar Gandham , Omar Baldonado , Adithya Gangidi , Pavan Balaji , Zhangyang Wang , Aditya Akella

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

Federated learning (FL) is becoming a popular paradigm for collaborative learning over distributed, private datasets owned by non-trusting entities. FL has seen successful deployment in production environments, and it has been adopted in…

Machine Learning · Computer Science 2021-02-16 Ahmed M. Abdelmoniem , Chen-Yu Ho , Pantelis Papageorgiou , Muhammad Bilal , Marco Canini

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Boyu Fan , Siyang Jiang , Xiang Su , Sasu Tarkoma , Pan Hui

Federated Learning (FL) allows machine learning models to train locally on individual mobile devices, synchronizing model updates via a shared server. This approach safeguards user privacy; however, it also generates a heterogeneous…

Machine Learning · Computer Science 2023-09-28 Irene Wang , Prashant J. Nair , Divya Mahajan

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational…

Machine Learning · Computer Science 2025-03-11 Chuan Chen , Tianchi Liao , Xiaojun Deng , Zihou Wu , Sheng Huang , Zibin Zheng

Federated learning (FL) is an emerging machine learning (ML) paradigm that enables heterogeneous edge devices to collaboratively train ML models without revealing their raw data to a logically centralized server. However, beyond the…

Machine Learning · Computer Science 2023-10-03 Jiachen Liu , Fan Lai , Yinwei Dai , Aditya Akella , Harsha Madhyastha , Mosharaf Chowdhury