English
Related papers

Related papers: Effective Heterogeneous Federated Learning via Eff…

200 papers

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Data heterogeneity across clients is one of the key challenges in Federated Learning (FL), which may slow down the global model convergence and even weaken global model performance. Most existing approaches tackle the heterogeneity by…

Machine Learning · Computer Science 2023-07-18 Jun Nie , Danyang Xiao , Lei Yang , Weigang Wu

Mobile Edge Computing (MEC), which incorporates the Cloud, edge nodes and end devices, has shown great potential in bringing data processing closer to the data sources. Meanwhile, Federated learning (FL) has emerged as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Rui Mao

There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where each client learns…

Machine Learning · Computer Science 2021-06-15 Jaehong Yoon , Wonyong Jeong , Giwoong Lee , Eunho Yang , Sung Ju Hwang

Federated Learning (FL) enables collaborative model training across diverse entities while safeguarding data privacy. However, FL faces challenges such as data heterogeneity and model diversity. The Meta-Federated Learning (Meta-FL)…

Machine Learning · Computer Science 2024-06-25 Zahir Alsulaimawi

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Federated learning has allowed the training of statistical models over remote devices without the transfer of raw client data. In practice, training in heterogeneous and large networks introduce novel challenges in various aspects like…

Machine Learning · Computer Science 2020-11-17 Dipankar Sarkar , Sumit Rai , Ankur Narang

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

Federated learning using mobile and Internet of Things devices requires not only the ability to handle heterogeneity of clients' data distributions but also high adaptability to varying communication environments. We propose FedHAW…

Machine Learning · Computer Science 2026-05-04 Ayano Nakai-Kasai , Tadashi Wadayama

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

One of the most challenging issues in federated learning is that the data is often not independent and identically distributed (nonIID). Clients are expected to contribute the same type of data and drawn from one global distribution.…

Machine Learning · Computer Science 2024-01-08 Hung Nguyen , Peiyuan Wu , Morris Chang

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Zhi Ding

Federated Learning (FL) is a distributed learning paradigm that empowers edge devices to collaboratively learn a global model leveraging local data. Simulating FL on GPU is essential to expedite FL algorithm prototyping and evaluations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-26 Min Zhang , Fuxun Yu , Yongbo Yu , Minjia Zhang , Ang Li , Xiang Chen

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

In practical federated learning scenarios, the participating devices may have different bitwidths for computation and memory storage by design. However, despite the progress made in device-heterogeneous federated learning scenarios, the…

Machine Learning · Computer Science 2023-01-12 Jaehong Yoon , Geon Park , Wonyong Jeong , Sung Ju Hwang

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated Learning (FL) is a privacy-preserving machine learning framework facilitating collaborative training across distributed clients. However, its performance is often compromised by data heterogeneity among participants, which can…

Machine Learning · Computer Science 2026-02-16 Ziru Niu , Hai Dong , A. K. Qin

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different…

Machine Learning · Computer Science 2022-05-27 Yaqi Sun , Shijing Si , Jianzong Wang , Yuhan Dong , Zhitao Zhu , Jing Xiao

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo