English
Related papers

Related papers: Tackling Resource-Constrained and Data-Heterogenei…

200 papers

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Federated learning has recently gained popularity as a framework for distributed clients to collaboratively train a machine learning model using local data. While traditional federated learning relies on a central server for model…

Machine Learning · Computer Science 2025-09-03 I-Cheng Lin , Osman Yagan , Carlee Joe-Wong

Federated learning (FL) commonly involves clients with diverse communication and computational capabilities. Such heterogeneity can significantly distort the optimization dynamics and lead to objective inconsistency, where the global model…

Machine Learning · Computer Science 2026-02-24 Shudi Weng , Chao Ren , Ming Xiao , Mikael Skoglund

This work presents a new method for enhancing communication efficiency in stochastic Federated Learning that trains over-parameterized random networks. In this setting, a binary mask is optimized instead of the model weights, which are kept…

Machine Learning · Computer Science 2024-03-01 Mohamad Mestoukirdi , Omid Esrafilian , David Gesbert , Qianrui Li , Nicolas Gresset

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Data heterogeneity across participating devices poses one of the main challenges in federated learning as it has been shown to greatly hamper its convergence time and generalization capabilities. In this work, we address this limitation by…

Machine Learning · Computer Science 2021-10-20 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li , Nicolas Gresset

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

One of the most challenging issues in federated learning is that the data is often not independent and identically distributed (nonIID). Clients are expected to contribute the same type of data and drawn from one global distribution.…

Machine Learning · Computer Science 2024-01-08 Hung Nguyen , Peiyuan Wu , Morris Chang

Federated learning (FL) is vulnerable to heterogeneously distributed data, since a common global model in FL may not adapt to the heterogeneous data distribution of each user. To counter this issue, personalized FL (PFL) was proposed to…

Machine Learning · Computer Science 2022-01-28 Tiansheng Huang , Shiwei Liu , Li Shen , Fengxiang He , Weiwei Lin , Dacheng Tao

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

We envision a mobile edge computing (MEC) framework for machine learning (ML) technologies, which leverages distributed client data and computation resources for training high-performance ML models while preserving client privacy. Toward…

Networking and Internet Architecture · Computer Science 2020-01-09 Takayuki Nishio , Ryo Yonetani

The emerging paradigm of federated learning strives to enable collaborative training of machine learning models on the network edge without centrally aggregating raw data and hence, improving data privacy. This sharply deviates from…

Machine Learning · Computer Science 2019-12-03 Manoj Ghuhan Arivazhagan , Vinay Aggarwal , Aaditya Kumar Singh , Sunav Choudhary

Heterogeneity arising from label distribution skew and data scarcity can cause inaccuracy and unfairness in intelligent communication applications that heavily rely on distributed computing. To deal with it, this paper proposes a novel…

Machine Learning · Computer Science 2025-09-18 Chenghao Huang , Xiaolu Chen , Yanru Zhang , Hao Wang

Data scarcity and heterogeneity pose significant performance challenges for personalized federated learning, and these challenges are mainly reflected in overfitting and low precision in existing methods. To overcome these challenges, a…

Machine Learning · Computer Science 2023-02-07 Wangzhuo Yang , Bo Chen , Yijun Shen , Jiong Liu , Li Yu

Efficient deployment of deep neural networks across many devices and resource constraints, particularly on edge devices, is one of the most challenging problems in the presence of data-privacy preservation issues. Conventional approaches…

Machine Learning · Computer Science 2022-10-07 Taehyeon Kim , Se-Young Yun

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

Traditional Federated Learning (FL) faces significant challenges in terms of efficiency and accuracy, particularly in heterogeneous environments where clients employ diverse model architectures and have varying computational resources. Such…

Machine Learning · Computer Science 2025-05-13 Jiacheng Wang , Hongtao Lv , Lei Liu

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

Machine Learning · Computer Science 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp