English
Related papers

Related papers: Measuring Data Similarity for Efficient Federated …

200 papers

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

Machine Learning · Computer Science 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

Federated learning (FL) is a powerful distributed machine learning framework where a server aggregates models trained by different clients without accessing their private data. Hierarchical FL, with a client-edge-cloud aggregation…

Machine Learning · Computer Science 2023-01-10 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Federated Learning (FL) presents an innovative approach to privacy-preserving distributed machine learning and enables efficient crowd intelligence on a large scale. However, a significant challenge arises when coordinating FL with crowd…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Yuhao Zhou , Minjia Shi , Yuxin Tian , Yuanxi Li , Qing Ye , Jiancheng Lv

Federated Learning is a novel paradigm that involves learning from data samples distributed across a large network of clients while the data remains local. It is, however, known that federated learning is prone to multiple system challenges…

Machine Learning · Computer Science 2021-01-01 Amirhossein Reisizadeh , Isidoros Tziotis , Hamed Hassani , Aryan Mokhtari , Ramtin Pedarsani

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik

Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Jiaqi Wang , Yuzhong Chen , Yuhang Wu , Mahashweta Das , Hao Yang , Fenglong Ma

Federated learning has received great attention for its capability to train a large-scale model in a decentralized manner without needing to access user data directly. It helps protect the users' private data from centralized collecting.…

Machine Learning · Computer Science 2023-02-07 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

Federated learning (FL) involves several clients that share with a fusion center (FC), the model each client has trained with its own data. Conventional FL, which can be interpreted as an estimation or distortion-based approach, ignores the…

Machine Learning · Computer Science 2024-08-06 Hassan Mohamad , Chao Zhang , Samson Lasaulce , Vineeth S Varma , Mérouane Debbah , Mounir Ghogho

Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on the convergence…

Machine Learning · Computer Science 2021-12-22 Bing Luo , Wenli Xiao , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated learning (FL) is increasingly adopted in domains like healthcare, where data privacy is paramount. A fundamental challenge in these systems is statistical heterogeneity-the fact that data distributions vary significantly across…

Machine Learning · Computer Science 2026-02-12 Zijian Wang , Xiaofei Zhang , Xin Zhang , Yukun Liu , Qiong Zhang

In diverse fields ranging from finance to omics, it is increasingly common that data is distributed and with multiple individual sources (referred to as ``clients'' in some studies). Integrating raw data, although powerful, is often not…

Methodology · Statistics 2022-11-08 Yuanxing Chen , Qingzhao Zhang , Shuangge Ma , Kuangnan Fang

Federated learning (FL) is an important technique for learning models from decentralized data in a privacy-preserving way. Existing FL methods usually uniformly sample clients for local model learning in each round. However, different…

Machine Learning · Computer Science 2023-06-27 Tao Qi , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Statistical heterogeneity across clients in a Federated Learning (FL) system increases the algorithm convergence time and reduces the generalization performance, resulting in a large communication overhead in return for a poor model. To…

Machine Learning · Computer Science 2023-04-26 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li

To reduce the communication overhead caused by parallel training of multiple clients, various federated learning (FL) techniques use random client sampling. Nonetheless, ensuring the efficacy of random sampling and determining the optimal…

Information Retrieval · Computer Science 2024-05-28 Kirandeep Kaur , Sujit Gujar , Shweta Jain

Client selection strategies are widely adopted to handle the communication-efficient problem in recent studies of Federated Learning (FL). However, due to the large variance of the selected subset's update, prior selection approaches with a…

Machine Learning · Computer Science 2022-04-28 Guangyuan Shen , Dehong Gao , Libin Yang , Fang Zhou , Duanxiao Song , Wei Lou , Shirui Pan

In this paper, we increase the availability and integration of devices in the learning process to enhance the convergence of federated learning (FL) models. To address the issue of having all the data in one location, federated learning,…

Artificial Intelligence · Computer Science 2022-11-08 Mario Chahoud , Hani Sami , Azzam Mourad , Safa Otoum , Hadi Otrok , Jamal Bentahar , Mohsen Guizani

Federated Learning (FL) over wireless network enables data-conscious services by leveraging the ubiquitous intelligence at network edge for privacy-preserving model training. As the proliferation of context-aware services, the diversified…

Machine Learning · Computer Science 2022-02-08 Y. Li , X. Qin , H. Chen , K. Han , P. Zhang

Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication…

Machine Learning · Computer Science 2019-01-09 Sebastian Caldas , Jakub Konečny , H. Brendan McMahan , Ameet Talwalkar