English
Related papers

Related papers: FedUV: Uniformity and Variance for Heterogeneous F…

200 papers

The emerging paradigm of federated learning strives to enable collaborative training of machine learning models on the network edge without centrally aggregating raw data and hence, improving data privacy. This sharply deviates from…

Machine Learning · Computer Science 2019-12-03 Manoj Ghuhan Arivazhagan , Vinay Aggarwal , Aaditya Kumar Singh , Sunav Choudhary

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance…

Machine Learning · Computer Science 2023-11-15 Yuwei Wang , Runhan Li , Hao Tan , Xuefeng Jiang , Sheng Sun , Min Liu , Bo Gao , Zhiyuan Wu

In contrast to centralized model training that involves data collection, federated learning (FL) enables remote clients to collaboratively train a model without exposing their private data. However, model performance usually degrades in FL…

Machine Learning · Computer Science 2023-04-21 Ye Lin Tun , Chu Myaet Thwal , Yu Min Park , Seong-Bae Park , Choong Seon Hong

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated Learning (FL) is a way for machines to learn from data that is kept locally, in order to protect the privacy of clients. This is typically done using local SGD, which helps to improve communication efficiency. However, such a…

Machine Learning · Computer Science 2023-06-01 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning is a popular paradigm for machine learning. Ideally, federated learning works best when all clients share a similar data distribution. However, it is not always the case in the real world. Therefore, the topic of…

Machine Learning · Computer Science 2022-12-20 Yuchuan Huang , Chen Hu

Recently, data heterogeneity among the training datasets on the local clients (a.k.a., Non-IID data) has attracted intense interest in Federated Learning (FL), and many personalized federated learning methods have been proposed to handle…

Machine Learning · Computer Science 2022-11-22 Xueyang Tang , Song Guo , Jie Zhang

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel

Federated learning is a distributed learning that allows each client to keep the original data locally and only upload the parameters of the local model to the server. Despite federated learning can address data island, it remains…

Machine Learning · Computer Science 2022-11-21 Ming Yang , Yanhan Wang , Xin Wang , Zhenyong Zhang , Xiaoming Wu , Peng Cheng

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

Federated learning allows multiple clients to collaborate to train high-performance deep learning models while keeping the training data locally. However, when the local data of all clients are not independent and identically distributed…

Machine Learning · Computer Science 2021-09-28 Xutong Mu , Yulong Shen , Ke Cheng , Xueli Geng , Jiaxuan Fu , Tao Zhang , Zhiwei Zhang

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

Machine Learning · Computer Science 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

Non-IID dataset and heterogeneous environment of the local clients are regarded as a major issue in Federated Learning (FL), causing a downturn in the convergence without achieving satisfactory performance. In this paper, we propose a novel…

Machine Learning · Computer Science 2021-12-30 Hunmin Lee , Yueyang Liu , Donghyun Kim , Yingshu Li

Federated learning has made an important contribution to data privacy-preserving. Many previous works are based on the assumption that the data are independently identically distributed (IID). As a result, the model performance on…

Machine Learning · Computer Science 2020-09-17 Anxun He , Jianzong Wang , Zhangcheng Huang , Jing Xiao

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

A widely recognized difficulty in federated learning arises from the statistical heterogeneity among clients: local datasets often originate from distinct yet not entirely unrelated probability distributions, and personalization is,…

Machine Learning · Statistics 2025-03-12 Shuxiao Chen , Qinqing Zheng , Qi Long , Weijie J. Su

Federated Learning aims at training a global model from multiple decentralized devices (i.e. clients) without exchanging their private local data. A key challenge is the handling of non-i.i.d. (independent identically distributed) data…

Machine Learning · Computer Science 2022-07-20 Xin Dong , Sai Qian Zhang , Ang Li , H. T. Kung

Data heterogeneity across clients in federated learning (FL) settings is a widely acknowledged challenge. In response, personalized federated learning (PFL) emerged as a framework to curate local models for clients' tasks. In PFL, a common…

Machine Learning · Computer Science 2023-12-27 Yutong Dai , Zeyuan Chen , Junnan Li , Shelby Heinecke , Lichao Sun , Ran Xu