English
Related papers

Related papers: Federated Learning with Fair Averaging

200 papers

Federated learning (FL) is a distributed machine learning strategy that enables participants to collaborate and train a shared model without sharing their individual datasets. Privacy and fairness are crucial considerations in FL. While FL…

Machine Learning · Computer Science 2023-05-24 Ayush K. Varshney , Sonakshi Garg , Arka Ghosh , Sargam Gupta

Federated Learning (FL) is a distributed learning paradigm that scales on-device learning collaboratively and privately. Standard FL algorithms such as FedAvg are primarily geared towards smooth unconstrained settings. In this paper, we…

Machine Learning · Computer Science 2021-06-08 Honglin Yuan , Manzil Zaheer , Sashank Reddi

Federated Learning (FL) coordinates with numerous heterogeneous devices to collaboratively train a shared model while preserving user privacy. Despite its multiple advantages, FL faces new challenges. One challenge arises when devices drop…

Machine Learning · Computer Science 2021-06-09 Xinran Gu , Kaixuan Huang , Jingzhao Zhang , Longbo Huang

Federated learning (FL) stands as a paradigmatic approach that facilitates model training across heterogeneous and diverse datasets originating from various data providers. However, conventional FLs fall short of achieving consistent…

Machine Learning · Computer Science 2024-08-28 Jiashi Gao , Xin Yao , Xuetao Wei

Data heterogeneity across clients is a key challenge in federated learning. Prior works address this by either aligning client and server models or using control variates to correct client model drift. Although these methods achieve fast…

Machine Learning · Computer Science 2023-06-12 Bo Li , Mikkel N. Schmidt , Tommy S. Alstrøm , Sebastian U. Stich

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible…

Machine Learning · Computer Science 2023-05-22 Raphael Poulain , Mirza Farhan Bin Tarek , Rahmatollah Beheshti

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Existing theory predicts that data heterogeneity will degrade the performance of the Federated Averaging (FedAvg) algorithm in federated learning. However, in practice, the simple FedAvg algorithm converges very well. This paper explains…

Machine Learning · Computer Science 2022-06-13 Jianyu Wang , Rudrajit Das , Gauri Joshi , Satyen Kale , Zheng Xu , Tong Zhang

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. It has recently become a hot research topic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Afaf Taïk , Soumaya Cherkaoui

Federated learning (FL) allows agents to jointly train a global model without sharing their local data. However, due to the heterogeneous nature of local data, it is challenging to optimize or even define fairness of the trained global…

Machine Learning · Computer Science 2023-11-17 Wenda Chu , Chulin Xie , Boxin Wang , Linyi Li , Lang Yin , Arash Nourian , Han Zhao , Bo Li

Federated learning (FL) has attracted widespread attention because it supports the joint training of models by multiple participants without moving private dataset. However, there are still many security issues in FL that deserve…

Cryptography and Security · Computer Science 2024-05-08 Huang Zeng , Anjia Yang , Jian Weng , Min-Rong Chen , Fengjun Xiao , Yi Liu , Ye Yao

Classic Machine Learning techniques require training on data available in a single data lake. However, aggregating data from different owners is not always convenient for different reasons, including security, privacy and secrecy. Data…

Machine Learning · Computer Science 2023-04-03 Bruno Casella , Roberto Esposito , Carlo Cavazzoni , Marco Aldinucci

Edge computing allows artificial intelligence and machine learning models to be deployed on edge devices, where they can learn from local data and collaborate to form a global model. Federated learning (FL) is a distributed machine learning…

Machine Learning · Computer Science 2024-05-03 Chris Xing Tian , Yibing Liu , Haoliang Li , Ray C. C. Cheung , Shiqi Wang

The increasingly stringent regulations on privacy protection have sparked interest in federated learning. As a distributed machine learning framework, it bridges isolated data islands by training a global model over devices while keeping…

Information Retrieval · Computer Science 2022-05-27 Zhitao Zhu , Shijing Si , Jianzong Wang , Jing Xiao
‹ Prev 1 4 5 6 7 8 10 Next ›