English
Related papers

Related papers: Federated Optimization with Doubly Regularized Dri…

200 papers

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

Machine Learning · Computer Science 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Over-the-air computation is a communication-efficient solution for federated learning (FL). In such a system, iterative procedure is performed: Local gradient of private loss function is updated, amplified and then transmitted by every…

Machine Learning · Computer Science 2023-09-06 Rongfei Fan , Xuming An , Shiyuan Zuo , Han Hu

There is a growing interest in the distributed optimization framework that goes under the name of Federated Learning (FL). In particular, much attention is being turned to FL scenarios where the network is strongly heterogeneous in terms of…

Machine Learning · Computer Science 2022-09-14 Nicolò Dal Fabbro , Subhrakanti Dey , Michele Rossi , Luca Schenato

Federated learning (FL) allows multiple clients to collaboratively train a deep learning model. One major challenge of FL is when data distribution is heterogeneous, i.e., differs from one client to another. Existing personalized FL…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Haolin Yuan , Bo Hui , Yuchen Yang , Philippe Burlina , Neil Zhenqiang Gong , Yinzhi Cao

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

Machine Learning · Computer Science 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan

Data heterogeneity across clients is a key challenge in federated learning. Prior works address this by either aligning client and server models or using control variates to correct client model drift. Although these methods achieve fast…

Machine Learning · Computer Science 2023-06-12 Bo Li , Mikkel N. Schmidt , Tommy S. Alstrøm , Sebastian U. Stich

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Federated learning (FL) has emerged as a popular technique for distributing machine learning across wireless edge devices. We examine FL under two salient properties of contemporary networks: device-server communication delays and device…

Networking and Internet Architecture · Computer Science 2022-02-08 David Nickel , Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolo Michelusi , Christopher G. Brinton

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

Federated learning (FL) is a new machine learning framework which trains a joint model across a large amount of decentralized computing devices. Existing methods, e.g., Federated Averaging (FedAvg), are able to provide an optimization…

Machine Learning · Computer Science 2021-02-15 Xingyu Li , Zhe Qu , Bo Tang , Zhuo Lu

As a popular paradigm for juggling data privacy and collaborative training, federated learning (FL) is flourishing to distributively process the large scale of heterogeneous datasets on edged clients. Due to bandwidth limitations and…

Machine Learning · Computer Science 2025-01-22 Yan Sun , Li Shen , Dacheng Tao

Federated learning is a distributed learning that allows each client to keep the original data locally and only upload the parameters of the local model to the server. Despite federated learning can address data island, it remains…

Machine Learning · Computer Science 2022-11-21 Ming Yang , Yanhan Wang , Xin Wang , Zhenyong Zhang , Xiaoming Wu , Peng Cheng

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Federated Learning (FL) models often experience client drift caused by heterogeneous data, where the distribution of data differs across clients. To address this issue, advanced research primarily focuses on manipulating the existing…

Machine Learning · Computer Science 2024-03-15 Zhenheng Tang , Yonggang Zhang , Shaohuai Shi , Xinmei Tian , Tongliang Liu , Bo Han , Xiaowen Chu

This work addresses the key challenges of applying federated learning to large-scale deep neural networks, particularly the issue of client drift due to data heterogeneity across clients and the high costs of communication, computation, and…

Machine Learning · Computer Science 2025-09-08 Jiaojiao Zhang , Yuqi Xu , Kun Yuan

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication…

Machine Learning · Computer Science 2026-02-18 Mohammad Partohaghighi , Roummel Marcia , YangQuan Chen