English
Related papers

Related papers: Escaping Saddle Points in Heterogeneous Federated …

200 papers

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

Federated learning (FL) enables edge-devices to collaboratively learn a model without disclosing their private data to a central aggregating server. Most existing FL algorithms require models of identical architecture to be deployed across…

Machine Learning · Computer Science 2022-04-28 Yae Jee Cho , Andre Manoel , Gauri Joshi , Robert Sim , Dimitrios Dimitriadis

This paper explores second-order optimization methods in Federated Learning (FL), addressing the critical challenges of slow convergence and the excessive communication rounds required to achieve optimal performance from the global model.…

Machine Learning · Computer Science 2025-05-30 Mrinmay Sen , Sidhant R Nair , C Krishna Mohan

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated learning (FL) has prevailed as an efficient and privacy-preserved scheme for distributed learning. In this work, we mainly focus on the optimization of computation and communication in FL from a view of pruning. By adopting…

Machine Learning · Computer Science 2023-03-14 Zheqi Zhu , Yuchen Shi , Jiajun Luo , Fei Wang , Chenghui Peng , Pingyi Fan , Khaled B. Letaief

Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this…

Machine Learning · Computer Science 2024-10-01 Zhidong Gao , Yu Zhang , Yanmin Gong , Yuanxiong Guo

Edge computing allows artificial intelligence and machine learning models to be deployed on edge devices, where they can learn from local data and collaborate to form a global model. Federated learning (FL) is a distributed machine learning…

Machine Learning · Computer Science 2024-05-03 Chris Xing Tian , Yibing Liu , Haoliang Li , Ray C. C. Cheung , Shiqi Wang

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Machine Learning · Computer Science 2020-12-23 Canh T. Dinh , Nguyen H. Tran , Minh N. H. Nguyen , Choong Seon Hong , Wei Bao , Albert Y. Zomaya , Vincent Gramoli

Federated learning (FL) is a distributed machine learning technology for next-generation AI systems that allows a number of workers, i.e., edge devices, collaboratively learn a shared global model while keeping their data locally to prevent…

Networking and Internet Architecture · Computer Science 2022-06-01 Pinyarash Pinyoanuntapong , Prabhu Janakaraj , Ravikumar Balakrishnan , Minwoo Lee , Chen Chen , Pu Wang

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

Machine Learning · Computer Science 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Federated learning (FL) has emerged as a promising paradigm within edge computing (EC) systems, enabling numerous edge devices to collaboratively train artificial intelligence (AI) models while maintaining data privacy. To overcome the…

Machine Learning · Computer Science 2025-08-13 Yuze Liu , Tiehua Zhang , Zhishu Shen , Libing Wu , Shiping Chen , Jiong Jin

Distributed learning, particularly Federated Learning (FL), faces a significant bottleneck in the communication cost, particularly the uplink transmission of client-to-server updates, which is often constrained by asymmetric bandwidth…

Machine Learning · Computer Science 2026-02-19 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

The diffusion strategy for distributed learning from streaming data employs local stochastic gradient updates along with exchange of iterates over neighborhoods. In Part I [2] of this work we established that agents cluster around a network…

Multiagent Systems · Computer Science 2019-07-04 Stefan Vlaski , Ali H. Sayed

Error feedback (EF), also known as error compensation, is an immensely popular convergence stabilization mechanism in the context of distributed training of supervised machine learning models enhanced by the use of contractive communication…

Machine Learning · Computer Science 2021-06-10 Peter Richtárik , Igor Sokolov , Ilyas Fatkhullin

Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge.…

Machine Learning · Computer Science 2021-11-17 Jing Cao , Zirui Lian , Weihong Liu , Zongwei Zhu , Cheng Ji

Federated learning (FL) allows multiple clients cooperatively train models without disclosing local data. However, the existing works fail to address all these practical concerns in FL: limited communication resources, dynamic network…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zhida Jiang , Yang Xu , Hongli Xu , Zhiyuan Wang , Chen Qian