English
Related papers

Related papers: Achieving Linear Speedup in Non-IID Federated Bile…

200 papers

Hyperparameter selection is critical for stable and efficient convergence of heterogeneous federated learning, where clients differ in computational capabilities, and data distributions are non-IID. Tuning hyperparameters is a manual and…

Machine Learning · Computer Science 2025-10-07 Aayushya Agarwal , Larry Pileggi , Gauri Joshi

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

The recently introduced optimizer, Muon, has gained increasing attention due to its superior performance across a wide range of applications. However, its effectiveness in federated learning remains unexplored. To address this gap, this…

Machine Learning · Computer Science 2025-10-07 Xinwen Zhang , Hongchang Gao

As an emerging technology, federated learning (FL) involves training machine learning models over distributed edge devices, which attracts sustained attention and has been extensively studied. However, the heterogeneity of client data…

Machine Learning · Computer Science 2022-12-29 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

Federated Learning (FL) is an emerging paradigm in machine learning without exposing clients' raw data. In practical scenarios with numerous clients, encouraging fair and efficient client participation in federated learning is of utmost…

Machine Learning · Computer Science 2024-01-30 Simin Javaherian , Sanjeev Panta , Shelby Williams , Md Sirajul Islam , Li Chen

Personalized Federated Learning aims at addressing the challenges of non-IID data in collaborative model training. However, existing methods struggle to balance personalization and generalization, often oversimplifying client similarities…

Machine Learning · Computer Science 2025-12-03 Mattia Giovanni Campana , Franca Delmastro

Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focused on improving accuracy for non-iid data, calibration…

Machine Learning · Computer Science 2024-06-05 Hongyi Peng , Han Yu , Xiaoli Tang , Xiaoxiao Li

The uneven distribution of local data across different edge devices (clients) results in slow model training and accuracy reduction in federated learning. Naive federated learning (FL) strategy and most alternative solutions attempted to…

Federated learning is an emerging distributed machine learning framework which jointly trains a global model via a large number of local devices with data privacy protections. Its performance suffers from the non-vanishing biases introduced…

Machine Learning · Computer Science 2023-07-06 Yan Sun , Li Shen , Tiansheng Huang , Liang Ding , Dacheng Tao

Federated learning refers to the task of machine learning based on decentralized data from multiple clients with secured data privacy. Recent studies show that quantum algorithms can be exploited to boost its performance. However, when the…

Quantum Physics · Physics 2023-01-19 Haimeng Zhao

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance…

Machine Learning · Computer Science 2023-11-15 Yuwei Wang , Runhan Li , Hao Tan , Xuefeng Jiang , Sheng Sun , Min Liu , Bo Gao , Zhiyuan Wu

Personalized federated learning has emerged as a popular approach to training on devices holding statistically heterogeneous data, known as clients. However, most existing approaches require a client to have labeled data for training or…

Machine Learning · Computer Science 2025-05-22 Hossein Zakerinia , Jonathan Scott , Christoph H. Lampert

Functional bilevel optimization (FBO) provides a powerful framework for hierarchical learning in function spaces, yet current methods are limited to static offline settings and perform suboptimally in online, non-stationary scenarios. We…

Machine Learning · Statistics 2026-01-23 Jason Bohne , Ieva Petrulionyte , Michael Arbel , Julien Mairal , Paweł Polak

Federated Learning (FL) is a collaborative machine learning technique to train a global model without obtaining clients' private data. The main challenges in FL are statistical diversity among clients, limited computing capability among…

Machine Learning · Computer Science 2023-03-07 Xiaofeng Liu , Yinchuan Li , Qing Wang , Xu Zhang , Yunfeng Shao , Yanhui Geng

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data. In practice, FL encounters challenges in dealing with partial client…

Machine Learning · Computer Science 2024-10-30 Xin Liu , Wei li , Dazhi Zhan , Yu Pan , Xin Ma , Yu Ding , Zhisong Pan

Federated Composite Optimization (FCO) has emerged as a promising framework for training models with structural constraints (e.g., sparsity) in distributed edge networks. However, simultaneously achieving communication efficiency and…

Optimization and Control · Mathematics 2026-03-10 Pu Qiu , Chen Ouyang , Yongyang Xiong , Keyou You , Wanquan Liu , Yang Shi

Federated learning aims to protect users' privacy while performing data analysis from different participants. However, it is challenging to guarantee the training efficiency on heterogeneous systems due to the various computational…

Machine Learning · Computer Science 2021-08-23 Junyu Luo , Jianlei Yang , Xucheng Ye , Xin Guo , Weisheng Zhao

Federated Learning is a novel paradigm that involves learning from data samples distributed across a large network of clients while the data remains local. It is, however, known that federated learning is prone to multiple system challenges…

Machine Learning · Computer Science 2021-01-01 Amirhossein Reisizadeh , Isidoros Tziotis , Hamed Hassani , Aryan Mokhtari , Ramtin Pedarsani

The purpose of federated learning is to enable multiple clients to jointly train a machine learning model without sharing data. However, the existing methods for training an image segmentation model have been based on an unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Jeffry Wicaksana , Zengqiang Yan , Dong Zhang , Xijie Huang , Huimin Wu , Xin Yang , Kwang-Ting Cheng