English
Related papers

Related papers: FedPM: Federated Learning Using Second-order Optim…

200 papers

In federated learning (FL), a number of devices train their local models and upload the corresponding parameters or gradients to the base station (BS) to update the global model while protecting their data privacy. However, due to the…

Machine Learning · Computer Science 2022-05-04 Zhigang Yan , Dong Li , Zhichao Zhang , Jiguang He

Very few methods for hybrid federated learning, where clients only hold subsets of both features and samples, exist. Yet, this scenario is extremely important in practical settings. We provide a fast, robust algorithm for hybrid federated…

Machine Learning · Computer Science 2025-02-28 Tom Overman , Garrett Blum , Diego Klabjan

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

Machine Learning · Computer Science 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

In federated learning (FL), the multi-step update and data heterogeneity among clients often lead to a loss landscape with sharper minima, degenerating the performance of the resulted global model. Prevalent federated approaches incorporate…

Machine Learning · Computer Science 2024-05-30 Ziqing Fan , Shengchao Hu , Jiangchao Yao , Gang Niu , Ya Zhang , Masashi Sugiyama , Yanfeng Wang

Federated Learning (FL) facilitates collaborative model training across decentralized clients while preserving data privacy by avoiding raw data exchange. Despite its potential, FL performance is often compromised by data heterogeneity…

Machine Learning · Computer Science 2026-05-12 Qijun Hou , Yuchen Shi , Pingyi Fan , Khaled B. Letaief

Federated prototype learning (FPL), as a solution to heterogeneous federated learning (HFL), effectively alleviates the challenges of data and model heterogeneity.However, existing FPL methods fail to balance the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ningzhi Gao , Siquan Huang , Leyu Shi , Ying Gao

Federated Learning (FL) enables multiple parties to collaboratively train machine learning models without sharing raw data. However, before training, data must be preprocessed to address missing values, inconsistent formats, and…

Machine Learning · Computer Science 2026-02-12 Xuefeng Xu , Graham Cormode

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold…

Machine Learning · Computer Science 2024-06-18 Liwei Che , Jiaqi Wang , Xinyue Liu , Fenglong Ma

Federated learning (FL) is a promising technology that enables edge devices/clients to collaboratively and iteratively train a machine learning model under the coordination of a central server. The most common approach to FL is first-order…

Machine Learning · Computer Science 2025-01-22 Shayan Mohajer Hamidi , Linfeng Ye

In this work, we quantitatively calibrate the performance of global and local models in federated learning through a multi-criterion optimization-based framework, which we cast as a constrained program. The objective of a device is its…

Machine Learning · Computer Science 2023-02-02 Amrit Singh Bedi , Chen Fan , Alec Koppel , Anit Kumar Sahu , Brian M. Sadler , Furong Huang , Dinesh Manocha

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data.…

Machine Learning · Computer Science 2026-04-07 Liwei Deng , Qingxiang Liu , Xinhe Niu , Shengchao Chen , Sheng Sun , Yuankai Wu , Guodong Long , Yuxuan Liang

Federated Learning (FL) has emerged as a promising solution in Edge Computing (EC) environments to process the proliferation of data generated by edge devices. By collaboratively optimizing the global machine learning models on distributed…

Machine Learning · Computer Science 2024-02-14 Yongzhe Jia , Xuyun Zhang , Amin Beheshti , Wanchun Dou

Aligning large language models (LLMs) with human preferences in federated learning (FL) is challenging due to decentralized, privacy-sensitive, and highly non-IID preference data. Direct Preference Optimization (DPO) offers an efficient…

Machine Learning · Computer Science 2026-03-23 Kewen Zhu , Liping Yi , Zhiming Zhao , Zhuang Qi , Han Yu , Qinghua Hu

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

Machine Learning · Computer Science 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved…

Machine Learning · Computer Science 2025-01-22 Mustafa Ghaleb , Mohanad Obeed , Muhamad Felemban , Anas Chaaban , Halim Yanikomeroglu