English
Related papers

Related papers: An Efficient Subspace Algorithm for Federated Lear…

200 papers

In the federated learning scenario, geographically distributed clients collaboratively train a global model. Data heterogeneity among clients significantly results in inconsistent model updates, which evidently slow down model convergence.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Xujing Li , Min Liu , Sheng Sun , Yuwei Wang , Hui Jiang , Xuefeng Jiang

While federated learning leverages distributed client resources, it faces challenges due to heterogeneous client capabilities. This necessitates allocating models suited to clients' resources and careful parameter aggregation to accommodate…

Machine Learning · Computer Science 2024-10-04 Yujin Shin , Kichang Lee , Sungmin Lee , You Rim Choi , Hyung-Sin Kim , JeongGil Ko

The prevalent communication efficient federated learning (FL) frameworks usually take advantages of model gradient compression or model distillation. However, the unbalanced local data distributions (either in quantity or quality) of…

Machine Learning · Computer Science 2023-01-31 Beibei Li , Zerui Shao , Ao Liu , Peiran Wang

Federated learning describes the distributed training of models across multiple clients while keeping the data private on-device. In this work, we view the server-orchestrated federated learning process as a hierarchical latent variable…

Machine Learning · Computer Science 2021-11-22 Christos Louizos , Matthias Reisser , Joseph Soriaga , Max Welling

In the era of big data, leveraging information from multiple clients while preserving data privacy has emerged as a critical challenge in modern statistical modeling and forecasting. This paper introduces a privacy-preserving federated…

Methodology · Statistics 2026-04-09 Kejun Chen , Qianqian Zhu

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Federated learning has drawn widespread interest from researchers, yet the data heterogeneity across edge clients remains a key challenge, often degrading model performance. Existing methods enhance model compatibility with data…

Machine Learning · Computer Science 2026-01-06 Qiantao Yang , Liquan Chen , Mingfu Xue , Songze Li

Federated learning (FL) enables multiple clients to train models collectively while preserving data privacy. However, FL faces challenges in terms of communication cost and data heterogeneity. One-shot federated learning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Matias Mendieta , Guangyu Sun , Chen Chen

Multi-satellite, multi-modality in-orbit fusion is a challenging task as it explores the fusion representation of complex high-dimensional data under limited computational resources. Deep neural networks can reveal the underlying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 DaiXun Li , Weiying Xie , Yunsong Li , Leyuan Fang

Federated learning (FL) faces critical challenges, particularly in heterogeneous environments where non-independent and identically distributed data across clients can lead to unfair and inefficient model performance. In this work, we…

Machine Learning · Computer Science 2025-05-22 Mounssif Krouka , Chaouki Ben Issaid , Mehdi Bennis

Federated learning can train models without directly providing local data to the server. However, the frequent updating of the local model brings the problem of large communication overhead. Recently, scholars have achieved the…

Machine Learning · Computer Science 2024-05-07 Ying Zhuansun , Dandan Li , Xiaohong Huang , Caijun Sun

Federated learning has emerged as a promising, massively distributed way to train a joint deep model over large amounts of edge devices while keeping private user data strictly on device. In this work, motivated from ensuring fairness among…

Machine Learning · Computer Science 2023-01-25 Zeou Hu , Kiarash Shaloudegi , Guojun Zhang , Yaoliang Yu

Federated learning (FL) is an important technique for learning models from decentralized data in a privacy-preserving way. Existing FL methods usually uniformly sample clients for local model learning in each round. However, different…

Machine Learning · Computer Science 2023-06-27 Tao Qi , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated learning is renowned for its efficacy in distributed model training, ensuring that users, called clients, retain data privacy by not disclosing their data to the central server that orchestrates collaborations. Most previous work…

Machine Learning · Computer Science 2024-10-30 Pouya M. Ghari , Yanning Shen

Federated learning is a decentralized machine learning framework that enables collaborative model training without revealing raw data. Due to the diverse hardware and software limitations, a client may not always be available for the…

Machine Learning · Computer Science 2024-02-21 Lili Su , Ming Xiang , Jiaming Xu , Pengkun Yang

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

Federated Learning (FL) enables decentralized model training across multiple clients while optionally preserving data privacy. However, communication efficiency remains a critical bottleneck, particularly for large-scale models. In this…

Machine Learning · Computer Science 2025-11-11 Arnaud Descours , Léonard Deroose , Jan Ramon

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

Efficient and controllable data unlearning in federated learning remains challenging, due to the trade-off between forgetting and retention performance. Especially under non-independent and identically distributed (non-IID) settings, where…

Machine Learning · Computer Science 2025-11-17 Qinghui Gong , Xue Yang , Xiaohu Tang

In this work, we propose a federated dynamical low-rank training (FeDLRT) scheme to reduce client compute and communication costs - two significant performance bottlenecks in horizontal federated learning. Our method builds upon dynamical…

Machine Learning · Computer Science 2024-06-27 Steffen Schotthöfer , M. Paul Laiu