English
Related papers

Related papers: FedOUI: OUI-Guided Client Weighting for Federated …

200 papers

Large language models (LLMs) increasingly adopt Mixture-of-Experts (MoE) architectures to scale model capacity while reducing computation. Fine-tuning these MoE-based LLMs often requires access to distributed and privacy-sensitive data,…

Machine Learning · Computer Science 2026-03-24 Zihan Fang , Qianru Wang , Haonan An , Zheng Lin , Yiqin Deng , Xianhao Chen , Yuguang Fang

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID and imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Renping Liu , Liang Liang , Xianzhang Chen , Yujuan Tan

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

Machine Learning · Computer Science 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao

Personalized federated learning (PFL) addresses a critical challenge of collaboratively training customized models for clients with heterogeneous and scarce local data. Conventional federated learning, which relies on a single consensus…

Machine Learning · Computer Science 2025-10-24 Ke Xing , Yanjie Dong , Xiaoyi Fan , Runhao Zeng , Victor C. M. Leung , M. Jamal Deen , Xiping Hu

In the realm of Federated Learning (FL), particularly within the manufacturing sector, the strategy for selecting client weights for server aggregation is pivotal for model performance. This study investigates the comparative effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Vinit Hegiste , Tatjana Legler , Martin Ruskowski

Heterogeneity is a fundamental and challenging issue in federated learning, especially for the graph data due to the complex relationships among the graph nodes. To deal with the heterogeneity, lots of existing methods perform the weighted…

Machine Learning · Computer Science 2024-12-17 Wentao Yu , Shuo Chen , Yongxin Tong , Tianlong Gu , Chen Gong

Federated learning aims to collaboratively model by integrating multi-source information to obtain a model that can generalize across all client data. Existing methods often leverage knowledge distillation or data augmentation to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Runhui Zhang , Sijin Zhou , Zhuang Qi

Personalized federated learning (pFL) enables collaborative training among multiple clients to enhance the capability of customized local models. In pFL, clients may have heterogeneous (also known as non-IID) data, which poses a key…

Machine Learning · Computer Science 2023-12-01 Lingzhi Gao , Zexi Li , Yang Lu , Chao Wu

Federated learning is a promising framework to train neural networks with widely distributed data. However, performance degrades heavily with heterogeneously distributed data. Recent work has shown this is due to the final layer of the…

Machine Learning · Computer Science 2024-03-06 Ha Min Son , Moon-Hyun Kim , Tai-Myoung Chung , Chao Huang , Xin Liu

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Federated learning (FL) is a novel distributed learning framework designed for applications with privacy-sensitive data. Without sharing data, FL trains local models on individual devices and constructs the global model on the server by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-25 Shuaijun Chen , Omid Tavallaie , Michael Henri Hambali , Seid Miad Zandavi , Hamed Haddadi , Nicholas Lane , Song Guo , Albert Y. Zomaya

Since Intersection-over-Union (IoU) based optimization maintains the consistency of the final IoU prediction metric and losses, it has been widely used in both regression and classification branches of single-stage 2D object detectors.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Hualian Sheng , Sijia Cai , Na Zhao , Bing Deng , Jianqiang Huang , Xian-Sheng Hua , Min-Jian Zhao , Gim Hee Lee

Although Federated Learning (FL) enables global model training across clients without compromising their raw data, due to the unevenly distributed data among clients, existing Federated Averaging (FedAvg)-based methods suffer from the…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Zhihao Yue , Xiaofei Xie , Cheng Chen , Yihao Huang , Xian Wei , Xiang Lian , Yang Liu , Mingsong Chen

This paper considers the Federated learning (FL) in a stochastic approximation (SA) framework. Here, each client $i$ trains a local model using its dataset $\mathcal{D}^{(i)}$ and periodically transmits the model parameters $w^{(i)}_n$ to a…

Machine Learning · Computer Science 2025-11-27 Srihari P , Anik Kumar Paul , Bharath Bhikkaji

In Federated Learning (FL), a framework to train machine learning models across distributed data, well-known algorithms like FedAvg tend to have slow convergence rates, resulting in high communication costs during training. To address this…

Machine Learning · Computer Science 2024-02-16 Zhiwei Tang , Tsung-Hui Chang

Federated Learning (FL) has emerged as a powerful paradigm for privacy-preserving model training, yet deployments in sensitive domains such as healthcare face persistent challenges from non-IID data, client unreliability, and adversarial…

Machine Learning · Computer Science 2025-09-24 Ferdinand Kahenga , Antoine Bagula , Sajal K. Das , Patrick Sello

The increasing size and complexity of scientific data could dramatically enhance discovery and prediction for basic scientific applications. Realizing this potential, however, requires novel statistical analysis methods that are both…

Federated learning (FL) involves several clients that share with a fusion center (FC), the model each client has trained with its own data. Conventional FL, which can be interpreted as an estimation or distortion-based approach, ignores the…

Machine Learning · Computer Science 2024-08-06 Hassan Mohamad , Chao Zhang , Samson Lasaulce , Vineeth S Varma , Mérouane Debbah , Mounir Ghogho

Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the…

Machine Learning · Computer Science 2022-03-01 Seunghan Yang , Hyoungseob Park , Junyoung Byun , Changick Kim

Decentralized federated learning (DFL) is an emerging paradigm to enable edge devices collaboratively training a learning model using a device-to-device (D2D) communication manner without the coordination of a parameter server (PS).…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Xiaojun Yuan , Xin Wang , Geoffrey Ye Li