English
Related papers

Related papers: Local-Global Knowledge Distillation in Heterogeneo…

200 papers

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated Learning (FL) enables privacy-preserving multi-source information fusion (MSIF) but is challenged by client drift in highly heterogeneous data settings. Many existing drift-mitigation strategies rely on reference-based…

Machine Learning · Computer Science 2026-02-12 Jungwon Seo , Ferhat Ozgur Catak , Chunming Rong , Kibeom Hong , Minhoe Kim

Federated graph learning is a widely recognized technique that promotes collaborative training of graph neural networks (GNNs) by multi-client graphs.However, existing approaches heavily rely on the communication of model parameters or…

Machine Learning · Computer Science 2025-05-06 Hao Zhang , Xunkai Li , Yinlin Zhu , Lianglin Hu

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

Existing federated learning paradigms usually extensively exchange distributed models at a central solver to achieve a more powerful model. However, this would incur severe communication burden between a server and multiple clients…

Machine Learning · Computer Science 2022-09-30 Ping Liu , Xin Yu , Joey Tianyi Zhou

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

Machine Learning · Computer Science 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

With the increasing multimodal knowledge privatization requirements, multimodal knowledge graphs in different institutes are usually decentralized, lacking of effective collaboration system with both stronger reasoning ability and…

Machine Learning · Computer Science 2025-06-30 Ying Zhang , Yu Zhao , Xuhui Sui , Baohang Zhou , Xiangrui Cai , Li Shen , Xiaojie Yuan , Dacheng Tao

Data privacy and silos are nontrivial and greatly challenging in many real-world applications. Federated learning is a decentralized approach to training models across multiple local clients without the exchange of raw data from client…

Machine Learning · Computer Science 2024-03-01 Xin Yang , Hao Yu , Xin Gao , Hao Wang , Junbo Zhang , Tianrui Li

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Model heterogeneity poses a significant challenge in Heterogeneous Federated Learning (HtFL). In scenarios with diverse model architectures, directly aggregating model parameters is impractical, leading HtFL methods to incorporate an extra…

Machine Learning · Computer Science 2025-06-04 Jianqing Zhang , Yang Liu , Yang Hua , Jian Cao , Qiang Yang

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-08 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

In the federated learning scenario, geographically distributed clients collaboratively train a global model. Data heterogeneity among clients significantly results in inconsistent model updates, which evidently slow down model convergence.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Xujing Li , Min Liu , Sheng Sun , Yuwei Wang , Hui Jiang , Xuefeng Jiang

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to construct large public datasets for machine learning.…

Machine Learning · Computer Science 2022-05-10 Wei Zhu , Jiebo Luo , Andrew White

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated learning (FL) has shown great potential in medical image computing since it provides a decentralized learning paradigm that allows multiple clients to train a model collaboratively without privacy leakage. However, current studies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Meilu Zhu , Qiushi Yang , Zhifan Gao , Yixuan Yuan , Jun Liu

Federated Learning (FL) is a privacy-preserving machine learning framework facilitating collaborative training across distributed clients. However, its performance is often compromised by data heterogeneity among participants, which can…

Machine Learning · Computer Science 2026-02-16 Ziru Niu , Hai Dong , A. K. Qin