English
Related papers

Related papers: Data Heterogeneity and Forgotten Labels in Split F…

200 papers

Federated learning (FL) is a new machine learning framework which trains a joint model across a large amount of decentralized computing devices. Existing methods, e.g., Federated Averaging (FedAvg), are able to provide an optimization…

Machine Learning · Computer Science 2021-02-15 Xingyu Li , Zhe Qu , Bo Tang , Zhuo Lu

Federated learning (FL) is a machine learning technique that enables participants to collaboratively train high-quality models without exchanging their private data. Participants utilizing cross-silo federated learning (CS-FL) settings are…

Machine Learning · Computer Science 2022-08-19 Xingjian Cao , Zonghang Li , Gang Sun , Hongfang Yu , Mohsen Guizani

Federated Learning (FL), Split Learning (SL), and SplitFed Learning (SFL) are three recent developments in distributed machine learning that are gaining attention due to their ability to preserve the privacy of raw data. Thus, they are…

Machine Learning · Computer Science 2021-09-21 Praveen Joshi , Chandra Thapa , Seyit Camtepe , Mohammed Hasanuzzamana , Ted Scully , Haithem Afli

In federated learning, the heterogeneity of client data has a great impact on the performance of model training. Many heterogeneity issues in this process are raised by non-independently and identically distributed (non-IID) data. To…

Machine Learning · Computer Science 2026-03-25 Xiufang Shi , Wei Zhang , Yuheng Li , Mincheng Wu , Zhenyu Wen , Shibo He , Tejal Shah , Rajiv Ranjan

Mobile devices contribute more than half of the world's web traffic, providing massive and diverse data for powering various federated learning (FL) applications. In order to avoid the communication bottleneck on the parameter server (PS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-03 Yunming Liao , Yang Xu , Hongli Xu , Zhiwei Yao , Liusheng Huang , Chunming Qiao

Recently, a large number of data sources opened up by informatization intensify the data heterogeneity, the faster speed of data generation and the gradual implementation of data regulations limit the storage time of data. In personalized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Sixing Tan , Xianmin Liu

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

In this work, we tackle the problem of performing multi-label classification in the case of extremely heterogeneous data and with decentralized Machine Learning. Solving this issue is very important in IoT scenarios, where data coming from…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Rastko Gajanin , Anastasiya Danilenka , Andrea Morichetta , Stefan Nastic

Federated Learning (FL) can be affected by data and device heterogeneities, caused by clients' different local data distributions and latencies in uploading model updates (i.e., staleness). Traditional schemes consider these heterogeneities…

Machine Learning · Computer Science 2024-12-25 Haoming Wang , Wei Gao

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency…

Machine Learning · Computer Science 2025-11-26 Kun Guo , Xuefei Li , Xijun Wang , Howard H. Yang , Wei Feng , Tony Q. S. Quek

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated learning (FL) has emerged as a promising approach to training machine learning models across decentralized data sources while preserving data privacy, particularly in manufacturing and shared production environments. However, the…

Machine Learning · Computer Science 2024-08-20 Tatjana Legler , Vinit Hegiste , Ahmed Anwar , Martin Ruskowski

Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge.…

Machine Learning · Computer Science 2021-11-17 Jing Cao , Zirui Lian , Weihong Liu , Zongwei Zhu , Cheng Ji

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

Federated Learning (FL) suffers from severe performance degradation due to the data heterogeneity among clients. Existing works reveal that the fundamental reason is that data heterogeneity can cause client drift where the local model…

Machine Learning · Computer Science 2025-01-22 Haoran Xu , Jiaze Li , Wanyi Wu , Hao Ren

Federated Learning (FL) allows several clients to construct a common global machine-learning model without having to share their data. FL, however, faces the challenge of statistical heterogeneity between the client's data, which degrades…

Machine Learning · Computer Science 2024-01-26 Zahra Taghiyarrenani , Abdallah Alabdallah , Slawomir Nowaczyk , Sepideh Pashami

Federated learning (FL) allows edge devices to collaboratively train models without sharing local data. As FL gains popularity, clients may need to train multiple unrelated FL models, but communication constraints limit their ability to…

Machine Learning · Computer Science 2025-04-23 Haoran Zhang , Zejun Gong , Zekai Li , Marie Siew , Carlee Joe-Wong , Rachid El-Azouzi

Federated learning-based semantic segmentation (FSS) has drawn widespread attention via decentralized training on local clients. However, most FSS models assume categories are fixed in advance, thus heavily undergoing forgetting on old…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiahua Dong , Duzhen Zhang , Yang Cong , Wei Cong , Henghui Ding , Dengxin Dai

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. However, data and system heterogeneity often cause catastrophic forgetting and unbounded drift in model updates, leading…

Machine Learning · Computer Science 2026-04-28 Taehwan Yoon , Bongjun Choi , Wesley De Neve