English
Related papers

Related papers: Redefining non-IID Data in Federated Learning for …

200 papers

In federated learning, federated unlearning is a technique that provides clients with a rollback mechanism that allows them to withdraw their data contribution without training from scratch. However, existing research has not considered…

Machine Learning · Computer Science 2024-12-23 Xinrui Yu , Wenbin Pei , Bing Xue , Qiang Zhang

Heterogeneity across devices in federated learning (FL) typically refers to statistical (e.g., non-i.i.d. data distributions) and resource (e.g., communication bandwidth) dimensions. In this paper, we focus on another important dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-10 Su Wang , Seyyedali Hosseinalipour , Christopher G. Brinton

Empirical studies show that federated learning exhibits convergence issues in Non Independent and Identically Distributed (IID) setups. However, these studies only focus on label distribution shifts, or concept shifts (e.g. ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Matthis Manthe , Carole Lartizien , Stefan Duffner

Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yu Qiao , Huy Q. Le , Mengchun Zhang , Apurba Adhikary , Chaoning Zhang , Choong Seon Hong

As Federated Learning (FL) expands, the challenge of non-independent and identically distributed (non-IID) data becomes critical. Clustered Federated Learning (CFL) addresses this by training multiple specialized models, each representing a…

Machine Learning · Statistics 2026-01-21 Michael Ben Ali , Omar El-Rifai , Imen Megdiche , André Peninou , Olivier Teste

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

In this paper, we investigate Federated Learning (FL), a paradigm of machine learning that allows for decentralized model training on devices without sharing raw data, there by preserving data privacy. In particular, we compare two…

Machine Learning · Computer Science 2023-09-06 Hamza Reguieg , Mohammed El Hanjri , Mohamed El Kamili , Abdellatif Kobbane

As privacy concerns and data regulations grow, federated learning (FL) has emerged as a promising approach for training machine learning models across decentralized data sources without sharing raw data. However, a significant challenge in…

Machine Learning · Computer Science 2025-06-04 Jungwon Seo , Ferhat Ozgur Catak , Chunming Rong

Federated Learning (FL) is a distributed machine learning framework that trains accurate global models while preserving clients' privacy-sensitive data. However, most FL approaches assume that clients possess labeled data, which is often…

Machine Learning · Computer Science 2024-11-01 Seungjoo Lee , Thanh-Long V. Le , Jaemin Shin , Sung-Ju Lee

As a promising distributed learning paradigm, federated learning (FL) involves training deep neural network (DNN) models at the network edge while protecting the privacy of the edge clients. To train a large-scale DNN model, batch…

Machine Learning · Computer Science 2023-11-10 Yanmeng Wang , Qingjiang Shi , Tsung-Hui Chang

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent service systems in edge-cloud environments. However, in…

Machine Learning · Computer Science 2026-02-03 Zhiwei Ling , Hailiang Zhao , Chao Zhang , Xiang Ao , Ziqi Wang , Cheng Zhang , Zhen Qin , Xinkui Zhao , Kingsum Chow , Yuanqing Wu , MengChu Zhou

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

In federated learning (FL), classifiers (e.g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency. However, the conventional FL setting assumes the…

Machine Learning · Computer Science 2024-02-16 Qiong Zhang , Jing Peng , Xin Zhang , Aline Talhouk , Gang Niu , Xiaoxiao Li

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

Federated learning (FL) has been a promising approach in the field of medical imaging in recent years. A critical problem in FL, specifically in medical scenarios is to have a more accurate shared model which is robust to noisy and out-of…

Machine Learning · Computer Science 2020-08-19 Yousef Yeganeh , Azade Farshad , Nassir Navab , Shadi Albarqouni

Many existing federated learning (FL) algorithms are designed for supervised learning tasks, assuming that the local data owned by the clients are well labeled. However, in many practical situations, it could be difficult and expensive to…

Machine Learning · Computer Science 2021-11-02 Zhiguo Wang , Xintong Wang , Ruoyu Sun , Tsung-Hui Chang

Federated Learning (FL) has emerged as a fundamental learning paradigm to harness massive data scattered at geo-distributed edge devices in a privacy-preserving way. Given the heterogeneous deployment of edge devices, however, their data…

Networking and Internet Architecture · Computer Science 2024-05-30 Mulei Ma , Chenyu Gong , Liekang Zeng , Yang Yang , Liantao Wu