English
Related papers

Related papers: Federated Learning with Taskonomy for Non-IID Data

200 papers

Operators from various industries have been pushing the adoption of wireless sensing nodes for industrial monitoring, and such efforts have produced sizeable condition monitoring datasets that can be used to build diagnosis algorithms…

Machine Learning · Computer Science 2023-04-27 Hao Lu , Adam Thelen , Olga Fink , Chao Hu , Simon Laflamme

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

How to tackle non-iid data is a crucial topic in federated learning. This challenging problem not only affects training process, but also harms performance of clients not participating in training. Existing literature mainly focuses on…

Machine Learning · Computer Science 2023-02-17 Meirui Jiang , Xiaoxiao Li , Xiaofei Zhang , Michael Kamp , Qi Dou

Federated Learning (FL) enables distributed learning across multiple clients without sharing raw data. When statistical heterogeneity across clients is severe, Clustered Federated Learning (CFL) can improve performance by grouping similar…

Machine Learning · Computer Science 2026-01-15 Sota Sugawara , Yuji Kawamata , Akihiro Toyoda , Tomoru Nakayama , Yukihiko Okada

Knowledge sharing and model personalization are essential components to tackle the non-IID challenge in federated learning (FL). Most existing FL methods focus on two extremes: 1) to learn a shared model to serve all clients with non-IID…

Machine Learning · Computer Science 2022-06-08 Jie Ma , Guodong Long , Tianyi Zhou , Jing Jiang , Chengqi Zhang

Federated Learning (FL) revolutionizes collaborative machine learning among Internet of Things (IoT) devices by enabling them to train models collectively while preserving data privacy. FL algorithms fall into two primary categories:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Liangkun Yu , Xiang Sun , Rana Albelaihi , Chaeeun Park , Sihua Shao

Though successful, federated learning presents new challenges for machine learning, especially when the issue of data heterogeneity, also known as Non-IID data, arises. To cope with the statistical heterogeneity, previous works incorporated…

Machine Learning · Computer Science 2022-10-03 Mahdi Morafah , Saeed Vahidian , Chen Chen , Mubarak Shah , Bill Lin

Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yu Qiao , Huy Q. Le , Mengchun Zhang , Apurba Adhikary , Chaoning Zhang , Choong Seon Hong

Recent advancements in federated learning (FL) have greatly facilitated the development of decentralized collaborative applications, particularly in the domain of Artificial Intelligence of Things (AIoT). However, a critical aspect missing…

Artificial Intelligence · Computer Science 2024-01-25 Ziyan An , Taylor T. Johnson , Meiyi Ma

Federated learning is a paradigm of joint learning in which clients collaborate by sharing model parameters instead of data. However, in the non-iid setting, the global model experiences client drift, which can seriously affect the final…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiaze Li , Haoran Xu , Wanyi Wu , Changwei Wang , Shuaiguang Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Youyang Qu , Longxiang Gao , Xudong Yang , Lumin Xing

Federated learning (FL) has been proposed as a privacy-preserving approach in distributed machine learning. A federated learning architecture consists of a central server and a number of clients that have access to private, potentially…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-06 Gergely Dániel Németh , Miguel Ángel Lozano , Novi Quadrianto , Nuria Oliver

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Due to the increasing privacy concerns and data regulations, training data have been increasingly fragmented, forming distributed databases of multiple "data silos" (e.g., within different organizations and countries). To develop effective…

Machine Learning · Computer Science 2021-10-29 Qinbin Li , Yiqun Diao , Quan Chen , Bingsheng He

As a promising method of central model training on decentralized device data while securing user privacy, Federated Learning (FL)is becoming popular in Internet of Things (IoT) design. However, when the data collected by IoT devices are…

Machine Learning · Computer Science 2022-02-01 Tian Liu , Jiahao Ding , Ting Wang , Miao Pan , Mingsong Chen

Federated Learning (FL) is a decentralized paradigm that enables a client-server architecture to collaboratively train a global Artificial Intelligence model without sharing raw data, thereby preserving privacy. A key challenge in FL is…

Machine Learning · Computer Science 2025-10-07 Michael Ben Ali , Imen Megdiche , André Peninou , Olivier Teste

We rethink Federated Learning (FL) from a nested learning perspective, framing the core challenge as how to collaboratively learn optimization rules, not just static models, to tackle Non-IID client data. To address this, we propose…

Machine Learning · Computer Science 2026-05-19 Hong Chen , Pengcheng Wu , Yuanguo Lin , Peilin Zhao , Xiuze Zhou , Fan Lin , Han Yu

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

Machine Learning · Computer Science 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

In federated learning, the heterogeneity of client data has a great impact on the performance of model training. Many heterogeneity issues in this process are raised by non-independently and identically distributed (non-IID) data. To…

Machine Learning · Computer Science 2026-03-25 Xiufang Shi , Wei Zhang , Yuheng Li , Mincheng Wu , Zhenyu Wen , Shibo He , Tejal Shah , Rajiv Ranjan

We present a federated learning approach for learning a client adaptable, robust model when data is non-identically and non-independently distributed (non-IID) across clients. By simulating heterogeneous clients, we show that adding learned…

Machine Learning · Computer Science 2020-07-10 Laura Rieger , Rasmus M. Th. Høegh , Lars K. Hansen

Federated Learning (FL) has emerged to allow multiple clients to collaboratively train machine learning models on their private data at the network edge. However, training and deploying large-scale models on resource-constrained devices is…

Machine Learning · Computer Science 2024-08-05 Yang Xu , Yunming Liao , Hongli Xu , Zhipeng Sun , Liusheng Huang , Chunming Qiao