English
Related papers

Related papers: Data Heterogeneity and Forgotten Labels in Split F…

200 papers

Recent works have shown that generative sequence models (e.g., language models) have a tendency to memorize rare or unique sequences in the training data. Since useful models are often trained on sensitive data, to ensure the privacy of the…

Machine Learning · Computer Science 2020-06-16 Om Thakkar , Swaroop Ramaswamy , Rajiv Mathews , Françoise Beaufays

Federated learning (FL) enables massive distributed Information and Communication Technology (ICT) devices to learn a global consensus model without any participants revealing their own data to the central server. However, the practicality,…

Machine Learning · Computer Science 2020-03-31 Zhikun Chen , Daofeng Li , Ming Zhao , Sihai Zhang , Jinkang Zhu

This paper proposes a cooperative mechanism for mitigating the performance degradation due to non-independent-and-identically-distributed (non-IID) data in collaborative machine learning (ML), namely federated learning (FL), which trains an…

Machine Learning · Computer Science 2020-03-06 Naoya Yoshida , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto , Ryo Yonetani

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth

Federated learning (FL) has provided a new methodology for coordinating a group of clients to train a machine learning model collaboratively, bringing an efficient paradigm in edge intelligence. Despite its promise, FL faces several…

Machine Learning · Computer Science 2025-03-07 Ziruo Hao , Zhenhua Cui , Tao Yang , Bo Hu , Xiaofeng Wu , Hui Feng

Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating client. However, in…

Machine Learning · Computer Science 2022-07-19 Ruixuan Liu , Fangzhao Wu , Chuhan Wu , Yanlin Wang , Lingjuan Lyu , Hong Chen , Xing Xie

Federated learning (FL) enables collaborative training of a machine learning (ML) model across multiple parties, facilitating the preservation of users' and institutions' privacy by maintaining data stored locally. Instead of centralizing…

Machine Learning · Computer Science 2024-11-06 Nicolò Romandini , Alessio Mora , Carlo Mazzocca , Rebecca Montanari , Paolo Bellavista

Federated Learning (FL) has emerged as a potent framework for training models across distributed data sources while maintaining data privacy. Nevertheless, it faces challenges with limited high-quality labels and non-IID client data,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Taehyeon Kim , Eric Lin , Junu Lee , Christian Lau , Vaikkunth Mugunthan

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated Learning (FL) enables collaborative training across multiple clients while preserving data privacy, yet it struggles with data heterogeneity, where clients' data are not distributed independently and identically (non-IID). This…

Machine Learning · Computer Science 2025-12-16 Incheol Baek , Hyungbin Kim , Minseo Kim , Yon Dohn Chung

SplitFed Learning, a combination of Federated and Split Learning (FL and SL), is one of the most recent developments in the decentralized machine learning domain. In SplitFed learning, a model is trained by clients and a server…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zahra Hafezi Kafshgari , Chamani Shiranthika , Parvaneh Saeedi , Ivan V. Bajić

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

Federated Learning (FL) enables clients to collaboratively train machine learning models without sharing local data, preserving privacy in diverse environments. While traditional FL approaches preserve privacy, they often struggle with high…

Machine Learning · Computer Science 2025-02-03 Nan Li , Xiaolu Wang , Xiao Du , Puyu Cai , Ting Wang

Split Federated Learning (SFL) enables privacy-preserving collaborative training by partitioning models between clients and a server. However, under non-IID data distributions, SFL often suffers from biased optimization and unstable…

Machine Learning · Computer Science 2026-05-19 Yuhan Xie , Chen Lyu , Jingrong Huang

Existing federated learning methods have effectively dealt with decentralized learning in scenarios involving data privacy and non-IID data. However, in real-world situations, each client dynamically learns new classes, requiring the global…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haiyang Guo , Fei Zhu , Wenzhuo Liu , Xu-Yao Zhang , Cheng-Lin Liu

In the distributed collaborative machine learning (DCML) paradigm, federated learning (FL) recently attracted much attention due to its applications in health, finance, and the latest innovations such as industry 4.0 and smart vehicles. FL…

Machine Learning · Computer Science 2020-12-01 Chandra Thapa , M. A. P. Chamikara , Seyit A. Camtepe

Model-heterogeneous personalized federated learning (MHPFL) enables FL clients to train structurally different personalized models on non-independent and identically distributed (non-IID) local data. Existing MHPFL methods focus on…

Machine Learning · Computer Science 2024-04-30 Liping Yi , Han Yu , Chao Ren , Heng Zhang , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Federated learning enables different parties to collaboratively build a global model under the orchestration of a server while keeping the training data on clients' devices. However, performance is affected when clients have heterogeneous…

Machine Learning · Computer Science 2022-06-20 Fabiola Espinoza Castellon , Aurelien Mayoue , Jacques-Henri Sublemontier , Cedric Gouy-Pailler

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang