English
Related papers

Related papers: Knowledge Distillation for Federated Learning: a P…

200 papers

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling…

Machine Learning · Computer Science 2025-03-04 Katharine Daly , Hubert Eichner , Peter Kairouz , H. Brendan McMahan , Daniel Ramage , Zheng Xu

Federated Learning(FL) is popular as a privacy-preserving machine learning paradigm for generating a single model on decentralized data. However, statistical heterogeneity poses a significant challenge for FL. As a subfield of FL,…

Machine Learning · Computer Science 2024-10-22 Keting Yin , Jiayi Mao

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

Machine Learning · Computer Science 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Federated Learning (FL) is a machine learning approach that allows multiple clients to collaboratively learn a shared model without sharing raw data. However, current FL systems provide an all-in-one solution, which can hinder the wide…

Databases · Computer Science 2023-03-16 Muhammad Jahanzeb Khan , Rui Hu , Mohammad Sadoghi , Dongfang Zhao

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm in which clients enable collaborative training without compromising private data. However, how to learn a robust global model in the data-heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Kangyang Luo , Shuai Wang , Yexuan Fu , Xiang Li , Yunshi Lan , Ming Gao

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated learning (FL) refers to the learning paradigm that trains machine learning models directly in the decentralized systems consisting of smart edge devices without transmitting the raw data, which avoids the heavy communication costs…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Lifeng Sun

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes…

Machine Learning · Computer Science 2023-01-05 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated Learning (FL) has emerged as a prominent alternative to the traditional centralized learning approach. Generally speaking, FL is a decentralized approach that allows for collaborative training of Machine Learning (ML) models…

Machine Learning · Computer Science 2024-03-19 S. Jamal Seyedmohammadi , S. Kawa Atapour , Jamshid Abouei , Arash Mohammadi

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Federated Learning (FL) is a distributed machine learning paradigm which coordinates multiple clients to collaboratively train a global model via a central server. Sequential Federated Learning (SFL) is a newly-emerging FL training…

Machine Learning · Computer Science 2025-07-14 Haotian Xu , Jinrui Zhou , Xichong Zhang , Mingjun Xiao , He Sun , Yin Xu

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun