English
Related papers

Related papers: Training Heterogeneous Client Models using Knowled…

200 papers

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer

Traditional federated learning (FL) methods have limited support for clients with varying computational and communication abilities, leading to inefficiencies and potential inaccuracies in model training. This limitation hinders the…

Machine Learning · Computer Science 2024-06-17 Jong-Ik Park , Carlee Joe-Wong

Federated learning (FL) is a collaborative machine learning paradigm which ensures data privacy by training models across distributed datasets without centralizing sensitive information. Vertical Federated Learning (VFL), a kind of FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-13 Nikita Shrivastava , Drishya Uniyal , Bapi Chatterjee

Federated Learning (FL) typically involves a large-scale, distributed system with individual user devices/servers training models locally and then aggregating their model updates on a trusted central server. Existing systems for FL often…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Shixiong Qi , K. K. Ramakrishnan , Myungjin Lee

Clustered Federated Learning (CFL) addresses the challenges posed by non-IID data by training multiple group- or cluster-specific expert models. However, existing methods often overlook the shared information across clusters, which…

Machine Learning · Computer Science 2025-06-26 Zeqi Leng , Chunxu Zhang , Guodong Long , Riting Xia , Bo Yang

Federated Learning (FL) is a privacy-preserving machine learning technique that allows decentralized collaborative model training across a set of distributed clients, by avoiding raw data exchange. A fundamental component of FL is the…

Machine Learning · Computer Science 2025-05-20 Sara Alosaime , Arshad Jhumka

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless communication links.…

Information Theory · Computer Science 2019-07-08 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Federated Learning (FL) presents significant potential for collaborative optimization without data sharing. Since synthetic data is sent to the server, leveraging the popular concept of dataset distillation, this FL framework protects real…

Machine Learning · Computer Science 2025-10-29 Haozhi Shi , Weiying Xie , Hangyu Ye , Daixun Li , Jitao Ma , Yunsong Li , Leyuan Fang

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches on FL to tackle the…

Machine Learning · Computer Science 2022-11-15 Yi Liu , Song Guo , Jie Zhang , Qihua Zhou , Yingchun Wang , Xiaohan Zhao

Federated learning (FL) is increasingly adopted in domains like healthcare, where data privacy is paramount. A fundamental challenge in these systems is statistical heterogeneity-the fact that data distributions vary significantly across…

Machine Learning · Computer Science 2026-02-12 Zijian Wang , Xiaofei Zhang , Xin Zhang , Yukun Liu , Qiong Zhang

Federated learning (FL) has been recognized as a privacy-preserving distributed machine learning paradigm that enables knowledge sharing among various heterogeneous artificial intelligence (AIoT) devices through centralized global model…

Machine Learning · Computer Science 2022-12-06 Jun Xia , Yi Zhang , Zhihao Yue , Ming Hu , Xian Wei , Mingsong Chen

Federated Learning (FL) has emerged as a promising decentralized learning (DL) approach that enables the use of distributed data without compromising user privacy. However, FL poses several key challenges. First, it is frequently assumed…

Machine Learning · Computer Science 2025-09-29 Zahid Iqbal

Federated learning (FL) facilitates edge devices to cooperatively train a global shared model while maintaining the training data locally and privately. However, a common assumption in FL requires the participating edge devices to have…

Machine Learning · Computer Science 2024-02-02 Yun-Hin Chan , Zhihan Jiang , Jing Deng , Edith C. -H. Ngai

Federated Learning (FL) is an evolving distributed machine learning approach that safeguards client privacy by keeping data on edge devices. However, the variation in data among clients poses challenges in training models that excel across…

Machine Learning · Computer Science 2025-03-04 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids direct model parameter…

Machine Learning · Computer Science 2026-05-08 Quang-Huy Nguyen , Jiaqi Wang , Wei-shinn Ku

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Recently, the compression and deployment of powerful deep neural networks (DNNs) on resource-limited edge devices to provide intelligent services have become attractive tasks. Although knowledge distillation (KD) is a feasible solution for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhiwei Hao , Yong Luo , Zhi Wang , Han Hu , Jianping An

The proliferation of edge devices has brought Federated Learning (FL) to the forefront as a promising paradigm for decentralized and collaborative model training while preserving the privacy of clients' data. However, FL struggles with a…

Machine Learning · Computer Science 2024-05-14 Mahdi Morafah , Matthias Reisser , Bill Lin , Christos Louizos