English
Related papers

Related papers: Communication-Efficient Federated Distillation

200 papers

As an emerging paradigm of federated learning, asynchronous federated learning offers significant speed advantages over traditional synchronous federated learning. Unlike synchronous federated learning, which requires waiting for all…

Machine Learning · Computer Science 2025-04-10 Chaoyi Lu , Yiding Sun , Pengbo Li , Zhichuan Yang

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Distributed learning algorithms, such as the ones employed in Federated Learning (FL), require communication compression to reduce the cost of client uploads. The compression methods used in practice are often biased, making error feedback…

Machine Learning · Computer Science 2025-09-12 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

Histopathological tissue classification is a fundamental task in computational pathology. Deep learning-based models have achieved superior performance but centralized training with data centralization suffers from the privacy leakage…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Tianpeng Deng , Yanqi Huang , Guoqiang Han , Zhenwei Shi , Jiatai Lin , Qi Dou , Zaiyi Liu , Xiao-jing Guo , C. L. Philip Chen , Chu Han

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows…

Machine Learning · Computer Science 2021-07-26 Osama Shahid , Seyedamin Pouriyeh , Reza M. Parizi , Quan Z. Sheng , Gautam Srivastava , Liang Zhao

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

Knowledge Distillation (KD) aims to transfer knowledge in a teacher-student framework, by providing the predictions of the teacher network to the student network in the training stage to help the student network generalize better. It can…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 SeongUk Park , Nojun Kwak

Federated Learning (FL) has emerged as a transformative approach for distributed machine learning, particularly in edge computing environments where data privacy, low latency, and bandwidth efficiency are critical. This paper presents a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Sales Aribe , Gil Nicholas Cagande

Federated Learning (FL) is a pioneering approach in distributed machine learning, enabling collaborative model training across multiple clients while retaining data privacy. However, the inherent heterogeneity due to imbalanced resource…

Machine Learning · Computer Science 2024-11-18 Suraj Racha , Shubh Gupta , Humaira Firdowse , Aastik Solanki , Ganesh Ramakrishnan , Kshitij S. Jadhav

Heterogeneity of data distributed across clients limits the performance of global models trained through federated learning, especially in the settings with highly imbalanced class distributions of local datasets. In recent years,…

Machine Learning · Computer Science 2023-04-11 Huancheng Chen , Johnny , Wang , Haris Vikalo

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, and significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Hanwen Zhang , Qiaojin Shen , Yuxi Liu , Yuesheng Zhu , Guibo Luo

Federated learning enables the creation of a powerful centralized model without compromising data privacy of multiple participants. While successful, it does not incorporate the case where each participant independently designs its own…

Machine Learning · Computer Science 2019-10-10 Daliang Li , Junpu Wang

Federated learning (FL) enables a loose set of participating clients to collaboratively learn a global model via coordination by a central server and with no need for data sharing. Existing FL approaches that rely on complex algorithms with…

Machine Learning · Computer Science 2023-12-27 Kazim Ergun , Rishikanth Chandrasekaran , Tajana Rosing

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Brain is one the most complex organs in the human body. Due to its complexity, classification of brain tumors still poses a significant challenge, making brain tumors a particularly serious medical issue. Techniques such as Machine Learning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Rasoul Jafari Gohari , Laya Aliahmadipour , Ezat Valipour

Federated learning (FL) is an emerging paradigm for training deep neural networks (DNNs) in distributed manners. Current FL approaches all suffer from high communication overhead and information leakage. In this work, we present a federated…

Machine Learning · Computer Science 2023-11-10 Guangchen Lan

Federated Learning (FL) is a distributed machine learning paradigm which coordinates multiple clients to collaboratively train a global model via a central server. Sequential Federated Learning (SFL) is a newly-emerging FL training…

Machine Learning · Computer Science 2025-07-14 Haotian Xu , Jinrui Zhou , Xichong Zhang , Mingjun Xiao , He Sun , Yin Xu

Federated learning (FL) enables distribution of machine learning workloads from the cloud to resource-limited edge devices. Unfortunately, current deep networks remain not only too compute-heavy for inference and training on edge devices,…

Machine Learning · Computer Science 2021-12-21 Sameer Bibikar , Haris Vikalo , Zhangyang Wang , Xiaohan Chen