English
Related papers

Related papers: Knowledge Distillation in Federated Learning: a Su…

200 papers

As a special type of multimedia data, Lithography Hotspot Detection (LHD) training often requires stronger privacy protection than conventional multimedia data, and federated learning provides a promising potential solution to this…

Machine Learning · Computer Science 2026-05-01 Yuqi Li , Xingyou Lin , Yanli Li , Kai Zhang , Chuanguang Yang , Zhongliang Guo , Jianping Gou , Tingwen Huang , Yingli Tian

Knowledge distillation (KD) is commonly deemed as an effective model compression technique in which a compact model (student) is trained under the supervision of a larger pretrained model or an ensemble of models (teacher). Various…

Machine Learning · Computer Science 2020-07-08 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Federated Learning (FL) is a pioneering approach in distributed machine learning, enabling collaborative model training across multiple clients while retaining data privacy. However, the inherent heterogeneity due to imbalanced resource…

Machine Learning · Computer Science 2024-11-18 Suraj Racha , Shubh Gupta , Humaira Firdowse , Aastik Solanki , Ganesh Ramakrishnan , Kshitij S. Jadhav

This paper addresses the challenge of mitigating data heterogeneity among clients within a Federated Learning (FL) framework. The model-drift issue, arising from the noniid nature of client data, often results in suboptimal personalization…

Machine Learning · Computer Science 2024-02-19 Kawa Atapour , S. Jamal Seyedmohammadi , Jamshid Abouei , Arash Mohammadi , Konstantinos N. Plataniotis

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

Machine Learning · Computer Science 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

Federated Reinforcement Learning (FedRL) improves sample efficiency while preserving privacy; however, most existing studies assume homogeneous agents, limiting its applicability in real-world scenarios. This paper investigates FedRL in…

Machine Learning · Computer Science 2025-02-04 Wenzheng Jiang , Ji Wang , Xiongtao Zhang , Weidong Bao , Cheston Tan , Flint Xiaofeng Fan

In the traditional distributed machine learning scenario, the user's private data is transmitted between clients and a central server, which results in significant potential privacy risks. In order to balance the issues of data privacy and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zihao Zhao , Yuzhu Mao , Yang Liu , Linqi Song , Ye Ouyang , Xinlei Chen , Wenbo Ding

Federated learning (FL) enables multiple clients to collaboratively train a global model while keeping local data decentralized. Data heterogeneity (non-IID) across clients has imposed significant challenges to FL, which makes local models…

Machine Learning · Computer Science 2025-04-22 Yuting He , Yiqiang Chen , XiaoDong Yang , Hanchao Yu , Yi-Hua Huang , Yang Gu

Federated learning (FL) promotes the development and application of artificial intelligence technologies by enabling model sharing and collaboration while safeguarding data privacy. Knowledge graph (KG) embedding representation provides a…

Machine Learning · Computer Science 2024-03-14 Bingchen Liu , Yuanyuan Fang

Federated learning (FL) is a distributed learning paradigm that allows multiple decentralized clients to collaboratively learn a common model without sharing local data. Although local data is not exposed directly, privacy concerns…

Machine Learning · Computer Science 2024-10-02 Tongxin Yin , Xuwei Tan , Xueru Zhang , Mohammad Mahdi Khalili , Mingyan Liu

Artificial intelligence has transformed the perspective of medical imaging, leading to a genuine technological revolution in modern computer-assisted healthcare systems. However, ubiquitously featured deep learning (DL) systems require…

Image and Video Processing · Electrical Eng. & Systems 2026-01-09 Dominika Ciupek , Maciej Malawski , Tomasz Pieciak

Along with the blooming of AI and Machine Learning-based applications and services, data privacy and security have become a critical challenge. Conventionally, data is collected and aggregated in a data centre on which machine learning…

Cryptography and Security · Computer Science 2021-03-19 Nguyen Truong , Kai Sun , Siyao Wang , Florian Guitton , Yike Guo

Communication constraints are one of the major challenges preventing the wide-spread adoption of Federated Learning systems. Recently, Federated Distillation (FD), a new algorithmic paradigm for Federated Learning with fundamentally…

Machine Learning · Computer Science 2020-12-02 Felix Sattler , Arturo Marban , Roman Rischke , Wojciech Samek

Increasing privacy concerns and unrestricted access to data lead to the development of a novel machine learning paradigm called Federated Learning (FL). FL borrows many of the ideas from distributed machine learning, however, the challenges…

Machine Learning · Computer Science 2025-01-08 Karthik Mohan

Federated Learning (FL) is a decentralized machine learning approach that has gained attention for its potential to enable collaborative model training across clients while protecting data privacy, making it an attractive solution for the…

Clustered Federated Learning (CFL) has emerged as a powerful approach for addressing data heterogeneity and ensuring privacy in large distributed IoT environments. By clustering clients and training cluster-specific models, CFL enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-12 Sabtain Ahmad , Meerzhan Kanatbekova , Ivona Brandic , Atakan Aral

Federated Learning (FL) has emerged as a promising distributed learning paradigm with an added advantage of data privacy. With the growing interest in having collaboration among data owners, FL has gained significant attention of…

Machine Learning · Computer Science 2023-04-11 Afsana Khan , Marijn ten Thij , Anna Wilbik

As an emerging technique, Federated Learning (FL) can jointly train a global model with the data remaining locally, which effectively solves the problem of data privacy protection through the encryption mechanism. The clients train their…

Machine Learning · Computer Science 2020-12-04 Yi Liu , Li Zhang , Ning Ge , Guanghao Li

Deep Neural Networks (DNNs) have achieved notable performance in the fields of computer vision and natural language processing with various applications in both academia and industry. However, with recent advancements in DNNs and…