中文
相关论文

相关论文: Optimized Federated Knowledge Distillation with Di…

200 篇论文

Federated learning (FL) enables a set of distributed clients to jointly train machine learning models while preserving their local data privacy, making it attractive for applications in healthcare, finance, mobility, and smart-city systems.…

机器学习 · 计算机科学 2026-03-26 Eman M. AbouNassar , Amr Elshall , Sameh Abdulah

Federated Learning (FL) enables multiple clients to collaboratively learn in a distributed way, allowing for privacy protection. However, the real-world non-IID data will lead to client drift which degrades the performance of FL.…

机器学习 · 计算机科学 2023-08-22 Yunlu Yan , Chun-Mei Feng , Mang Ye , Wangmeng Zuo , Ping Li , Rick Siow Mong Goh , Lei Zhu , C. L. Philip Chen

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

机器学习 · 计算机科学 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

机器学习 · 计算机科学 2024-10-14 Peiran Wang , Haohan Wang

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

机器学习 · 计算机科学 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

Federated learning (FL) enables distributed participants to collectively learn a strong global model without sacrificing their individual data privacy. Mainstream FL approaches require each participant to share a common network architecture…

机器学习 · 计算机科学 2021-07-28 Yiying Li , Wei Zhou , Huaimin Wang , Haibo Mi , Timothy M. Hospedales

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

机器学习 · 计算机科学 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

机器学习 · 计算机科学 2022-02-04 Hongda Wu , Ping Wang

Federated Learning (FL) is a pioneering approach in distributed machine learning, enabling collaborative model training across multiple clients while retaining data privacy. However, the inherent heterogeneity due to imbalanced resource…

机器学习 · 计算机科学 2024-11-18 Suraj Racha , Shubh Gupta , Humaira Firdowse , Aastik Solanki , Ganesh Ramakrishnan , Kshitij S. Jadhav

Federated learning (FL) offers a privacy-preserving paradigm for machine learning, but its application in intrusion detection systems (IDS) within IoT networks is challenged by severe class imbalance, non-IID data, and high communication…

机器学习 · 计算机科学 2025-10-28 Gurpreet Singh , Keshav Sood , P. Rajalakshmi , Yong Xiang

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

机器学习 · 计算机科学 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids direct model parameter…

机器学习 · 计算机科学 2026-05-08 Quang-Huy Nguyen , Jiaqi Wang , Wei-shinn Ku

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

机器学习 · 计算机科学 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

分布式、并行与集群计算 · 计算机科学 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated Averaging, and many federated learning algorithm variants which build upon it, have a limitation: all clients must share the same model architecture. This results in unused modeling capacity on many clients, which limits model…

机器学习 · 计算机科学 2023-10-05 Jared Lichtarge , Ehsan Amid , Shankar Kumar , Tien-Ju Yang , Rohan Anil , Rajiv Mathews

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

分布式、并行与集群计算 · 计算机科学 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

机器学习 · 计算机科学 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra

Federated learning (FL) enables multiple clients to train models collaboratively without sharing local data, which has achieved promising results in different areas, including the Internet of Things (IoT). However, end IoT devices do not…

机器学习 · 计算机科学 2023-03-07 Jiaqi Wang , Shenglai Zeng , Zewei Long , Yaqing Wang , Houping Xiao , Fenglong Ma

Traditionally, federated learning (FL) aims to train a single global model while collaboratively using multiple clients and a server. Two natural challenges that FL algorithms face are heterogeneity in data across clients and collaboration…

机器学习 · 计算机科学 2022-07-06 Kaan Ozkara , Navjot Singh , Deepesh Data , Suhas Diggavi