中文
相关论文

相关论文: Optimized Federated Knowledge Distillation with Di…

200 篇论文

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Recently, the compression and deployment of powerful deep neural networks (DNNs) on resource-limited edge devices to provide intelligent services have become attractive tasks. Although knowledge distillation (KD) is a feasible solution for…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Zhiwei Hao , Yong Luo , Zhi Wang , Han Hu , Jianping An

Most current federated learning frameworks are modeled as static processes, ignoring the dynamic characteristics of the learning system. Under the limited communication budget of the central server, the flexible model architecture of a…

机器学习 · 计算机科学 2025-03-11 Yiting Zheng , Bohan Lin , Jinqian Chen , Jihua Zhu

Federated learning (FL) is an emerging technique used to collaboratively train a global machine learning model while keeping the data localized on the user devices. The main obstacle to FL's practical implementation is the Non-Independent…

机器学习 · 计算机科学 2022-08-01 Hiep Nguyen , Lam Phan , Harikrishna Warrier , Yogesh Gupta

Federated learning (FL) is a distributed machine learning paradigm where multiple clients conduct local training based on their private data, then the updated models are sent to a central server for global aggregation. The practical…

机器学习 · 计算机科学 2025-04-03 Harsh Vardhan , Xiaofan Yu , Tajana Rosing , Arya Mazumdar

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

机器学习 · 计算机科学 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

机器学习 · 计算机科学 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

机器学习 · 计算机科学 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

机器学习 · 计算机科学 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

Subgraph federated learning (subgraph-FL) is a new distributed paradigm that facilitates the collaborative training of graph neural networks (GNNs) by multi-client subgraphs. Unfortunately, a significant challenge of subgraph-FL arises from…

机器学习 · 计算机科学 2024-04-26 Yinlin Zhu , Xunkai Li , Zhengyu Wu , Di Wu , Miao Hu , Rong-Hua Li

Federated learning (FL) offers a promising framework for collaborative digital pathology by enabling model training across institutions. However, real-world deployments face heterogeneity arising from diverse multiple instance learning…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Luru Jing , Cong Cong , Yanyuan Chen , Yongzhi Cao

With the development of wireless network, Multi-Access Edge Computing (MEC) and Artificial Intelligence (AI)-native Radio Access Network (RAN) have attracted significant attention. Particularly, the integration of AI-RAN and MEC is…

机器学习 · 计算机科学 2026-03-11 Luyao Zou , Hayoung Oh , Chu Myaet Thwal , Apurba Adhikary , Seohyeon Hong , Zhu Han

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

机器学习 · 计算机科学 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated Learning (FL) allows several clients to construct a common global machine-learning model without having to share their data. FL, however, faces the challenge of statistical heterogeneity between the client's data, which degrades…

机器学习 · 计算机科学 2024-01-26 Zahra Taghiyarrenani , Abdallah Alabdallah , Slawomir Nowaczyk , Sepideh Pashami

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its scalability is limited by synchronization overhead. Asynchronous federated learning (AFL) alleviates this issue by…

机器学习 · 计算机科学 2026-02-02 Baris Askin , Holger R. Roth , Zhenyu Sun , Carlee Joe-Wong , Gauri Joshi , Ziyue Xu

In federated learning, the heterogeneity of client data has a great impact on the performance of model training. Many heterogeneity issues in this process are raised by non-independently and identically distributed (non-IID) data. To…

机器学习 · 计算机科学 2026-03-25 Xiufang Shi , Wei Zhang , Yuheng Li , Mincheng Wu , Zhenyu Wen , Shibo He , Tejal Shah , Rajiv Ranjan

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

机器学习 · 计算机科学 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

机器学习 · 计算机科学 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

As a promising distributed machine learning paradigm, Federated Learning (FL) enables all the involved devices to train a global model collaboratively without exposing their local data privacy. However, for non-IID scenarios, the…

机器学习 · 计算机科学 2022-02-28 Ming Hu , Tian Liu , Zhiwei Ling , Zhihao Yue , Mingsong Chen