English
Related papers

Related papers: Exploring the Distributed Knowledge Congruence in …

200 papers

Federated learning (FL) for large language models (LLMs) offers a privacy-preserving scheme, enabling clients to collaboratively fine-tune locally deployed LLMs or smaller language models (SLMs) without exchanging raw data. While…

Machine Learning · Computer Science 2025-10-02 Xinlu Zhang , Na Yan , Yang Su , Yansha Deng , Toktam Mahmoodi

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

Machine Learning · Computer Science 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

Machine Learning · Computer Science 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on…

Machine Learning · Computer Science 2021-09-02 Yujing Chen , Zheng Chai , Yue Cheng , Huzefa Rangwala

While existing federated learning approaches primarily focus on aggregating local models to construct a global model, in realistic settings, some clients may be reluctant to share their private models due to the inclusion of…

Machine Learning · Computer Science 2025-07-01 Lingzhi Gao , Zhenyuan Zhang , Chao Wu

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its scalability is limited by synchronization overhead. Asynchronous federated learning (AFL) alleviates this issue by…

Machine Learning · Computer Science 2026-02-02 Baris Askin , Holger R. Roth , Zhenyu Sun , Carlee Joe-Wong , Gauri Joshi , Ziyue Xu

Large models, renowned for superior performance, outperform smaller ones even without billion-parameter scales. While mobile network servers have ample computational resources to support larger models than client devices, privacy…

Machine Learning · Computer Science 2025-08-20 Wenxuan Ye , Xueli An , Onur Ayan , Junfan Wang , Xueqiang Yan , Georg Carle

Federated learning (FL) is a privacy-promoting framework that enables potentially large number of clients to collaboratively train machine learning models. In a FL system, a server coordinates the collaboration by collecting and aggregating…

Machine Learning · Computer Science 2023-04-21 Huancheng Chen , Haris Vikalo

Cross-Project Defect Prediction (CPDP) poses a non-trivial challenge to construct a reliable defect predictor by leveraging data from other projects, particularly when data owners are concerned about data privacy. In recent years, Federated…

Machine Learning · Computer Science 2024-12-24 Yuying Wang , Yichen Li , Haozhao Wang , Lei Zhao , Xiaofang Zhang

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

Federated Learning (FL) facilitates collaborative training of a shared global model without exposing clients' private data. In practical FL systems, clients (e.g., edge servers, smartphones, and wearables) typically have disparate system…

Machine Learning · Computer Science 2025-03-03 Leming Shen , Qiang Yang , Kaiyan Cui , Yuanqing Zheng , Xiao-Yong Wei , Jianwei Liu , Jinsong Han

Collaborative fairness is a crucial challenge in federated learning. However, existing approaches often overlook a practical yet complex form of heterogeneity: imbalanced covariate shift. We provide a theoretical analysis of this setting,…

Machine Learning · Computer Science 2025-07-14 Tianrun Yu , Jiaqi Wang , Haoyu Wang , Mingquan Lin , Han Liu , Nelson S. Yee , Fenglong Ma

Federated Recommendation (FedRec) has emerged as a key paradigm for building privacy-preserving recommender systems. However, existing FedRec models face a critical dilemma: memory-efficient single-knowledge models suffer from a suboptimal…

Information Retrieval · Computer Science 2025-11-19 Jaehyung Lim , Wonbin Kweon , Woojoo Kim , Junyoung Kim , Dongha Kim , Hwanjo Yu

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

Machine Learning · Computer Science 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

Online intelligent education platforms have generated a vast amount of distributed student learning data. This influx of data presents opportunities for cognitive diagnosis (CD) to assess students' mastery of knowledge concepts while also…

Machine Learning · Computer Science 2025-08-05 Shangshang Yang , Jialin Han , Xiaoshan Yu , Ziwen Wang , Hao Jiang , Haiping Ma , Xingyi Zhang , Geyong Min

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

Machine Learning · Computer Science 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

The growing interest in intelligent services and privacy protection for mobile devices has given rise to the widespread application of federated learning in Multi-access Edge Computing (MEC). Diverse user behaviors call for personalized…

Machine Learning · Computer Science 2025-02-28 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Quyang Pan , Xuefeng Jiang , Bo Gao

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang