English
Related papers

Related papers: ConDistFL: Conditional Distillation for Federated …

200 papers

Federated Learning (FL) has emerged to allow multiple clients to collaboratively train machine learning models on their private data at the network edge. However, training and deploying large-scale models on resource-constrained devices is…

Machine Learning · Computer Science 2024-08-05 Yang Xu , Yunming Liao , Hongli Xu , Zhipeng Sun , Liusheng Huang , Chunming Qiao

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

Federated learning is a distributed learning framework that takes full advantage of private data samples kept on edge devices. In real-world federated learning systems, these data samples are often decentralized and Non-Independently…

Machine Learning · Computer Science 2023-03-03 Dun Zeng , Xiangjing Hu , Shiyu Liu , Yue Yu , Qifan Wang , Zenglin Xu

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless communication links.…

Information Theory · Computer Science 2019-07-08 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Personalized Federated Learning (PFL) enables collaboratively model training on decentralized, heterogeneous data while tailoring them to each client's unique distribution. However, existing PFL methods produce static models with a fixed…

Machine Learning · Computer Science 2026-01-16 Boyi Liu , Zimu Zhou , Yongxin Tong

In federated learning, all networked clients contribute to the model training cooperatively. However, with model sizes increasing, even sharing the trained partial models often leads to severe communication bottlenecks in underlying…

Machine Learning · Computer Science 2023-05-22 Rui Song , Dai Liu , Dave Zhenyu Chen , Andreas Festag , Carsten Trinitis , Martin Schulz , Alois Knoll

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

Machine Learning · Computer Science 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

Federated learning (FL) refers to the learning paradigm that trains machine learning models directly in the decentralized systems consisting of smart edge devices without transmitting the raw data, which avoids the heavy communication costs…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Lifeng Sun

Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, and significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Hanwen Zhang , Qiaojin Shen , Yuxi Liu , Yuesheng Zhu , Guibo Luo

Federated learning (FL) for large language models (LLMs) offers a privacy-preserving scheme, enabling clients to collaboratively fine-tune locally deployed LLMs or smaller language models (SLMs) without exchanging raw data. While…

Machine Learning · Computer Science 2025-10-02 Xinlu Zhang , Na Yan , Yang Su , Yansha Deng , Toktam Mahmoodi

Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distributions among clients, often termed the Non-Independent…

Machine Learning · Computer Science 2024-12-12 Zheshun Wu , Zenglin Xu , Dun Zeng , Qifan Wang , Jie Liu

The Federated Learning (FL) workflow of training a centralized model with distributed data is growing in popularity. However, until recently, this was the realm of contributing clients with similar computing capability. The fast expanding…

Machine Learning · Computer Science 2022-03-23 Hongrui Shi , Valentin Radu

Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often faces challenges due to data heterogeneity, leading to…

Machine Learning · Computer Science 2025-10-21 Dun Zeng , Zheshun Wu , Shiyu Liu , Yu Pan , Xiaoying Tang , Zenglin Xu

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated distillation (FD), built…

Machine Learning · Computer Science 2023-12-18 Jiawei Shao , Fangzhao Wu , Jun Zhang

Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of…

Machine Learning · Computer Science 2021-10-19 Jun Luo , Shandong Wu

Federated learning is an approach to train machine learning models on the edge of the networks, as close as possible where the data is produced, motivated by the emerging problem of the inability to stream and centrally store the large…

Machine Learning · Computer Science 2022-10-07 Kuo-Yun Liang , Abhishek Srinivasan , Juan Carlos Andresen

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Federated learning (FL) enables distributed participants to collectively learn a strong global model without sacrificing their individual data privacy. Mainstream FL approaches require each participant to share a common network architecture…

Machine Learning · Computer Science 2021-07-28 Yiying Li , Wei Zhou , Huaimin Wang , Haibo Mi , Timothy M. Hospedales

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar