English
Related papers

Related papers: FedLLM-Align: Feature Extraction From Heterogeneou…

200 papers

Federated learning (FL) addresses privacy concerns in training language models by enabling multiple clients to contribute to the training, without sending their data to others. However, non-IID (identically and independently distributed)…

Machine Learning · Computer Science 2025-01-28 Jong-Ik Park , Carlee Joe-Wong

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

Machine Learning · Computer Science 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer

Federated learning (FL) has shown promising potential in safeguarding data privacy in healthcare collaborations. While the term "FL" was originally coined by the engineering community, the statistical field has also explored similar…

Most cross-device federated learning (FL) studies focus on the model-homogeneous setting where the global server model and local client models are identical. However, such constraint not only excludes low-end clients who would otherwise…

Machine Learning · Computer Science 2023-01-24 Samiul Alam , Luyang Liu , Ming Yan , Mi Zhang

Federated learning (FL) is an important technique for learning models from decentralized data in a privacy-preserving way. Existing FL methods usually uniformly sample clients for local model learning in each round. However, different…

Machine Learning · Computer Science 2023-06-27 Tao Qi , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated learning (FL) enables distributed optimization of machine learning models while protecting privacy by independently training local models on each client and then aggregating parameters on a central server, thereby producing an…

Machine Learning · Computer Science 2022-03-08 Chencheng Xu , Zhiwei Hong , Minlie Huang , Tao Jiang

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

Machine Learning · Computer Science 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

Machine Learning · Computer Science 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh

Large Language Models (LLMs), such as ChatGPT, LLaMA, GLM, and PaLM, have exhibited remarkable performances across various tasks in recent years. However, LLMs face two main challenges in real-world applications. One challenge is that…

Machine Learning · Computer Science 2023-10-17 Tao Fan , Yan Kang , Guoqiang Ma , Weijing Chen , Wenbin Wei , Lixin Fan , Qiang Yang

Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model. This design is not well-suited for scenarios involving…

Machine Learning · Computer Science 2024-04-22 Liping Yi , Han Yu , Zhuan Shi , Gang Wang , Xiaoguang Liu , Lizhen Cui , Xiaoxiao Li

Federated Learning (FL) is a collaborative machine learning technique to train a global model without obtaining clients' private data. The main challenges in FL are statistical diversity among clients, limited computing capability among…

Machine Learning · Computer Science 2023-03-07 Xiaofeng Liu , Yinchuan Li , Qing Wang , Xu Zhang , Yunfeng Shao , Yanhui Geng

Federated Learning (FL) offers a collaborative training framework, allowing multiple clients to contribute to a shared model without compromising data privacy. Due to the heterogeneous nature of local datasets, updated client models may…

Machine Learning · Computer Science 2023-11-14 Chia-Hsiang Kao , Yu-Chiang Frank Wang

Federated learning (FL) is a kind of distributed machine learning framework, where the global model is generated on the centralized aggregation server based on the parameters of local models, addressing concerns about privacy leakage caused…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Chenhao Xu , Youyang Qu , Yong Xiang , Longxiang Gao

In federated graph learning (FGL), a complete graph is divided into multiple subgraphs stored in each client due to privacy concerns, and all clients jointly train a global graph model by only transmitting model parameters. A pain point of…

Machine Learning · Computer Science 2025-03-26 Bo Yan , Zhongjian Zhang , Huabin Sun , Mengmei Zhang , Yang Cao , Chuan Shi

Federated Learning (FL) enables distributed machine learning training while preserving privacy, representing a paradigm shift for data-sensitive and decentralized environments. Despite its rapid advancements, FL remains a complex and…

Machine Learning · Computer Science 2025-05-14 Frederico Vicente , Cláudia Soares , Dušan Jakovetić

Federated learning (FL) is a distributed learning methodology that allows multiple nodes to cooperatively train a deep learning model, without the need to share their local data. It is a promising solution for telemonitoring systems that…

Machine Learning · Computer Science 2021-07-15 Alaa Awad Abdellatif , Naram Mhaisen , Amr Mohamed , Aiman Erbad , Mohsen Guizani , Zaher Dawy , Wassim Nasreddine

Federated Learning (FL) is a decentralized machine learning framework that enables collaborative model training while respecting data privacy. In various applications, non-uniform availability or participation of users is unavoidable due to…

Machine Learning · Computer Science 2023-09-26 Periklis Theodoropoulos , Konstantinos E. Nikolakakis , Dionysis Kalogerias

Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-08 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng