English
Related papers

Related papers: Heterogeneous Federated Learning with Splited Lang…

200 papers

Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often have limited communication bandwidth and local computation…

Machine Learning · Computer Science 2021-11-09 Hakim Sidahmed , Zheng Xu , Ankush Garg , Yuan Cao , Mingqing Chen

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo

Many existing federated learning (FL) algorithms are designed for supervised learning tasks, assuming that the local data owned by the clients are well labeled. However, in many practical situations, it could be difficult and expensive to…

Machine Learning · Computer Science 2021-11-02 Zhiguo Wang , Xintong Wang , Ruoyu Sun , Tsung-Hui Chang

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Motivated by high resource costs of centralized machine learning schemes as well as data privacy concerns, federated learning (FL) emerged as an efficient alternative that relies on aggregating locally trained models rather than collecting…

Machine Learning · Computer Science 2023-12-22 Yiyue Chen , Haris Vikalo , Chianing Wang

Federated Learning (FL) enables distributed model training on edge devices while preserving data privacy. However, clients tend to have non-Independent and Identically Distributed (non-IID) data, which often leads to client-drift, and…

Machine Learning · Computer Science 2026-02-23 Fotios Zantalis , Evangelos Zervas , Grigorios Koulouras

Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language Models (LLMs) are trained on data from a single device or client. However, real-world scenarios often require fine-tuning these models on private data…

Machine Learning · Computer Science 2025-06-03 Sajjad Ghiasvand , Yifan Yang , Zhiyu Xue , Mahnoosh Alizadeh , Zheng Zhang , Ramtin Pedarsani

Federated Learning (FL) is an evolving paradigm that enables multiple parties to collaboratively train models without sharing raw data. Among its variants, Vertical Federated Learning (VFL) is particularly relevant in real-world,…

Machine Learning · Computer Science 2024-10-24 Zhaomin Wu , Junyi Hou , Yiqun Diao , Bingsheng He

Federated learning is a learning paradigm to enable collaborative learning across different parties without revealing raw data. Notably, vertical federated learning (VFL), where parties share the same set of samples but only hold partial…

Machine Learning · Computer Science 2023-03-24 Zhaomin Wu , Qinbin Li , Bingsheng He

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated Learning (FL) has emerged as a privacy-preserving paradigm for training machine learning models across distributed edge devices in the Internet of Things (IoT). By keeping data local and coordinating model training through a…

Machine Learning · Computer Science 2025-12-30 Ziru Niu , Hai Dong , A. K. Qin , Tao Gu , Pengcheng Zhang

Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy. However, the heterogeneous hardware capabilities of devices often result in significant training delays, as…

Machine Learning · Computer Science 2025-09-23 Letian Zhang , Bo Chen , Jieming Bian , Lei Wang , Jie Xu

The scalability of large language models (LLMs) in handling high-complexity models and large-scale datasets has led to tremendous successes in pivotal domains. While there is an urgent need to acquire more training data for LLMs, a…

Machine Learning · Computer Science 2024-07-02 Zheng Lin , Xuanjie Hu , Yuxin Zhang , Zhe Chen , Zihan Fang , Xianhao Chen , Ang Li , Praneeth Vepakomma , Yue Gao

Federated learning (FL) is a distributed machine learning paradigm enabling collaborative model training while preserving data privacy. In today's landscape, where most data is proprietary, confidential, and distributed, FL has become a…

Machine Learning · Computer Science 2025-03-11 Zilinghan Li , Shilan He , Ze Yang , Minseok Ryu , Kibaek Kim , Ravi Madduri

Federated Learning (FL) has emerged as a transformative paradigm for distributed machine learning while preserving data privacy. However, existing approaches predominantly focus on model heterogeneity and aggregation techniques, largely…

Machine Learning · Computer Science 2025-09-23 Sajid Hussain , Muhammad Sohail , Nauman Ali Khan , Naima Iltaf , Ihtesham ul Islam

Federated Learning is a new machine learning paradigm dealing with distributed model learning on independent devices. One of the many advantages of federated learning is that training data stay on devices (such as smartphones), and only…

Machine Learning · Computer Science 2022-07-19 Sannara Ek , Romain Rombourg , François Portet , Philippe Lalanda

Split Federated Learning (SFL) has emerged as an efficient alternative to traditional Federated Learning (FL) by reducing client-side computation through model partitioning. However, exchanging of intermediate activations and model updates…

Machine Learning · Computer Science 2026-01-01 Xingchen Wang , Feijie Wu , Chenglin Miao , Tianchun Li , Haoyu Hu , Qiming Cao , Jing Gao , Lu Su

Federated learning is an approach to train machine learning models on the edge of the networks, as close as possible where the data is produced, motivated by the emerging problem of the inability to stream and centrally store the large…

Machine Learning · Computer Science 2022-10-07 Kuo-Yun Liang , Abhishek Srinivasan , Juan Carlos Andresen

In recent years, there have been great advances in the field of decentralized learning with private data. Federated learning (FL) and split learning (SL) are two spearheads possessing their pros and cons, and are suited for many user…

Machine Learning · Computer Science 2021-12-14 Shraman Pal , Mansi Uniyal , Jihong Park , Praneeth Vepakomma , Ramesh Raskar , Mehdi Bennis , Moongu Jeon , Jinho Choi

Federated Learning (FL) is a distributed learning paradigm that enhances users privacy by eliminating the need for clients to share raw, private data with the server. Despite the success, recent studies expose the vulnerability of FL to…

Machine Learning · Computer Science 2023-12-15 Jing Wu , Munawar Hayat , Mingyi Zhou , Mehrtash Harandi