English
Related papers

Related papers: Efficient Language Model Architectures for Differe…

200 papers

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

Machine Learning · Computer Science 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

We propose a Stochastic Gradient Descent (SGD)-type algorithm for Personalized Federated Learning which can be particularly attractive for mobile energy-limited regimes due to its low per-client computational cost. The model to be trained…

Machine Learning · Computer Science 2025-12-15 Sotirios Nikoloutsopoulos , Iordanis Koutsopoulos , Michalis K. Titsias

Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, but applying FL to multi-modal settings introduces significant challenges. Clients typically possess heterogeneous modalities…

Machine Learning · Computer Science 2026-03-20 Mohamed Badi , Chaouki Ben Issaid , Mehdi Bennis

Federated Learning (FL) is a collaborative machine learning paradigm for training models on local sensitive data with privacy protection. Pre-trained transformer-based models have emerged as useful foundation models (FMs) to be fine-tuned…

Machine Learning · Computer Science 2025-06-24 Yuning Yang , Han Yu , Chuan Sun , Tianrun Gao , Xiaohong Liu , Xiaodong Xu , Ping Zhang , Guangyu Wang

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

Federated Learning (FL) is a distributed machine learning (ML) paradigm, aiming to train a global model by exploiting the decentralized data across millions of edge devices. Compared with centralized learning, FL preserves the clients'…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Bocheng Chen , Nikolay Ivanov , Guangjing Wang , Qiben Yan

Federated Learning (FL) has emerged as a solution for distributed model training across decentralized, privacy-preserving devices, but the different energy capacities of participating devices (system heterogeneity) constrain real-world…

Machine Learning · Computer Science 2025-10-28 Roberto Pereira , Cristian J. Vaca-Rubio , Luis Blanco

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artificial intelligence…

Machine Learning · Computer Science 2023-10-06 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated Learning (FL) is a recent model training paradigm in which client devices collaboratively train a model without ever aggregating their data. Crucially, this scheme offers users potential privacy and security benefits by only ever…

Machine Learning · Computer Science 2024-11-11 Raja Vavekanand , Kira Sam

Federated learning (FL) allows multiple clients cooperatively train models without disclosing local data. However, the existing works fail to address all these practical concerns in FL: limited communication resources, dynamic network…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zhida Jiang , Yang Xu , Hongli Xu , Zhiyuan Wang , Chen Qian

Federated learning (FL) is a kind of distributed machine learning framework, where the global model is generated on the centralized aggregation server based on the parameters of local models, addressing concerns about privacy leakage caused…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Chenhao Xu , Youyang Qu , Yong Xiang , Longxiang Gao

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated Learning (FL), an emerging paradigm for fast intelligent acquisition at the network edge, enables joint training of a machine learning model over distributed data sets and computing resources with limited disclosure of local data.…

Information Theory · Computer Science 2020-03-02 Hong Xing , Osvaldo Simeone , Suzhi Bi

Federated learning (FL) has enabled distributed learning of a model across multiple clients in a privacy-preserving manner. One of the main challenges of FL is to accommodate clients with varying hardware capacities; clients have differing…

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

Federated learning is a privacy-preserving training method which consists of training from a plurality of clients but without sharing their confidential data. However, previous work on federated learning do not explore suitable neural…

Machine Learning · Computer Science 2023-11-16 Shuhei Nitta , Taiji Suzuki , Albert Rodríguez Mulet , Atsushi Yaguchi , Ryusuke Hirai