English
Related papers

Related papers: Federate the Router: Learning Language Model Route…

200 papers

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

LLMs have demonstrated significant potential in Medical Report Generation (MRG), yet their development requires large amounts of medical image-report pairs, which are commonly scattered across multiple centers. Centralizing these data is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Haoxuan Che , Haibo Jin , Zhengrui Guo , Yi Lin , Cheng Jin , Hao Chen

Efficiently enhancing the reasoning capabilities of large language models (LLMs) in federated learning environments remains challenging, particularly when balancing performance gains with strict computational, communication, and privacy…

Computation and Language · Computer Science 2025-08-15 Chuan Li , Qianyi Zhao , Fengran Mo , Cen Chen

Personalized federated learning is tasked with training machine learning models for multiple clients, each with its own data distribution. The goal is to train personalized models in a collaborative way while accounting for data disparities…

Machine Learning · Computer Science 2021-03-09 Aviv Shamsian , Aviv Navon , Ethan Fetaya , Gal Chechik

Federated Learning (FL) is an approach to conduct machine learning without centralizing training data in a single place, for reasons of privacy, confidentiality or data volume. However, solving federated machine learning problems raises…

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

Machine Learning · Computer Science 2022-08-22 Zachary Charles , Kallista Bonawitz , Stanislav Chiknavaryan , Brendan McMahan , Blaise Agüera y Arcas

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

Machine Learning · Computer Science 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

Federated learning (FL) was proposed to facilitate the training of models in a distributed environment. It supports the protection of (local) data privacy and uses local resources for model training. Until now, the majority of research has…

Federated Learning (FL) is a machine learning paradigm in which many clients cooperatively train a single centralized model while keeping their data private and decentralized. FL is commonly used in edge computing, which involves placing…

Trained on massive publicly available data, large language models (LLMs) have demonstrated tremendous success across various fields. While more data contributes to better performance, a disconcerting reality is that high-quality public data…

Machine Learning · Computer Science 2024-02-13 Rui Ye , Wenhao Wang , Jingyi Chai , Dihan Li , Zexi Li , Yinda Xu , Yaxin Du , Yanfeng Wang , Siheng Chen

This study analyzes the performance of domain-specific Large Language Models (LLMs) for the medical field by integrating Retrieval-Augmented Generation (RAG) systems within a federated learning framework. Leveraging the inherent advantages…

Computation and Language · Computer Science 2025-01-09 Jincheol Jung , Hongju Jeong , Eui-Nam Huh

Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework that enables multiple users to fine-tune these models while…

Machine Learning · Computer Science 2025-10-27 Yiyuan Yang , Guodong Long , Qinghua Lu , Liming Zhu , Jing Jiang , Chengqi Zhang

Federated learning (FL) has emerged as a key paradigm for collaborative model training across multiple clients without sharing raw data, enabling privacy-preserving applications in areas such as radiology and pathology. However, works on…

Machine Learning · Computer Science 2025-10-31 Furkan Pala , Islem Rekik

Multi-Label Recognition (MLR) based on Vision-Language Models (VLMs) aims to leverage their pre-trained knowledge to better adapt complex recognition scenarios, thereby enhancing model robustness. However, for realistic decentralized…

Artificial Intelligence · Computer Science 2026-05-28 Xucong Wang , Pengkun Wang , Zhe Zhao , Liheng Yu , Shuang Wang , Yang Wang

Large Language Models (LLMs) deliver state-of-the-art performance across many tasks but impose high computational and memory costs, limiting their deployment in resource-constrained or real-time settings. To address this, we propose…

Computation and Language · Computer Science 2025-11-14 Nikunj Gupta , Bill Guo , Rajgopal Kannan , Viktor K. Prasanna

Large language models (LLMs) exhibit strengths across diverse domains. However, achieving strong performance across these domains with a single general-purpose model typically requires scaling to sizes that are prohibitively expensive to…

Artificial Intelligence · Computer Science 2026-05-22 Nuoya Xiong , Yuhang Zhou , Hanqing Zeng , Zhaorun Chen , Furong Huang , Shuchao Bi , Lizhu Zhang , Zhuokai Zhao

Federated learning involves training statistical models over edge devices such as mobile phones such that the training data is kept local. Federated Learning (FL) can serve as an ideal candidate for training spatial temporal models that…

Machine Learning · Computer Science 2024-02-09 Yacine Belal , Sonia Ben Mokhtar , Hamed Haddadi , Jaron Wang , Afra Mashhadi

Large Language Models (LLMs) have achieved state-of-the-art results across diverse domains, yet their development remains reliant on vast amounts of publicly available data, raising concerns about data scarcity and the lack of access to…

With the arising concerns of privacy within machine learning, federated learning (FL) was invented in 2017, in which the clients, such as mobile devices, train a model and send the update to the centralized server. Choosing clients randomly…

Machine Learning · Computer Science 2023-06-09 Carl Smestad , Jingyue Li

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen