English
Related papers

Related papers: Resource-Efficient Federated Multimodal Learning v…

200 papers

Federated learning (FL) has been widely adopted across various applications, such as healthcare, finance, and smart cities. However, as experimental scenarios become more complex, existing FL frameworks and benchmarks have struggled to keep…

Machine Learning · Computer Science 2024-09-10 Chuyi Chen , Zhe Zhang , Yanchao Zhao

Federated fine-tuning enables Large Language Models (LLMs) to adapt to downstream tasks while preserving data privacy, but its resource-intensive nature limits deployment on edge devices. In this paper, we introduce Developmental Federated…

Machine Learning · Computer Science 2025-08-04 Yebo Wu , Jingguang Li , Zhijiang Guo , Li Li

Federated Learning (FL) has recently been applied to the parameter-efficient fine-tuning of Large Language Models (LLMs). While promising, it raises significant challenges due to the heterogeneous resources and data distributions of…

Computation and Language · Computer Science 2024-05-31 Jiamu Bai , Daoyuan Chen , Bingchen Qian , Liuyi Yao , Yaliang Li

Mobile and Web-of-Things (WoT) devices at the network edge generate vast amounts of data for machine learning applications, yet privacy concerns hinder centralized model training. Federated Learning (FL) allows clients (devices) to…

Machine Learning · Computer Science 2025-04-15 Yongqiang Huang , Zerui Shao , Ziyuan Yang , Zexin Lu , Yi Zhang

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a number of participants without sharing data. Recent works have begun to consider the effects of using pre-trained models as an initialization point…

Machine Learning · Computer Science 2023-11-07 Gwen Legate , Nicolas Bernier , Lucas Caccia , Edouard Oyallon , Eugene Belilovsky

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Large Language Models (LLMs) have gained prominence in the field of Legal Intelligence, offering potential applications in assisting legal professionals and laymen. However, the centralized training of these Legal LLMs raises data privacy…

Computation and Language · Computer Science 2024-04-11 Linan Yue , Qi Liu , Yichao Du , Weibo Gao , Ye Liu , Fangzhou Yao

Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be…

Machine Learning · Computer Science 2025-05-20 Marie Siew , Haoran Zhang , Jong-Ik Park , Yuezhou Liu , Yichen Ruan , Lili Su , Stratis Ioannidis , Edmund Yeh , Carlee Joe-Wong

Foundation Models (FMs), such as LLaMA, BERT, GPT, ViT, and CLIP, have demonstrated remarkable success in a wide range of applications, driven by their ability to leverage vast amounts of data for pre-training. However, optimizing FMs often…

Machine Learning · Computer Science 2024-03-21 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

In recent years, mobile devices are equipped with increasingly advanced sensing and computing capabilities. Coupled with advancements in Deep Learning (DL), this opens up countless possibilities for meaningful applications. Traditional…

Networking and Internet Architecture · Computer Science 2020-03-02 Wei Yang Bryan Lim , Nguyen Cong Luong , Dinh Thai Hoang , Yutao Jiao , Ying-Chang Liang , Qiang Yang , Dusit Niyato , Chunyan Miao

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Machine Learning · Computer Science 2024-02-13 Mohak Chadha , Pulkit Khera , Jianfeng Gu , Osama Abboud , Michael Gerndt

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog-cloud…

Machine Learning · Computer Science 2024-10-28 Van-Dinh Nguyen , Symeon Chatzinotas , Bjorn Ottersten , Trung Q. Duong

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, it is not uncommon that some FL participants…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qian Dai , Dong Wei , Hong Liu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Federated learning (FL) has emerged as a promising paradigm for enabling the collaborative training of models without centralized access to the raw data on local devices. In the typical FL paradigm (e.g., FedAvg), model weights are sent to…

Machine Learning · Computer Science 2024-12-25 Guangyu Sun , Umar Khalid , Matias Mendieta , Pu Wang , Chen Chen

Recently, multimodal graph learning (MGL) has garnered significant attention for integrating diverse modality information and structured context to support various network applications. However, real-world graphs are often isolated due to…

Machine Learning · Computer Science 2026-05-14 Sirui Zhang , Haonan Wang , Xunkai Li , Zekai Chen , Shumeng Li , Hongchao Qin , Rong-Hua Li , Guoren Wang

Federated Learning (FL), as a rapidly evolving privacy-preserving collaborative machine learning paradigm, is a promising approach to enable edge intelligence in the emerging Industrial Metaverse. Even though many successful use cases have…

Machine Learning · Computer Science 2022-11-08 Shenglai Zeng , Zonghang Li , Hongfang Yu , Zhihao Zhang , Long Luo , Bo Li , Dusit Niyato

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

Artificial Intelligence · Computer Science 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

Statistical heterogeneity severely limits the performance of federated learning (FL), motivating several explorations e.g., FedProx, MOON and FedDyn, to alleviate this problem. Despite effectiveness, their considered scenario generally…

Machine Learning · Computer Science 2024-06-04 Ziqing Fan , Jiangchao Yao , Ruipeng Zhang , Lingjuan Lyu , Ya Zhang , Yanfeng Wang