English
Related papers

Related papers: A Federated and Parameter-Efficient Framework for …

200 papers

This paper provides a comprehensive study of Federated Learning (FL) with an emphasis on components, challenges, applications and FL environment. FL can be applicable in multiple fields and domains in real-life models. in the medical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Dhurgham Hassan Mahlool , Mohammed Hamzah Abed

Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect…

Computation and Language · Computer Science 2025-05-23 Kexin Shang , Chia-Hsuan Chang , Christopher C. Yang

The recent success of large language models (LLMs) has been largely driven by vast public datasets. However, the next frontier for LLM development lies beyond public data. Much of the world's most valuable information is private, especially…

In many-task optimization scenarios, surrogate models are valuable for mitigating the computational burden of repeated fitness evaluations across tasks. This study proposes a novel meta-surrogate framework to assist many-task optimization,…

Machine Learning · Computer Science 2026-02-05 Xian-Rong Zhang , Yue-Jiao Gong , Yuan-Ting Zhong , Ting Huang , Jun Zhang

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated learning (FL) has attracted considerable interest in the medical domain due to its capacity to facilitate collaborative model training while maintaining data privacy. However, conventional FL methods typically necessitate multiple…

Machine Learning · Computer Science 2025-01-08 Naibo Wang , Yuchen Deng , Shichen Fan , Jianwei Yin , See-Kiong Ng

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

In the ever-evolving landscape of artificial intelligence (AI) and large language models (LLMs), handling and leveraging data effectively has become a critical challenge. Most state-of-the-art machine learning algorithms are data-centric.…

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

Federated Learning (FL) facilitates the fine-tuning of Foundation Models (FMs) using distributed data sources, with Low-Rank Adaptation (LoRA) gaining popularity due to its low communication costs and strong performance. While recent work…

Machine Learning · Computer Science 2025-05-27 Zihao Peng , Jiandian Zeng , Boyuan Li , Guo Li , Shengbo Chen , Tian Wang

Federated Learning (FL) has gained popularity for fine-tuning large language models (LLMs) across multiple nodes, each with its own private data. While LoRA has been widely adopted for parameter efficient federated fine-tuning, recent…

Machine Learning · Computer Science 2025-03-11 Navyansh Mahla , Sunny Gupta , Amit Sethi

To address data locality and privacy restrictions, Federated Learning (FL) has recently been adopted to fine-tune large language models (LLMs), enabling improved performance on various downstream tasks without requiring aggregated data.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-11 Han Liu , Ruoyao Wen , Srijith Nair , Jia Liu , Wenjing Lou , Chongjie Zhang , William Yeoh , Yevgeniy Vorobeychik , Ning Zhang

Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating client. However, in…

Machine Learning · Computer Science 2022-07-19 Ruixuan Liu , Fangzhao Wu , Chuhan Wu , Yanlin Wang , Lingjuan Lyu , Hong Chen , Xing Xie

Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performance, but collecting large-scale multimodal data and…

While federated learning (FL) enables fine-tuning of large language models (LLMs) without compromising data privacy, the substantial size of an LLM renders on-device training impractical for resource-constrained clients, such as mobile…

Machine Learning · Computer Science 2026-01-05 Zihan Fang , Zheng Lin , Senkang Hu , Yanan Ma , Yihang Tao , Yiqin Deng , Xianhao Chen , Yuguang Fang

Federated learning (FL) enables edge-devices to collaboratively learn a model without disclosing their private data to a central aggregating server. Most existing FL algorithms require models of identical architecture to be deployed across…

Machine Learning · Computer Science 2022-04-28 Yae Jee Cho , Andre Manoel , Gauri Joshi , Robert Sim , Dimitrios Dimitriadis

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network language model…

Building robust deep learning-based models requires diverse training data, ideally from several sources. However, these datasets cannot be combined easily because of patient privacy concerns or regulatory hurdles, especially if medical data…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Holger R. Roth , Dong Yang , Wenqi Li , Andriy Myronenko , Wentao Zhu , Ziyue Xu , Xiaosong Wang , Daguang Xu

Objective: Large language models (LLMs) are attracting increasing interest in healthcare. This commentary evaluates the potential of LLMs to improve clinical prediction models (CPMs) for diagnostic and prognostic tasks, with a focus on…

Computers and Society · Computer Science 2025-11-07 Yusuf Yildiz , Goran Nenadic , Meghna Jani , David A. Jenkins