English
Related papers

Related papers: A Federated and Parameter-Efficient Framework for …

200 papers

Large Language Models (LLMs) have achieved state-of-the-art results across diverse domains, yet their development remains reliant on vast amounts of publicly available data, raising concerns about data scarcity and the lack of access to…

We present LLM-KT, a flexible framework designed to enhance collaborative filtering (CF) models by seamlessly integrating LLM (Large Language Model)-generated features. Unlike existing methods that rely on passing LLM-generated features as…

In the rapidly evolving field of artificial intelligence, multimodal models, e.g., integrating vision and language into visual-language models (VLMs), have become pivotal for many applications, ranging from image captioning to multimodal…

Machine Learning · Computer Science 2024-04-24 Duy Phuong Nguyen , J. Pablo Munoz , Ali Jannesari

This paper investigates the challenges of developing large language models (LLMs) proficient in both multilingual understanding and medical knowledge. We demonstrate that simply translating medical data does not guarantee strong performance…

Computation and Language · Computer Science 2025-01-20 Nada Saadi , Tathagata Raha , Clément Christophe , Marco AF Pimentel , Ronnie Rajan , Praveen K Kanithi

Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. However, the performance of the global model is often hampered by non-i.i.d.…

Machine Learning · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Nian Liu , Xinxing Xu , Salman Khan , Wangmeng Zuo

The integration of Large Language Models (LLMs) into healthcare holds significant potential to enhance diagnostic accuracy and support medical treatment planning. These AI-driven systems can analyze vast datasets, assisting clinicians in…

Computation and Language · Computer Science 2025-04-15 Diogo Sousa , Guilherme Barbosa , Catarina Rocha , Dulce Oliveira

Multi-Model Federated Learning (MMFL) is an emerging direction in Federated Learning (FL) where multiple models are trained in parallel, generally on various datasets. Optimizing the models' accuracies and training times in the MMFL setting…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Shouxu Lin , Zimeng Pan , Yuhang Yao , Haeyoung Noh , Pei Zhang , Carlee Joe-Wong

Large Language Models (LLMs) are transforming the landscape of mobile intelligence. Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tuning LLMs to downstream mobile tasks, an approach known as…

Artificial Intelligence · Computer Science 2024-01-23 Mengwei Xu , Dongqi Cai , Yaozong Wu , Xiang Li , Shangguang Wang

Segmentation models for brain lesions in MRI are typically developed for a specific disease and trained on data with a predefined set of MRI modalities. Such models cannot segment the disease using data with a different set of MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-11-20 Felix Wagner , Wentian Xu , Pramit Saha , Ziyun Liang , Daniel Whitehouse , David Menon , Virginia Newcombe , Natalie Voets , J. Alison Noble , Konstantinos Kamnitsas

Federated Learning with LoRA fine-tuning offers an efficient and privacy-aware solution for institutions to collaboratively leverage their large datasets to train VLLMs. However, participating institutions often possess heterogeneous…

Machine Learning · Computer Science 2026-05-19 Lishan Yang , Wei Emma Zhang , Nam Kha Nguygen , Po Hu , Yanjun Shu , Weitong Chen , Mong Yuan Sim

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Due to the rapid advancements in recent years, medical image analysis is largely dominated by deep learning (DL). However, building powerful and robust DL models requires training with large multi-party datasets. While multiple stakeholders…

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong

Federated Learning (FL) is designed as a decentralized, privacy-preserving machine learning paradigm that enables multiple clients to collaboratively train a model without sharing their data. In real-world scenarios, however, clients often…

Machine Learning · Computer Science 2025-10-17 Maulidi Adi Prasetia , Muhamad Risqi U. Saputra , Guntur Dharma Putra

Federated learning (FL) is increasingly being recognized as a key approach to overcoming the data silos that so frequently obstruct the training and deployment of machine-learning models in clinical settings. This work contributes to a…

Machine Learning · Computer Science 2024-07-08 Fatemeh Tavakoli , D. B. Emerson , Sana Ayromlou , John Jewell , Amrit Krishnan , Yuchong Zhang , Amol Verma , Fahad Razak

Open-source, multilingual medical large language models (LLMs) have the potential to serve linguistically diverse populations across different regions. Adapting generic LLMs for healthcare often requires continual pretraining, but this…

Computation and Language · Computer Science 2024-09-10 Meng Zhou , Surajsinh Parmar , Anubhav Bhatti

Federated learning (FL) is a distributed learning framework that leverages commonalities between distributed client datasets to train a global model. Under heterogeneous clients, however, FL can fail to produce stable training results.…

Machine Learning · Computer Science 2024-11-04 Connor J. Mclaughlin , Lili Su

Federated Learning (FL) applied to real world data may suffer from several idiosyncrasies. One such idiosyncrasy is the data distribution across devices. Data across devices could be distributed such that there are some "heavy devices" with…

Machine Learning · Computer Science 2022-02-09 Christophe Dupuy , Tanya G. Roosta , Leo Long , Clement Chung , Rahul Gupta , Salman Avestimehr

With the rapid adoption of Federated Learning (FL) as the training and tuning protocol for applications utilizing Large Language Models (LLMs), recent research highlights the need for significant modifications to FL to accommodate the…

Cryptography and Security · Computer Science 2024-03-11 Minh N. Vu , Truc Nguyen , Tre' R. Jeter , My T. Thai

Federated learning (FL) is a promising approach to distributed compute, as well as distributed data, and provides a level of privacy and compliance to legal frameworks. This makes FL attractive for both consumer and healthcare applications.…

Machine Learning · Computer Science 2021-02-02 Agrin Hilmkil , Sebastian Callh , Matteo Barbieri , Leon René Sütfeld , Edvin Listo Zec , Olof Mogren