中文
相关论文

相关论文: A Federated and Parameter-Efficient Framework for …

200 篇论文

Transfer learning via fine-tuning pre-trained transformer models has gained significant success in delivering state-of-the-art results across various NLP tasks. In the absence of centralized data, Federated Learning (FL) can benefit from…

Large language models (LLMs) show promise for improving the efficiency of qualitative analysis in large, multi-site health-services research. Yet methodological guidance for LLM integration into qualitative analysis and evidence of their…

计算与语言 · 计算机科学 2026-01-22 Sasha Ronaghi , Emma-Louise Aveling , Maria Levis , Rachel Lauren Ross , Emily Alsentzer , Sara Singer

We study few-shot Natural Language Understanding (NLU) tasks with Large Language Models (LLMs) in federated learning (FL) scenarios. It is a challenging task due to limited labeled data and communication capacities in FL, especially with…

分布式、并行与集群计算 · 计算机科学 2023-07-27 Jingang Jiang , Xiangyang Liu , Chenyou Fan

Federated learning (FL) is an active area of research. One of the most suitable areas for adopting FL is the medical domain, where patient privacy must be respected. Previous research, however, does not provide a practical guide to applying…

机器学习 · 计算机科学 2023-05-22 Seongjun Yang , Hyeonji Hwang , Daeyoung Kim , Radhika Dua , Jong-Yeup Kim , Eunho Yang , Edward Choi

By adapting Large Language Models (LLMs) to domain-specific tasks or enriching them with domain-specific knowledge, we can fully harness the capabilities of LLMs. Nonetheless, a gap persists in achieving simultaneous mutual enhancement…

计算与语言 · 计算机科学 2026-04-24 Tao Fan , Yan Kang , Guoqiang Ma , Lixin Fan , Shuoling Liu , Kai Chen , Qiang Yang

Large language models (LLMs) hold promise for transforming healthcare, from streamlining administrative and clinical workflows to enriching patient engagement and advancing clinical decision-making. However, their successful integration…

计算机与社会 · 计算机科学 2025-04-04 Mohammed Al-Garadi , Tushar Mungle , Abdulaziz Ahmed , Abeed Sarker , Zhuqi Miao , Michael E. Matheny

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa,…

机器学习 · 计算机科学 2024-05-14 Xingyu Li , Lu Peng , Yuping Wang , Weihua Zhang

The rise of electronic health records (EHRs) has unlocked new opportunities for medical research, but privacy regulations and data heterogeneity remain key barriers to large-scale machine learning. Federated learning (FL) enables…

Fine-tuning large language models (LLMs) via federated learning, i.e., FedLLM, has been proposed to adapt LLMs for various downstream applications in a privacy-preserving way. To reduce the fine-tuning costs on resource-constrained devices,…

机器学习 · 计算机科学 2025-03-28 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu

Federated learning (FL) provides a promising paradigm for collaboratively training machine learning models across distributed data sources while maintaining privacy. Nevertheless, real-world FL often faces major challenges including…

机器学习 · 计算机科学 2025-07-09 Samuel Ofosu Mensah , Kerol Djoumessi , Philipp Berens

Federated Learning (FL) has emerged as an effective solution for multi-institutional collaborations without sharing patient data, offering a range of methods tailored for diverse applications. However, real-world medical datasets are often…

机器学习 · 计算机科学 2025-04-16 Penghao Wang , Qian Chen , Teng Zhang , Yingwei Zhang , Wang Lu , Yiqiang Chen

LLMs have demonstrated great capabilities in various NLP tasks. Different entities can further improve the performance of those LLMs on their specific downstream tasks by fine-tuning LLMs. When several entities have similar interested…

机器学习 · 计算机科学 2023-09-04 Weirui Kuang , Bingchen Qian , Zitao Li , Daoyuan Chen , Dawei Gao , Xuchen Pan , Yuexiang Xie , Yaliang Li , Bolin Ding , Jingren Zhou

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

While developing artificial intelligence (AI)-based algorithms to solve problems, the amount of data plays a pivotal role - large amount of data helps the researchers and engineers to develop robust AI algorithms. In the case of building…

机器学习 · 计算机科学 2022-04-25 Amartya Bhattacharya , Manish Gawali , Jitesh Seth , Viraj Kulkarni

Federated learning has enabled multiple parties to collaboratively train large language models without directly sharing their data (FedLLM). Following this training paradigm, the community has put massive efforts from diverse aspects…

计算与语言 · 计算机科学 2024-06-10 Rui Ye , Rui Ge , Xinyu Zhu , Jingyi Chai , Yaxin Du , Yang Liu , Yanfeng Wang , Siheng Chen

As a promising paradigm to collaboratively train models with decentralized data, Federated Learning (FL) can be exploited to fine-tune Large Language Models (LLMs). While LLMs correspond to huge size, the scale of the training data…

机器学习 · 计算机科学 2024-10-21 Ji Liu , Jiaxiang Ren , Ruoming Jin , Zijie Zhang , Yang Zhou , Patrick Valduriez , Dejing Dou

Artificial intelligence has transformed the perspective of medical imaging, leading to a genuine technological revolution in modern computer-assisted healthcare systems. However, ubiquitously featured deep learning (DL) systems require…

图像与视频处理 · 电气工程与系统科学 2026-01-09 Dominika Ciupek , Maciej Malawski , Tomasz Pieciak

Vision-language pre-training (VLP) has emerged as an effective scheme for multimodal representation learning, but its reliance on large-scale multimodal data poses significant challenges for medical applications. Federated learning (FL)…

机器学习 · 计算机科学 2024-11-25 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Liyue Shen

Federated learning (FL) enables collaborative model training without sharing raw data, making it attractive for privacy-sensitive domains, e.g., healthcare, finance, and IoT. A major obstacle, however, is the potential heterogeneity of…

机器学习 · 计算机科学 2026-02-02 Abdelrhman Gaber , Muhammad ElMahdy , Youssif Abuzied , Hassan Abd-Eltawab , Tamer ElBatt

With the increasing prevalence of mental health conditions worldwide, AI-powered chatbots and conversational agents have emerged as accessible tools to support mental health. However, deploying Large Language Models (LLMs) in mental…

计算与语言 · 计算机科学 2026-01-27 Nobin Sarwar