中文
相关论文

相关论文: FedLLM-Align: Feature Extraction From Heterogeneou…

200 篇论文

The enormous amount of data produced by mobile and IoT devices has motivated the development of federated learning (FL), a framework allowing such devices (or clients) to collaboratively train machine learning models without sharing their…

机器学习 · 计算机科学 2023-01-12 Angelo Rodio , Francescomaria Faticanti , Othmane Marfoq , Giovanni Neglia , Emilio Leonardi

Multimodal Large Language Models (MLLMs) have made significant advancements, demonstrating powerful capabilities in processing and understanding multimodal data. Fine-tuning MLLMs with Federated Learning (FL) allows for expanding the…

机器学习 · 计算机科学 2025-03-11 Binqian Xu , Xiangbo Shu , Haiyang Mei , Guosen Xie , Basura Fernando , Jinhui Tang

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

机器学习 · 计算机科学 2025-10-22 Ali Forootani , Raffaele Iervolino

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises from the non-IID…

机器学习 · 计算机科学 2024-07-09 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Federated learning (FL) enables collaborative model training across organizations without sharing raw data, addressing crucial privacy concerns in healthcare natural language processing (NLP). However, training large language models (LLMs)…

机器学习 · 计算机科学 2025-04-16 Lihong Zhang , Yue Li

Electronic Health Records (EHR) data contains medical records such as diagnoses, medications, procedures, and treatments of patients. This data is often considered sensitive medical information. Therefore, the EHR data from the medical…

机器学习 · 计算机科学 2023-05-25 Ofir Ben Shoham , Nadav Rappoport

Instruction tuning is a crucial step in improving the responsiveness of pretrained large language models (LLMs) to human instructions. Federated learning (FL) helps to exploit the use of vast private instruction data from clients, becoming…

机器学习 · 计算机科学 2025-06-30 Zhen Qin , Zhaomin Wu , Bingsheng He , Shuiguang Deng

Federated learning (FL) promises to enable collaborative machine learning across healthcare sites whilst preserving data privacy. Practical deployment remains limited by statistical heterogeneity arising from differences in patient…

Foundation models (FMs) have demonstrated remarkable performance in machine learning but demand extensive training data and computational resources. Federated learning (FL) addresses the challenges posed by FMs, especially related to data…

机器学习 · 计算机科学 2023-10-24 Jiyun Shin , Jinhyun Ahn , Honggu Kang , Joonhyuk Kang

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which…

分布式、并行与集群计算 · 计算机科学 2024-11-05 Boyu Fan , Siyang Jiang , Xiang Su , Sasu Tarkoma , Pan Hui

Fine-tuning large language models (LLMs) via federated learning, i.e., FedLLM, has been proposed to adapt LLMs for various downstream applications in a privacy-preserving way. To reduce the fine-tuning costs on resource-constrained devices,…

机器学习 · 计算机科学 2025-03-28 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu

Standard federated learning approaches suffer when client data distributions have sufficient heterogeneity. Recent methods addressed the client data heterogeneity issue via personalized federated learning (PFL) - a class of FL algorithms…

机器学习 · 计算机科学 2024-04-04 Rishub Tamirisa , Chulin Xie , Wenxuan Bao , Andy Zhou , Ron Arel , Aviv Shamsian

Federated learning is a decentralized training approach that keeps data under stakeholder control while achieving superior performance over isolated training. While inter-institutional feature discrepancies pose a challenge in all federated…

图像与视频处理 · 电气工程与系统科学 2025-07-01 Vasilis Siomos , Jonathan Passerat-Palmbach , Giacomo Tarroni

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

机器学习 · 计算机科学 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

Pre-trained BERT models have achieved impressive performance in many natural language processing (NLP) tasks. However, in many real-world situations, textual data are usually decentralized over many clients and unable to be uploaded to a…

计算与语言 · 计算机科学 2022-05-27 Zhengyang Li , Shijing Si , Jianzong Wang , Jing Xiao

In Federated Learning (FL), clients may have weak devices that cannot train the full model or even hold it in their memory space. To implement large-scale FL applications, thus, it is crucial to develop a distributed learning method that…

机器学习 · 计算机科学 2024-06-24 Sunwoo Lee , Tuo Zhang , Saurav Prakash , Yue Niu , Salman Avestimehr

Data-driven industrial health prognostics require rich training data to develop accurate and reliable predictive models. However, stringent data privacy laws and the abundance of edge industrial data necessitate decentralized data…

机器学习 · 计算机科学 2023-05-19 Anushiya Arunan , Yan Qin , Xiaoli Li , Chau Yuen

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

机器学习 · 计算机科学 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

机器学习 · 计算机科学 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

机器学习 · 计算机科学 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang