中文
相关论文

相关论文: FedOne: Query-Efficient Federated Learning for Bla…

200 篇论文

Large language models (LLMs) have shown increasing power on various natural language processing (NLP) tasks. However, tuning these models for downstream tasks usually needs exorbitant costs or is unavailable due to commercial…

计算与语言 · 计算机科学 2024-05-07 Qiushi Sun , Chengcheng Han , Nuo Chen , Renyu Zhu , Jingyang Gong , Xiang Li , Ming Gao

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

机器学习 · 计算机科学 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato

Federated learning (FL) is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. The learning scheme may be horizontal, vertical or hybrid (both…

机器学习 · 计算机科学 2024-01-11 Fanfei Meng , Lele Zhang , Yu Chen , Yuxin Wang

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

机器学习 · 计算机科学 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language Models (LLMs) are trained on data from a single device or client. However, real-world scenarios often require fine-tuning these models on private data…

机器学习 · 计算机科学 2025-06-03 Sajjad Ghiasvand , Yifan Yang , Zhiyu Xue , Mahnoosh Alizadeh , Zheng Zhang , Ramtin Pedarsani

Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is…

机器学习 · 计算机科学 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

机器学习 · 计算机科学 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

机器学习 · 计算机科学 2022-02-04 Hongda Wu , Ping Wang

Federated Learning (FL) has recently been applied to the parameter-efficient fine-tuning of Large Language Models (LLMs). While promising, it raises significant challenges due to the heterogeneous resources and data distributions of…

计算与语言 · 计算机科学 2024-05-31 Jiamu Bai , Daoyuan Chen , Bingchen Qian , Liuyi Yao , Yaliang Li

As a mechanism for devices to update a global model without sharing data, federated learning bridges the tension between the need for data and respect for privacy. However, classic FL methods like Federated Averaging struggle with non-iid…

机器学习 · 计算机科学 2020-06-22 Kavya Kopparapu , Eric Lin

Personalized Federated Learning (PFL) is widely employed in IoT applications to handle high-volume, non-iid client data while ensuring data privacy. However, heterogeneous edge devices owned by clients may impose varying degrees of resource…

机器学习 · 计算机科学 2025-04-15 Ziru Niu , Hai Dong , A. K. Qin

Federated learning is a distributed learning framework where clients collaboratively train a global model without sharing their raw data. FedAvg is a popular algorithm for federated learning, but it often suffers from slow convergence due…

机器学习 · 计算机科学 2025-05-19 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Neural network pruning is an essential technique for reducing the size and complexity of deep neural networks, enabling large-scale models on devices with limited resources. However, existing pruning approaches heavily rely on training data…

机器学习 · 计算机科学 2023-07-12 Hong Huang , Lan Zhang , Chaoyue Sun , Ruogu Fang , Xiaoyong Yuan , Dapeng Wu

As a promising paradigm to collaboratively train models with decentralized data, Federated Learning (FL) can be exploited to fine-tune Large Language Models (LLMs). While LLMs correspond to huge size, the scale of the training data…

机器学习 · 计算机科学 2024-10-21 Ji Liu , Jiaxiang Ren , Ruoming Jin , Zijie Zhang , Yang Zhou , Patrick Valduriez , Dejing Dou

Recently pre-trained Foundation Models (FMs) have been combined with Federated Learning (FL) to improve training of downstream tasks while preserving privacy. However, deploying FMs over edge networks with resource-constrained Internet of…

分布式、并行与集群计算 · 计算机科学 2024-09-17 S. Kawa Atapour , S. Jamal SeyedMohammadi , S. Mohammad Sheikholeslami , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Federated Learning (FL) enables collaborative model training without sharing raw data but suffers from limited scalability, high communication costs, and privacy risks due to its centralized architecture. This paper proposes FedSelect-ME, a…

密码学与安全 · 计算机科学 2025-11-05 Hanie Vatani , Reza Ebrahimi Atani

Federated learning is a machine learning training paradigm that enables clients to jointly train models without sharing their own localized data. However, the implementation of federated learning in practice still faces numerous challenges,…

机器学习 · 计算机科学 2023-04-21 Yujia Wang , Lu Lin , Jinghui Chen

Federated learning (FL) effectively mitigates the data silo challenge brought about by policies and privacy concerns, implicitly harnessing more data for deep model training. However, traditional centralized FL models grapple with diverse…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Li Lin , Yixiang Liu , Jiewei Wu , Pujin Cheng , Zhiyuan Cai , Kenneth K. Y. Wong , Xiaoying Tang

Histopathological tissue classification is a fundamental task in computational pathology. Deep learning-based models have achieved superior performance but centralized training with data centralization suffers from the privacy leakage…

图像与视频处理 · 电气工程与系统科学 2023-12-19 Tianpeng Deng , Yanqi Huang , Guoqiang Han , Zhenwei Shi , Jiatai Lin , Qi Dou , Zaiyi Liu , Xiao-jing Guo , C. L. Philip Chen , Chu Han