English
Related papers

Related papers: Dual-Personalizing Adapter for Federated Foundatio…

200 papers

Personalized federated learning (PFL) aims to harness the collective wisdom of clients' data while building personalized models tailored to individual clients' data distributions. Existing works offer personalization primarily to clients…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Hong-You Chen , Jike Zhong , Mingda Zhang , Xuhui Jia , Hang Qi , Boqing Gong , Wei-Lun Chao , Li Zhang

Personalized Federated Learning (PFL) aims to learn personalized models for each client based on the knowledge across all clients in a privacy-preserving manner. Existing PFL methods generally assume that the underlying global data across…

Machine Learning · Computer Science 2023-03-28 Yang Lu , Pinxin Qian , Gang Huang , Hanzi Wang

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained…

Machine Learning · Computer Science 2023-06-05 Zhuo Zhang , Yuanhang Yang , Yong Dai , Lizhen Qu , Zenglin Xu

Massively multi-task learning with large language models has recently made substantial progress on few-shot generalization. However, this is usually performed in a centralized learning fashion, ignoring the privacy sensitivity issue of…

Computation and Language · Computer Science 2022-12-19 Weilong Dong , Xinwei Wu , Junzhuo Li , Shuangzhi Wu , Chao Bian , Deyi Xiong

Federated Learning (FL) enables decentralized, privacy-preserving model training but struggles to balance global generalization and local personalization due to non-identical data distributions across clients. Personalized Fine-Tuning…

Machine Learning · Computer Science 2025-12-30 Minghui Chen , Hrad Ghoukasian , Ruinan Jin , Zehua Wang , Sai Praneeth Karimireddy , Xiaoxiao Li

Foundation models (FMs) exhibit remarkable generalization but require adaptation to downstream tasks, particularly in privacy-sensitive applications. Due to data privacy regulations, cloud-based FMs cannot directly access private edge data,…

Machine Learning · Computer Science 2025-08-25 Guangyu Sun , Jingtao Li , Weiming Zhuang , Chen Chen , Chen Chen , Lingjuan Lyu

Federated Learning (FL) with pre-trained Vision-Language Models (VLMs) has emerged as a promising paradigm for various downstream tasks. By leveraging its strong representations, recent studies improve task adaptation under insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yuting Ma , Lechao Cheng , Xiaohua Xu

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Federated Learning (FL) has emerged as a promising framework for distributed machine learning, enabling collaborative model training without sharing local data, thereby preserving privacy and enhancing security. However, data heterogeneity…

Machine Learning · Computer Science 2025-03-21 Changlong Shi , He Zhao , Bingjie Zhang , Mingyuan Zhou , Dandan Guo , Yi Chang

While federated learning (FL) eliminates the transmission of raw data over a network, it is still vulnerable to privacy breaches from the communicated model parameters. Differential privacy (DP) is often employed to address such issues.…

Networking and Internet Architecture · Computer Science 2025-12-03 Evan Chen , Frank Po-Chen Lin , Dong-Jun Han , Christopher G. Brinton

Vision-Language Models (VLMs) like CLIP have demonstrated remarkable generalization in zero- and few-shot settings, but adapting them efficiently to decentralized, heterogeneous data remains a challenge. While prompt tuning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Sajjad Ghiasvand , Mahnoosh Alizadeh , Ramtin Pedarsani

Federated learning (FL) has prevailed as an efficient and privacy-preserved scheme for distributed learning. In this work, we mainly focus on the optimization of computation and communication in FL from a view of pruning. By adopting…

Machine Learning · Computer Science 2023-03-14 Zheqi Zhu , Yuchen Shi , Jiajun Luo , Fei Wang , Chenghui Peng , Pingyi Fan , Khaled B. Letaief

Current deep learning (DL)-based palmprint verification models rely on centralized training with large datasets, which raises significant privacy concerns due to biometric data's sensitive and immutable nature. Federated learning~(FL), a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ziyuan Yang , Yingyu Chen , Chengrui Gao , Andrew Beng Jin Teoh , Bob Zhang , Yi Zhang

Federated Learning (FL) with parameter-efficient fine-tuning, such as Low-Rank Adaptation (LoRA), enables scalable model training on distributed data. However, when combined with Differential Privacy (DP), LoRA often introduces errors…

Cryptography and Security · Computer Science 2026-05-12 Linh Tran , Ana Milanova , Stacy Patterson

Large Language Models (LLMs) herald a transformative era in artificial intelligence (AI). However, the expansive scale of data and parameters of LLMs requires high-demand computational and memory resources, restricting their accessibility…

Machine Learning · Computer Science 2024-11-26 Shengwen Ding , Chenhui Hu

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Balancing robust security with strong privacy guarantees is critical for Risk-Based Adaptive Authentication (RBA), particularly in decentralized settings. Federated Learning (FL) offers a promising solution by enabling collaborative risk…

Cryptography and Security · Computer Science 2025-09-23 Yaser Baseri , Abdelhakim Senhaji Hafid , Dimitrios Makrakis , Hamidreza Fereidouni

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across…

Machine Learning · Computer Science 2020-12-21 Wei Huang , Tianrui Li , Dexian Wang , Shengdong Du , Junbo Zhang

Federated Split Learning has been identified as an efficient approach to address the computational resource constraints of clients in classical federated learning, while guaranteeing data privacy for distributed model training across data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Yimeng Shan , Zhaorui Zhang , Sheng Di , Yu Liu , Xiaoyi Lu , Benben Liu

Realistic synthetic tabular data generation encounters significant challenges in preserving privacy, especially when dealing with sensitive information in domains like finance and healthcare. In this paper, we introduce \textit{Federated…

Machine Learning · Computer Science 2024-01-15 Timur Sattarov , Marco Schreyer , Damian Borth