English
Related papers

Related papers: Gradient Inversion Attacks on Parameter-Efficient …

200 papers

Federated Learning (FL), a privacy-preserving machine learning framework, faces significant data-related challenges. For example, the lack of suitable public datasets leads to ineffective information exchange, especially in heterogeneous…

Cryptography and Security · Computer Science 2025-04-22 Xi Li , Chen Wu , Jiaqi Wang

Federated learning (FL), a novel branch of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, it is still possible to access the model updates (gradient…

Machine Learning · Computer Science 2024-06-27 Mahtab Talaei , Iman Izadi

The privacy-preserving federated learning schemes based on the setting of two honest-but-curious and non-colluding servers offer promising solutions in terms of security and efficiency. However, our investigation reveals that these schemes…

Cryptography and Security · Computer Science 2025-07-31 Jiahui Wu , Fucai Luo , Tiecheng Sun , Haiyan Wang , Weizhe Zhang

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Federated learning reduces the risk of information leakage, but remains vulnerable to attacks. We investigate how several neural network design decisions can defend against gradients inversion attacks. We show that overlapping gradients…

Machine Learning · Computer Science 2022-04-28 Shaltiel Eloul , Fran Silavong , Sanket Kamthe , Antonios Georgiadis , Sean J. Moran

Federated learning (FL) enables decentralized machine learning without sharing raw data, allowing multiple clients to collaboratively learn a global model. However, studies reveal that privacy leakage is possible under commonly adopted FL…

Machine Learning · Computer Science 2025-06-16 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Federated learning enables training high-utility models across several clients without directly sharing their private data. As a downside, the federated setting makes the model vulnerable to various adversarial attacks in the presence of…

Machine Learning · Computer Science 2024-03-12 Xiaoyang Wang , Dimitrios Dimitriadis , Sanmi Koyejo , Shruti Tople

Fine-tuning plays a crucial role in enabling pre-trained LLMs to evolve from general language comprehension to task-specific expertise. To preserve user data privacy, federated fine-tuning is often employed and has emerged as the de facto…

Machine Learning · Computer Science 2025-03-14 Shilong Wang , Jianchun Liu , Hongli Xu , Jiaming Yan , Xianjun Gao

While "instruction-tuned" generative large language models (LLMs) have demonstrated an impressive ability to generalize to new tasks, the training phases heavily rely on large amounts of diverse and high-quality instruction data (such as…

Computation and Language · Computer Science 2024-01-30 Jianyi Zhang , Saeed Vahidian , Martin Kuo , Chunyuan Li , Ruiyi Zhang , Tong Yu , Yufan Zhou , Guoyin Wang , Yiran Chen

With the rapid adoption of Federated Learning (FL) as the training and tuning protocol for applications utilizing Large Language Models (LLMs), recent research highlights the need for significant modifications to FL to accommodate the…

Cryptography and Security · Computer Science 2024-03-11 Minh N. Vu , Truc Nguyen , Tre' R. Jeter , My T. Thai

Federated Unlearning (FU) has emerged as a critical compliance mechanism for data privacy regulations, requiring unlearned clients to provide verifiable Proof of Federated Unlearning (PoFU) to auditors upon data removal requests. However,…

Cryptography and Security · Computer Science 2025-05-19 Fuyao Zhang , Wenjie Li , Yurong Hao , Xinyu Yan , Yang Cao , Wei Yang Bryan Lim

Federated Learning (FL) is a collaborative learning framework designed to protect client data, yet it remains highly vulnerable to Intellectual Property (IP) threats. Model extraction (ME) attacks pose a significant risk to Machine Learning…

Cryptography and Security · Computer Science 2025-06-02 Sayyed Farid Ahamed , Sandip Roy , Soumya Banerjee , Marc Vucovich , Kevin Choi , Abdul Rahman , Alison Hu , Edward Bowen , Sachin Shetty

Federated learning (FL) is an emerging paradigm that enables multiple organizations to jointly train a model without revealing their private data to each other. This paper studies {\it vertical} federated learning, which tackles the…

Cryptography and Security · Computer Science 2020-08-17 Yuncheng Wu , Shaofeng Cai , Xiaokui Xiao , Gang Chen , Beng Chin Ooi

Federated Learning (FL) allows for the training of Machine Learning models in a collaborative manner without the need to share sensitive data. However, it remains vulnerable to Gradient Leakage Attacks (GLAs), which can reveal private…

Machine Learning · Computer Science 2025-10-29 Miguel Fernandez-de-Retana , Unai Zulaika , Rubén Sánchez-Corcuera , Aitor Almeida

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

With the emerging trend in generative models and convenient public access to diffusion models pre-trained on large datasets, users can fine-tune these models to generate images of personal faces or items in new contexts described by natural…

Machine Learning · Computer Science 2024-09-16 Dixi Yao

Federated learning (FL) enables a set of entities to collaboratively train a machine learning model without sharing their sensitive data, thus, mitigating some privacy concerns. However, an increasing number of works in the literature…

Cryptography and Security · Computer Science 2022-01-04 Aidmar Wainakh , Ephraim Zimmer , Sandeep Subedi , Jens Keim , Tim Grube , Shankar Karuppayah , Alejandro Sanchez Guinea , Max Mühlhäuser

Fine-tuning large pre-trained foundation models (FMs) on distributed edge devices presents considerable computational and privacy challenges. Federated fine-tuning (FedFT) mitigates some privacy issues by facilitating collaborative model…

Machine Learning · Computer Science 2024-11-28 Tianqu Kang , Zixin Wang , Hengtao He , Jun Zhang , Shenghui Song , Khaled B. Letaief

Recent studies have revealed severe privacy risks in federated learning, represented by Gradient Leakage Attacks. However, existing studies mainly aim at increasing the privacy attack success rate and overlook the high computation costs for…

Cryptography and Security · Computer Science 2024-04-16 Nawrin Tabassum , Ka-Ho Chow , Xuyu Wang , Wenbin Zhang , Yanzhao Wu