English
Related papers

Related papers: Seeing the Forest through the Trees: Data Leakage …

200 papers

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the…

Cryptography and Security · Computer Science 2021-12-02 Yangsibo Huang , Samyak Gupta , Zhao Song , Kai Li , Sanjeev Arora

Training deep neural networks via federated learning allows clients to share, instead of the original data, only the model trained on their data. Prior work has demonstrated that in practice a client's private information, unrelated to the…

Cryptography and Security · Computer Science 2021-06-01 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Hamed Haddadi , Soteris Demetriou

Federated learning (FL) allows multiple entities to train a shared model collaboratively. Its core, privacy-preserving principle is that participants only exchange model updates, such as gradients, and never their raw, sensitive data. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Md Fazle Rasul , Alanood Alqobaisi , Bruhadeshwar Bezawada , Indrakshi Ray

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data…

Machine Learning · Computer Science 2022-03-21 Liam Fowl , Jonas Geiping , Wojtek Czaja , Micah Goldblum , Tom Goldstein

The idea of federated learning is to collaboratively train a neural network on a server. Each user receives the current weights of the network and in turns sends parameter updates (gradients) based on local data. This protocol has been…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jonas Geiping , Hartmut Bauermeister , Hannah Dröge , Michael Moeller

Diffusion models are becoming defector generative models, which generate exceptionally high-resolution image data. Training effective diffusion models require massive real data, which is privately owned by distributed parties. Each data…

Artificial Intelligence · Computer Science 2024-06-03 Jiyue Huang , Chi Hong , Lydia Y. Chen , Stefanie Roos

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

Machine Learning · Computer Science 2025-06-26 Fei Wang , Baochun Li

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Federated learning (FL) has become a key component in various language modeling applications such as machine translation, next-word prediction, and medical record analysis. These applications are trained on datasets from many FL…

Cryptography and Security · Computer Science 2025-12-11 Md Rafi Ur Rashid , Vishnu Asutosh Dasu , Kang Gu , Najrin Sultana , Shagufta Mehnaz

Federated Learning (FL) framework brings privacy benefits to distributed learning systems by allowing multiple clients to participate in a learning task under the coordination of a central server without exchanging their private data.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zhuohang Li , Jiaxin Zhang , Luyang Liu , Jian Liu

Federated learning enables multiple users to build a joint model by sharing their model updates (gradients), while their raw data remains local on their devices. In contrast to the common belief that this provides privacy benefits, we here…

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

Machine Learning · Computer Science 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Distributed learning paradigms such as federated learning often involve transmission of model updates, or gradients, over a network, thereby avoiding transmission of private data. However, it is possible for sensitive information about the…

Machine Learning · Computer Science 2021-11-02 Trung Dang , Om Thakkar , Swaroop Ramaswamy , Rajiv Mathews , Peter Chin , Françoise Beaufays

Language models trained via federated learning (FL) demonstrate impressive capabilities in handling complex tasks while protecting user privacy. Recent studies indicate that leveraging gradient information and prior knowledge can…

Machine Learning · Computer Science 2024-03-19 Jianwei Li , Sheng Liu , Qi Lei

Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained…

Cryptography and Security · Computer Science 2024-04-02 Shanglun Feng , Florian Tramèr

Decentralized training has become a resource-efficient framework to democratize the training of large language models (LLMs). However, the privacy risks associated with this framework, particularly due to the potential inclusion of…

Cryptography and Security · Computer Science 2025-02-25 Chenxi Dai , Lin Lu , Pan Zhou

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

Cryptography and Security · Computer Science 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

Collaborative training of neural networks leverages distributed data by exchanging gradient information between different clients. Although training data entirely resides with the clients, recent work shows that training data can be…

Machine Learning · Computer Science 2021-10-22 Daniel Scheliga , Patrick Mäder , Marco Seeland

Federated learning (FL) allows multiple data-owners to collaboratively train machine learning models by exchanging local gradients, while keeping their private data on-device. To simultaneously enhance privacy and training efficiency,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hasin Us Sami , Swapneel Sen , Amit K. Roy-Chowdhury , Srikanth V. Krishnamurthy , Basak Guler