English
Related papers

Related papers: Analysing Training-Data Leakage from Gradients thr…

200 papers

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

Cryptography and Security · Computer Science 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Cen Chen , Chengyu Wang , Xiaodan Li , Wenmeng Zhou

Gradient inversion attacks on federated learning systems reconstruct client training data from exchanged gradient information. To defend against such attacks, a variety of defense mechanisms were proposed. However, they usually lead to an…

Machine Learning · Computer Science 2022-11-24 Daniel Scheliga , Patrick Mäder , Marco Seeland

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Recent studies have shown that the training samples can be recovered from gradients, which are called Gradient Inversion (GradInv) attacks. However, there remains a lack of extensive surveys covering recent advances and thorough analysis of…

Machine Learning · Computer Science 2022-06-16 Rui Zhang , Song Guo , Junxiao Wang , Xin Xie , Dacheng Tao

Gradient inversion attacks are often presented as a serious privacy threat in federated learning, with recent work reporting increasingly strong reconstructions under favorable experimental settings. However, it remains unclear whether such…

Cryptography and Security · Computer Science 2026-02-10 Viktor Valadi , Mattias Åkesson , Johan Östman , Fazeleh Hoseini , Salman Toor , Andreas Hellander

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

Machine Learning · Computer Science 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Deep Learning algorithms have recently become the de-facto paradigm for various prediction problems, which include many privacy-preserving applications like online medical image analysis. Presumably, the privacy of data in a deep learning…

Machine Learning · Computer Science 2018-11-14 Manaar Alam , Debdeep Mukhopadhyay

In the evolving landscape of Federated Learning (FL), the challenge of ensuring data integrity against poisoning attacks is paramount, particularly for applications demanding stringent privacy preservation. Traditional anomaly detection…

Cryptography and Security · Computer Science 2024-03-18 Zahir Alsulaimawi

Collaborative learning has gained great popularity due to its benefit of data privacy protection: participants can jointly train a Deep Learning model without sharing their training sets. However, recent works discovered that an adversary…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Gao , Shangwei Guo , Tianwei Zhang , Han Qiu , Yonggang Wen , Yang Liu

The idea of federated learning is to collaboratively train a neural network on a server. Each user receives the current weights of the network and in turns sends parameter updates (gradients) based on local data. This protocol has been…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jonas Geiping , Hartmut Bauermeister , Hannah Dröge , Michael Moeller

A fundamental challenge for multi-task learning is that different tasks may conflict with each other when they are solved jointly, and a cause of this phenomenon is conflicting gradients during optimization. Recent works attempt to mitigate…

Machine Learning · Computer Science 2023-02-23 Guangyuan Shi , Qimai Li , Wenlong Zhang , Jiaxin Chen , Xiao-Ming Wu

Recently researchers have studied input leakage problems in Federated Learning (FL) where a malicious party can reconstruct sensitive training inputs provided by users from shared gradient. It raises concerns about FL since input leakage…

Machine Learning · Computer Science 2021-07-22 Jiankai Sun , Yuanshun Yao , Weihao Gao , Junyuan Xie , Chong Wang

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

Machine Learning · Computer Science 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Data used to train supervised machine learning models are commonly split into independent training, validation, and test sets. This paper illustrates that complex data leakage cases have occurred in the no-reference image and video quality…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Franz Götz-Hahn , Vlad Hosu , Dietmar Saupe

Data reconstruction attacks on trained neural networks aim to recover the data on which the network has been trained and pose a significant threat to privacy, especially if the training dataset contains sensitive information. Here, we…

Machine Learning · Computer Science 2026-05-08 Edward Tansley , Roy Makhlouf , Estelle Massart , Coralia Cartis

Federated Learning (FL) has become a cornerstone of privacy protection, shifting the paradigm towards localizing sensitive data while only sending model gradients to a central server. This strategy is designed to reinforce privacy…

Machine Learning · Computer Science 2024-10-14 H. Yi , H. Ren , C. Hu , Y. Li , J. Deng , X. Xie

Deep feedforward and recurrent networks have achieved impressive results in many perception and language processing applications. This success is partially attributed to architectural innovations such as convolutional and long short-term…

Machine Learning · Statistics 2015-11-24 Arvind Neelakantan , Luke Vilnis , Quoc V. Le , Ilya Sutskever , Lukasz Kaiser , Karol Kurach , James Martens

Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed training, where a model is replicated into several…

Machine Learning · Computer Science 2021-03-18 Lusine Abrahamyan , Yiming Chen , Giannis Bekoulis , Nikos Deligiannis

Reconstructing training data from trained neural networks is an active area of research with significant implications for privacy and explainability. Recent advances have demonstrated the feasibility of this process for several data types.…

Machine Learning · Computer Science 2024-11-26 Ran Elbaz , Gilad Yehudai , Meirav Galun , Haggai Maron