English
Related papers

Related papers: Analysing Training-Data Leakage from Gradients thr…

200 papers

Data privacy has become an increasingly important issue in Machine Learning (ML), where many approaches have been developed to tackle this challenge, e.g. cryptography (Homomorphic Encryption (HE), Differential Privacy (DP), etc.) and…

Machine Learning · Computer Science 2022-09-13 Hanchi Ren , Jingjing Deng , Xianghua Xie

With the advent of deep learning, the number of works proposing new methods or improving existent ones has grown exponentially in the last years. In this scenario, "very deep" models were emerging, once they were expected to extract more…

Artificial Intelligence · Computer Science 2021-01-19 Mateus Roder , Leandro A. Passos , Luiz Carlos Felix Ribeiro , Clayton Pereira , João Paulo Papa

Deep neural network image classifiers are known to be susceptible not only to adversarial examples created for them but even those created for others. This phenomenon poses a potential security risk in various black-box systems relying on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Kevin Richard G. Operiano , Wanchalerm Pora , Hitoshi Iba , Hiroshi Kera

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

The widespread deployment of deep learning models in privacy-sensitive domains has amplified concerns regarding privacy risks, particularly those stemming from gradient leakage during training. Current privacy assessments primarily rely on…

Machine Learning · Computer Science 2025-02-13 Jiayang Meng , Tao Huang , Hong Chen , Xin Shi , Qingyu Huang , Chen Hou

Model stealing attacks present a dilemma for public machine learning APIs. To protect financial investments, companies may be forced to withhold important information about their models that could facilitate theft, including uncertainty…

Machine Learning · Computer Science 2022-06-29 Mantas Mazeika , Bo Li , David Forsyth

Although federated learning has increasingly gained attention in terms of effectively utilizing local devices for data privacy enhancement, recent studies show that publicly shared gradients in the training process can reveal the private…

Cryptography and Security · Computer Science 2021-09-22 Jieren Deng , Yijue Wang , Ji Li , Chao Shang , Hang Liu , Sanguthevar Rajasekaran , Caiwen Ding

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Federated learning reduces the risk of information leakage, but remains vulnerable to attacks. We investigate how several neural network design decisions can defend against gradients inversion attacks. We show that overlapping gradients…

Machine Learning · Computer Science 2022-04-28 Shaltiel Eloul , Fran Silavong , Sanket Kamthe , Antonios Georgiadis , Sean J. Moran

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

Cryptography and Security · Computer Science 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

Federated Learning is a privacy preserving decentralized machine learning paradigm designed to collaboratively train models across multiple clients by exchanging gradients to the server and keeping private data local. Nevertheless, recent…

Cryptography and Security · Computer Science 2025-01-07 Isaac Baglin , Xiatian Zhu , Simon Hadfield

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

Machine Learning · Computer Science 2025-06-26 Fei Wang , Baochun Li

Reconstructing samples from the training set of trained neural networks is a major privacy concern. Haim et al. (2022) recently showed that it is possible to reconstruct training samples from neural network binary classifiers, based on…

Machine Learning · Computer Science 2023-05-08 Gon Buzaglo , Niv Haim , Gilad Yehudai , Gal Vardi , Michal Irani

Understanding whether deep neural networks are effectively optimized remains challenging, as training occurs in highly nonconvex landscapes and standard metrics provide limited visibility into layer-wise learning quality. This challenge is…

Machine Learning · Computer Science 2026-05-05 Arian Eamaz , Farhang Yeganegi , Mojtaba Soltanalian

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Federated learning (FL) is an emerging collaborative learning paradigm that aims to protect data privacy. Unfortunately, recent works show FL algorithms are vulnerable to the serious data reconstruction attacks. However, existing works lack…

Cryptography and Security · Computer Science 2024-08-23 Zifan Wang , Binghui Zhang , Meng Pang , Yuan Hong , Binghui Wang

Federated learning (FL) allows multiple entities to train a shared model collaboratively. Its core, privacy-preserving principle is that participants only exchange model updates, such as gradients, and never their raw, sensitive data. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Md Fazle Rasul , Alanood Alqobaisi , Bruhadeshwar Bezawada , Indrakshi Ray

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

Federated learning (FL) is an emerging distributed machine learning framework for collaborative model training with a network of clients (edge devices). FL offers default client privacy by allowing clients to keep their sensitive data on…

Machine Learning · Computer Science 2020-04-24 Wenqi Wei , Ling Liu , Margaret Loper , Ka-Ho Chow , Mehmet Emre Gursoy , Stacey Truex , Yanzhao Wu