English
Related papers

Related papers: Deep Leakage from Gradients

200 papers

Deep Learning has recently become hugely popular in machine learning, providing significant improvements in classification accuracy in the presence of highly-structured and large databases. Researchers have also considered privacy…

Cryptography and Security · Computer Science 2017-09-15 Briland Hitaj , Giuseppe Ateniese , Fernando Perez-Cruz

Two-party split learning is a popular technique for learning a model across feature-partitioned data. In this work, we explore whether it is possible for one party to steal the private label information from the other party during split…

Machine Learning · Computer Science 2022-05-26 Oscar Li , Jiankai Sun , Xin Yang , Weihao Gao , Hongyi Zhang , Junyuan Xie , Virginia Smith , Chong Wang

Large, general purpose language models have demonstrated impressive performance across many different conversational domains. While multi-domain language models achieve low overall perplexity, their outputs are not guaranteed to stay within…

Computation and Language · Computer Science 2023-12-11 Anmol Kabra , Ethan R. Elenberg

Differentially private stochastic gradient descent (DP-SGD) is the canonical approach to private deep learning. While the current privacy analysis of DP-SGD is known to be tight in some settings, several empirical results suggest that…

Machine Learning · Computer Science 2024-07-17 Anvith Thudi , Hengrui Jia , Casey Meehan , Ilia Shumailov , Nicolas Papernot

Federated Learning (FL) is a distributed learning framework, in which the local data never leaves clients devices to preserve privacy, and the server trains models on the data via accessing only the gradients of those local data. Without…

Machine Learning · Computer Science 2021-10-29 Jinwoo Jeon , Jaechang Kim , Kangwook Lee , Sewoong Oh , Jungseul Ok

Federated Learning (FL) enables collaborative training of models across distributed clients without sharing local data, addressing privacy concerns in decentralized systems. However, the gradient-sharing process exposes private data to…

Machine Learning · Computer Science 2025-03-11 Mingcong Xu , Xiaojin Zhang , Wei Chen , Hai Jin

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

Machine Learning · Computer Science 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Embeddings are functions that map raw input data to low-dimensional vector representations, while preserving important semantic information about the inputs. Pre-training embeddings on a large amount of unlabeled data and fine-tuning them…

Machine Learning · Computer Science 2020-08-21 Congzheng Song , Ananth Raghunathan

Federated learning (FL) enables collaborative model training among multiple clients without the need to expose raw data. Its ability to safeguard privacy, at the heart of FL, has recently been a hot-button debate topic. To elaborate,…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Fuyi Wang , Cen Chen , Jianying Zhou

Machine learning models leak information about their training data every time they reveal a prediction. This is problematic when the training data needs to remain private. Private prediction methods limit how much information about the…

Machine Learning · Computer Science 2020-07-13 Laurens van der Maaten , Awni Hannun

Federated learning enables isolated clients to train a shared model collaboratively by aggregating the locally-computed gradient updates. However, privacy information could be leaked from uploaded gradients and be exposed to malicious…

Cryptography and Security · Computer Science 2023-02-28 Dun Zeng , Shiyu Liu , Siqi Liang , Zonghang Li , Hui Wang , Irwin King , Zenglin Xu

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

Gradient inversion attacks are an ubiquitous threat in federated learning as they exploit gradient leakage to reconstruct supposedly private training data. Recent work has proposed to prevent gradient leakage without loss of model utility…

Machine Learning · Computer Science 2024-10-28 Daniel Scheliga , Patrick Mäder , Marco Seeland

To continuously improve quality and reflect changes in data, machine learning applications have to regularly retrain and update their core models. We show that a differential analysis of language model snapshots before and after an update…

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

Federated Learning is a machine learning setting that reduces direct data exposure, improving the privacy guarantees of machine learning models. Yet, the exchange of model updates between the participants and the aggregator can still leak…

Machine Learning · Computer Science 2025-12-18 Pablo Montaña-Fernández , Ines Ortega-Fernandez

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Despite tremendous success of modern neural networks, they are known to be overconfident even when the model encounters inputs with unfamiliar conditions. Detecting such inputs is vital to preventing models from making naive predictions…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jinsol Lee , Ghassan AlRegib

Federated learning (FL) is a popular distributed learning framework that can reduce privacy risks by not explicitly sharing private data. However, recent works demonstrated that sharing model updates makes FL vulnerable to inference…

Machine Learning · Computer Science 2020-12-14 Jingwei Sun , Ang Li , Binghui Wang , Huanrui Yang , Hai Li , Yiran Chen

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia