中文
相关论文

相关论文: Understanding Training-Data Leakage from Gradients…

200 篇论文

Deep deraining networks consistently encounter substantial generalization issues when deployed in real-world applications, although they are successful in laboratory benchmarks. A prevailing perspective in deep learning encourages using…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jinjin Gu , Xianzheng Ma , Xiangtao Kong , Yu Qiao , Chao Dong

Federated learning (FL) is a privacy-preserving machine learning framework that enables multiple nodes to train models on their local data and periodically average weight updates to benefit from other nodes' training. Each node's goal is to…

机器学习 · 计算机科学 2025-06-16 Ethan Wilson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

机器学习 · 计算机科学 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Model stealing attacks present a dilemma for public machine learning APIs. To protect financial investments, companies may be forced to withhold important information about their models that could facilitate theft, including uncertainty…

机器学习 · 计算机科学 2022-06-29 Mantas Mazeika , Bo Li , David Forsyth

Federated learning frameworks typically require collaborators to share their local gradient updates of a common model instead of sharing training data to preserve privacy. However, prior works on Gradient Leakage Attacks showed that private…

计算机视觉与模式识别 · 计算机科学 2021-12-30 Jiahao Lu , Xi Sheryl Zhang , Tianli Zhao , Xiangyu He , Jian Cheng

Federated learning (FL) enables collaborative model training among multiple clients without the need to expose raw data. Its ability to safeguard privacy, at the heart of FL, has recently been a hot-button debate topic. To elaborate,…

机器学习 · 计算机科学 2025-06-11 Mingyuan Fan , Fuyi Wang , Cen Chen , Jianying Zhou

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

密码学与安全 · 计算机科学 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Despite tremendous success of modern neural networks, they are known to be overconfident even when the model encounters inputs with unfamiliar conditions. Detecting such inputs is vital to preventing models from making naive predictions…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Jinsol Lee , Ghassan AlRegib

Among existing privacy attacks on the gradient of neural networks, \emph{data reconstruction attack}, which reverse engineers the training batch from the gradient, poses a severe threat on the private training data. Despite its empirical…

密码学与安全 · 计算机科学 2021-12-23 Xudong Pan , Mi Zhang , Yifan Yan , Jiaming Zhu , Min Yang

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy…

机器学习 · 计算机科学 2025-06-11 Mingyuan Fan , Cen Chen , Chengyu Wang , Xiaodan Li , Wenmeng Zhou

Linear layers in neural networks (NNs) trained by gradient descent can be expressed as a key-value memory system which stores all training datapoints and the initial weights, and produces outputs using unnormalised dot attention over the…

机器学习 · 计算机科学 2022-06-20 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Collaborative learning has gained great popularity due to its benefit of data privacy protection: participants can jointly train a Deep Learning model without sharing their training sets. However, recent works discovered that an adversary…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Wei Gao , Shangwei Guo , Tianwei Zhang , Han Qiu , Yonggang Wen , Yang Liu

Federated learning (FL) has become a key component in various language modeling applications such as machine translation, next-word prediction, and medical record analysis. These applications are trained on datasets from many FL…

密码学与安全 · 计算机科学 2025-12-11 Md Rafi Ur Rashid , Vishnu Asutosh Dasu , Kang Gu , Najrin Sultana , Shagufta Mehnaz

Federated learning has emerged as a promising paradigm for collaborative model training while preserving data privacy. However, recent studies have shown that it is vulnerable to various privacy attacks, such as data reconstruction attacks.…

密码学与安全 · 计算机科学 2024-07-25 Xiaojin Zhang , Wei Chen

Federated Learning (FL) has become a cornerstone of privacy protection, shifting the paradigm towards localizing sensitive data while only sending model gradients to a central server. This strategy is designed to reinforce privacy…

机器学习 · 计算机科学 2024-10-14 H. Yi , H. Ren , C. Hu , Y. Li , J. Deng , X. Xie

With the growing attention on learning-to-learn new tasks using only a few examples, meta-learning has been widely used in numerous problems such as few-shot classification, reinforcement learning, and domain generalization. However,…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Hung-Yu Tseng , Yi-Wen Chen , Yi-Hsuan Tsai , Sifei Liu , Yen-Yu Lin , Ming-Hsuan Yang

This paper presents a new mathematical framework to analyze the loss functions of deep neural networks with ReLU functions. Furthermore, as as application of this theory, we prove that the loss functions can reconstruct the inputs of the…

机器学习 · 统计学 2018-05-21 Akiyoshi Sannai

Machine Unlearning aims to remove specific data from trained models, addressing growing privacy and ethical concerns. We provide a theoretical analysis of a simple and widely used method - gradient ascent - used to reverse the influence of…

机器学习 · 计算机科学 2025-10-17 Odelia Melamed , Gilad Yehudai , Gal Vardi

Federated Learning is a privacy preserving decentralized machine learning paradigm designed to collaboratively train models across multiple clients by exchanging gradients to the server and keeping private data local. Nevertheless, recent…

密码学与安全 · 计算机科学 2025-01-07 Isaac Baglin , Xiatian Zhu , Simon Hadfield

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

机器学习 · 计算机科学 2025-09-24 Furan Xie , Bing Liu , Li Chai