English
Related papers

Related papers: Reconstructing Training Data from Model Gradient, …

200 papers

Federated Learning (FL) is a widely adopted privacy-preserving machine learning approach where private data remains local, enabling secure computations and the exchange of local model gradients between local clients and third-party…

Machine Learning · Computer Science 2025-08-04 Hanchi Ren , Jingjing Deng , Xianghua Xie

The prominence of embodied Artificial Intelligence (AI), which empowers robots to navigate, perceive, and engage within virtual environments, has attracted significant attention, owing to the remarkable advances in computer vision and large…

Robotics · Computer Science 2024-12-10 Miao Li , Wenhao Ding , Ding Zhao

Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching…

Machine Learning · Computer Science 2021-08-17 Xue Yang , Yan Feng , Weijun Fang , Jun Shao , Xiaohu Tang , Shu-Tao Xia , Rongxing Lu

We show through theory and experiment that gradient-based explanations of a model quickly reveal the model itself. Our results speak to a tension between the desire to keep a proprietary model secret and the ability to offer model…

Machine Learning · Statistics 2018-07-16 Smitha Milli , Ludwig Schmidt , Anca D. Dragan , Moritz Hardt

Federated learning enables multiple participants to collaboratively train a model without aggregating the training data. Although the training data are kept within each participant and the local gradients can be securely synthesized, recent…

Machine Learning · Computer Science 2021-04-28 Yanjun Zhang , Guangdong Bai , Xue Li , Surya Nepal , Ryan K L Ko

Recent work has demonstrated the successful extraction of training data from generative language models. However, it is not evident whether such extraction is feasible in text classification models since the training objective is to predict…

Computation and Language · Computer Science 2022-06-10 Adel Elmahdy , Huseyin A. Inan , Robert Sim

Data privacy has become an increasingly important issue in Machine Learning (ML), where many approaches have been developed to tackle this challenge, e.g. cryptography (Homomorphic Encryption (HE), Differential Privacy (DP), etc.) and…

Machine Learning · Computer Science 2022-09-13 Hanchi Ren , Jingjing Deng , Xianghua Xie

Models leak information about their training data. This enables attackers to infer sensitive information about their training sets, notably determine if a data sample was part of the model's training set. The existing works empirically show…

Machine Learning · Statistics 2021-02-18 Sasi Kumar Murakonda , Reza Shokri , George Theodorakopoulos

Federated learning (FL) enables collaborative model training among multiple clients without the need to expose raw data. Its ability to safeguard privacy, at the heart of FL, has recently been a hot-button debate topic. To elaborate,…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Fuyi Wang , Cen Chen , Jianying Zhou

Federated learning is a decentralized learning paradigm introduced to preserve privacy of client data. Despite this, prior work has shown that an attacker at the server can still reconstruct the private training data using only the client…

Cryptography and Security · Computer Science 2024-03-28 Joshua C. Zhao , Ahaan Dabholkar , Atul Sharma , Saurabh Bagchi

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

Machine Learning · Computer Science 2025-06-26 Fei Wang , Baochun Li

Unlearnable examples are proposed to prevent third parties from exploiting unauthorized data, which generates unlearnable examples by adding imperceptible perturbations to public publishing data. These unlearnable examples proficiently…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Pucheng Dang , Xing Hu , Kaidi Xu , Jinhao Duan , Di Huang , Husheng Han , Rui Zhang , Zidong Du

Recent regulation on right-to-be-forgotten emerges tons of interest in unlearning pre-trained machine learning models. While approximating a straightforward yet expensive approach of retrain-from-scratch, recent machine unlearning methods…

Machine Learning · Computer Science 2023-07-19 Seohui Bae , Seoyoon Kim , Hyemin Jung , Woohyung Lim

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

Machine Learning · Computer Science 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the…

Cryptography and Security · Computer Science 2021-12-02 Yangsibo Huang , Samyak Gupta , Zhao Song , Kai Li , Sanjeev Arora

Federated learning frameworks have been regarded as a promising approach to break the dilemma between demands on privacy and the promise of learning from large collections of distributed data. Many such frameworks only ask collaborators to…

Machine Learning · Computer Science 2021-03-17 Junyi Zhu , Matthew Blaschko

What is the information leakage of an iterative randomized learning algorithm about its training data, when the internal state of the algorithm is \emph{private}? How much is the contribution of each specific training epoch to the…

Machine Learning · Statistics 2022-09-12 Rishav Chourasia , Jiayuan Ye , Reza Shokri

``The right to be forgotten'' ensured by laws for user data privacy becomes increasingly important. Machine unlearning aims to efficiently remove the effect of certain data points on the trained model parameters so that it can be…

Machine Learning · Computer Science 2025-02-04 Eli Chien , Haoyu Wang , Ziang Chen , Pan Li