English
Related papers

Related papers: Combining Stochastic Defenses to Resist Gradient I…

200 papers

Generative Adversarial Network (GAN) and its variants have recently attracted intensive research interests due to their elegant theoretical foundation and excellent empirical performance as generative models. These tools provide a promising…

Machine Learning · Computer Science 2018-02-20 Liyang Xie , Kaixiang Lin , Shu Wang , Fei Wang , Jiayu Zhou

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

Federated learning (FL) aims to protect data privacy by enabling clients to build machine learning models collaboratively without sharing their private data. Recent works demonstrate that information exchanged during FL is subject to…

Machine Learning · Computer Science 2024-07-09 Yuezhou Wu , Yan Kang , Jiahuan Luo , Yuanqin He , Qiang Yang

Federated learning (FL) allows to train a massive amount of data privately due to its decentralized structure. Stochastic gradient descent (SGD) is commonly used for FL due to its good empirical performance, but sensitive user information…

Machine Learning · Computer Science 2021-02-10 Muah Kim , Onur Günlü , Rafael F. Schaefer

Privacy estimation techniques for differentially private (DP) algorithms are useful for comparing against analytical bounds, or to empirically measure privacy loss in settings where known analytical bounds are not tight. However, existing…

Machine Learning · Computer Science 2024-04-19 Galen Andrew , Peter Kairouz , Sewoong Oh , Alina Oprea , H. Brendan McMahan , Vinith M. Suriyakumar

Model inversion (MI) attacks have raised increasing concerns about privacy, which can reconstruct training data from public models. Indeed, MI attacks can be formalized as an optimization problem that seeks private data in a certain space.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xiaojian Yuan , Kejiang Chen , Jie Zhang , Weiming Zhang , Nenghai Yu , Yang Zhang

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model.…

Machine Learning · Computer Science 2021-09-13 Zhicong Liang , Bao Wang , Quanquan Gu , Stanley Osher , Yuan Yao

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

Bidirectional privacy-preservation federated learning is crucial as both local gradients and the global model may leak privacy. However, only a few works attempt to achieve it, and they often face challenges such as excessive communication…

Machine Learning · Computer Science 2024-12-17 Xue Yang , Depan Peng , Yan Feng , Xiaohu Tang , Weijun Fang , Jun Shao

Federated reinforcement learning (FRL) enables distributed learning of optimal policies while preserving local data privacy through gradient sharing.However, FRL faces the risk of data privacy leaks, where attackers exploit shared gradients…

Machine Learning · Computer Science 2025-12-02 Shenghong He

While machine learning has achieved remarkable results in a wide variety of domains, the training of models often requires large datasets that may need to be collected from different individuals. As sensitive information may be contained in…

Machine Learning · Computer Science 2023-02-07 Richeng Jin , Xiaofan He , Huaiyu Dai

Federated Learning is a privacy preserving decentralized machine learning paradigm designed to collaboratively train models across multiple clients by exchanging gradients to the server and keeping private data local. Nevertheless, recent…

Cryptography and Security · Computer Science 2025-01-07 Isaac Baglin , Xiatian Zhu , Simon Hadfield

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

Machine Learning · Computer Science 2025-09-24 Furan Xie , Bing Liu , Li Chai

Many data mining tasks rely on graphs to model relational structures among individuals (nodes). Since relational data are often sensitive, there is an urgent need to evaluate the privacy risks in graph data. One famous privacy attack…

Machine Learning · Computer Science 2022-09-20 Zaixi Zhang , Qi Liu , Zhenya Huang , Hao Wang , Chee-Kong Lee , Enhong Chen

Differentially Private Stochastic Gradient Descent (DP-SGD) forms a fundamental building block in many applications for learning over sensitive data. Two standard approaches, privacy amplification by subsampling, and privacy amplification…

Machine Learning · Computer Science 2020-07-31 Borja Balle , Peter Kairouz , H. Brendan McMahan , Om Thakkar , Abhradeep Thakurta

Federated learning reduces the risk of information leakage, but remains vulnerable to attacks. We investigate how several neural network design decisions can defend against gradients inversion attacks. We show that overlapping gradients…

Machine Learning · Computer Science 2022-04-28 Shaltiel Eloul , Fran Silavong , Sanket Kamthe , Antonios Georgiadis , Sean J. Moran

Differential privacy (DP) provides a formal privacy guarantee that prevents adversaries with access to machine learning models from extracting information about individual training points. Differentially private stochastic gradient descent…

Cryptography and Security · Computer Science 2022-12-15 Jie Fu , Zhili Chen , XinPeng Ling

Federated Learning (FL) is an emerging distributed machine learning paradigm enabling multiple clients to train a global model collaboratively without sharing their raw data. While FL enhances data privacy by design, it remains vulnerable…