English
Related papers

Related papers: Defense against Poisoning Attacks under Shuffle-DP

200 papers

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Differentially private (DP) machine learning algorithms incur many sources of randomness, such as random initialization, random batch subsampling, and shuffling. However, such randomness is difficult to take into account when proving…

Machine Learning · Statistics 2023-11-02 Chendi Wang , Buxin Su , Jiayuan Ye , Reza Shokri , Weijie J. Su

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

Differentially private federated learning (DP-FL) is a promising technique for collaborative model training while ensuring provable privacy for clients. However, optimizing the tradeoff between privacy and accuracy remains a critical…

Machine Learning · Computer Science 2024-07-25 Shuya Feng , Meisam Mohammady , Hanbin Hong , Shenao Yan , Ashish Kundu , Binghui Wang , Yuan Hong

In this paper, we present a framework based on differential privacy (DP) for querying electric power measurements to detect system anomalies or bad data. Our DP approach conceals consumption and system matrix data, while simultaneously…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Nikhil Ravi , Anna Scaglione , Sean Peisert , Parth Pradhan

Federated learning promises to make machine learning feasible on distributed, private datasets by implementing gradient descent using secure aggregation methods. The idea is to compute a global weight update without revealing the…

Machine Learning · Computer Science 2019-12-03 Badih Ghazi , Rasmus Pagh , Ameya Velingker

Differential privacy protects an individual's privacy by perturbing data on an aggregated level (DP) or individual level (LDP). We report four online human-subject experiments investigating the effects of using different approaches to…

Cryptography and Security · Computer Science 2020-04-01 Aiping Xiong , Tianhao Wang , Ninghui Li , Somesh Jha

While quantum computing has strong potential in data-driven fields, the privacy issue of sensitive or valuable information involved in the quantum algorithm should be considered. Differential privacy (DP), which is a fundamental privacy…

Quantum Physics · Physics 2024-08-15 Yusheng Zhao , Hui Zhong , Xinyue Zhang , Yuqing Li , Chi Zhang , Miao Pan

We consider the problem of secret protection, in which a business or organization wishes to train a model on their own data, while attempting to not leak secrets potentially contained in that data via the model. The standard method for…

Cryptography and Security · Computer Science 2025-06-03 Arun Ganesh , Brendan McMahan , Milad Nasr , Thomas Steinke , Abhradeep Thakurta

Federated learning (FL) enables collaborative model training through model parameter exchanges instead of raw data. To avoid potential inference attacks from exchanged parameters, differential privacy (DP) offers rigorous guarantee against…

Cryptography and Security · Computer Science 2025-01-14 Shu Hong , Xiaojun Lin , Lingjie Duan

Differential privacy (DP) -- a principled approach to producing statistical data products with strong, mathematically provable privacy guarantees for the individuals in the underlying dataset -- has seen substantial adoption in practice…

Cryptography and Security · Computer Science 2025-11-26 Priyanka Nanayakkara , Elena Ghazi , Salil Vadhan

Recent studies reveal that local differential privacy (LDP) protocols are vulnerable to data poisoning attacks where an attacker can manipulate the final estimate on the server by leveraging the characteristics of LDP and sending carefully…

Cryptography and Security · Computer Science 2025-01-28 Xiaoguang Li , Zitao Li , Ninghui Li , Wenhai Sun

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

Differentially Private Federated Learning (DP-FL) has garnered attention as a collaborative machine learning approach that ensures formal privacy. Most DP-FL approaches ensure DP at the record-level within each silo for cross-silo FL.…

Machine Learning · Computer Science 2024-06-18 Fumiyuki Kato , Li Xiong , Shun Takagi , Yang Cao , Masatoshi Yoshikawa

It has been widely understood that differential privacy (DP) can guarantee rigorous privacy against adversaries with arbitrary prior knowledge. However, recent studies demonstrate that this may not be true for correlated data, and indicate…

Machine Learning · Computer Science 2019-06-07 Yanan Li , Xuebin Ren , Shusen Yang , Xinyu Yang

Recently, several studies have indicated that data poisoning attacks pose a severe security threat to deep learning-based (DL-based) code search models. Attackers inject carefully crafted malicious patterns into the training data,…

Software Engineering · Computer Science 2025-07-16 Gong Chen , Wenjie Liu , Xiaoyuan Xie , Xunzhu Tang , Tegawendé F. Bissyandé , Songqiang Chen

Differential privacy is a popular privacy model within the research community because of the strong privacy guarantee it offers, namely that the presence or absence of any individual in a data set does not significantly influence the…

Cryptography and Security · Computer Science 2017-02-09 Jordi Soria-Comas , Josep Domingo-Ferrer , David Sánchez , David Megías

Differential privacy is a widely accepted formal privacy definition that allows aggregate information about a dataset to be released while controlling privacy leakage for individuals whose records appear in the data. Due to the unavoidable…

Cryptography and Security · Computer Science 2022-09-09 Prottay Protivash , John Durrell , Zeyu Ding , Danfeng Zhang , Daniel Kifer

Differential privacy (DP) is a widely used notion for reasoning about privacy when publishing aggregate data. In this paper, we observe that certain DP mechanisms are amenable to a posteriori privacy analysis that exploits the fact that…

Cryptography and Security · Computer Science 2023-06-21 Valentin Hartmann , Vincent Bindschaedler , Alexander Bentkamp , Robert West

Differential privacy (DP) considers a scenario, where an adversary has almost complete information about the entries of a database This worst-case assumption is likely to overestimate the privacy thread for an individual in real life.…

Cryptography and Security · Computer Science 2025-04-16 Dennis Breutigam , Rüdiger Reischuk