English
Related papers

Related papers: Systematic Evaluation of Privacy Risks of Machine …

200 papers

Malicious software is an integral part of cybercrime defense. Due to the growing number of malicious attacks and their target sources, detecting and preventing the attack becomes more challenging due to the assault's changing behavior. The…

Cryptography and Security · Computer Science 2023-08-10 Mohammad Aziz , Ali Saeed Alfoudi

This paper describes a testing methodology for quantitatively assessing the risk that rare or unique training-data sequences are unintentionally memorized by generative sequence models---a common type of machine-learning model. Because such…

Machine Learning · Computer Science 2019-07-17 Nicholas Carlini , Chang Liu , Úlfar Erlingsson , Jernej Kos , Dawn Song

Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is to utilize differential privacy (DP) during model training…

Cryptography and Security · Computer Science 2022-04-14 Saeed Mahloujifar , Alexandre Sablayrolles , Graham Cormode , Somesh Jha

As the prevalence of data-driven technologies in healthcare continues to rise, concerns regarding data privacy and security become increasingly paramount. This thesis aims to address the vulnerability of personalized healthcare models,…

Machine Learning · Computer Science 2024-07-08 Ahan Chatterjee , Sai Anirudh Aryasomayajula , Rajat Chaudhari , Subhajit Paul , Vishwa Mohan Singh

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

Artificial intelligence and machine learning have been integrated into all aspects of our lives and the privacy of personal data has attracted more and more attention. Since the generation of the model needs to extract the effective…

Cryptography and Security · Computer Science 2022-02-14 Ruikang Yang , Jianfeng Ma , Yinbin Miao , Xindi Ma

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

Machine Learning · Computer Science 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Deep Neural Networks (DNNs) have revolutionized various domains with their exceptional performance across numerous applications. However, Model Inversion (MI) attacks, which disclose private information about the training dataset by abusing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Hao Fang , Yixiang Qiu , Hongyao Yu , Wenbo Yu , Jiawei Kong , Baoli Chong , Bin Chen , Xuan Wang , Shu-Tao Xia , Ke Xu

We introduce Epsilon*, a new privacy metric for measuring the privacy risk of a single model instance prior to, during, or after deployment of privacy mitigation strategies. The metric requires only black-box access to model predictions,…

Membership inference (MI) attacks exploit the fact that machine learning algorithms sometimes leak information about their training data through the learned model. In this work, we study membership inference in the white-box setting in…

Machine Learning · Computer Science 2020-06-26 Klas Leino , Matt Fredrikson

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

Cryptography and Security · Computer Science 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Sequence models, such as Large Language Models (LLMs) and autoregressive image generators, have a tendency to memorize and inadvertently leak sensitive information. While this tendency has critical legal implications, existing tools are…

Cryptography and Security · Computer Science 2025-06-06 Lorenzo Rossi , Michael Aerni , Jie Zhang , Florian Tramèr

Machine learning tools are becoming increasingly powerful and widely used. Unfortunately membership attacks, which seek to uncover information from data sets used in machine learning, have the potential to limit data sharing. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Dennis Conway , Loic Simon , Alexis Lechervy , Frederic Jurie

We address the problem of defending predictive models, such as machine learning classifiers (Defender models), against membership inference attacks, in both the black-box and white-box setting, when the trainer and the trained model are…

Machine Learning · Computer Science 2022-02-07 Joseph Pedersen , Rafael Muñoz-Gómez , Jiangnan Huang , Haozhe Sun , Wei-Wei Tu , Isabelle Guyon

In an era of escalating cyber threats, malware poses significant risks to individuals and organizations, potentially leading to data breaches, system failures, and substantial financial losses. This study addresses the urgent need for…

Cryptography and Security · Computer Science 2025-01-28 Marzieh Esnaashari , Nima Moradi

This paper surveys the landscape of security and data attacks on machine unlearning, with a focus on financial and e-commerce applications. We discuss key privacy threats such as Membership Inference Attacks and Data Reconstruction Attacks,…

Cryptography and Security · Computer Science 2024-10-02 Carl E. J. Brodzinski

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine Learning · Computer Science 2023-01-10 Fred Lu , Joseph Munoz , Maya Fuchs , Tyler LeBlond , Elliott Zaresky-Williams , Edward Raff , Francis Ferraro , Brian Testa

Deep ensemble learning has been shown to improve accuracy by training multiple neural networks and averaging their outputs. Ensemble learning has also been suggested to defend against membership inference attacks that undermine privacy. In…

Machine Learning · Computer Science 2023-05-26 Shahbaz Rezaei , Zubair Shafiq , Xin Liu

Semi-supervised learning (SSL) leverages both labeled and unlabeled data to train machine learning (ML) models. State-of-the-art SSL methods can achieve comparable performance to supervised learning by leveraging much fewer labeled data.…

Cryptography and Security · Computer Science 2022-07-27 Xinlei He , Hongbin Liu , Neil Zhenqiang Gong , Yang Zhang