English
Related papers

Related papers: How Worrying Are Privacy Attacks Against Machine L…

200 papers

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

We quantitatively investigate how machine learning models leak information about the individual data records on which they were trained. We focus on the basic membership inference attack: given a data record and black-box access to a model,…

Cryptography and Security · Computer Science 2017-04-04 Reza Shokri , Marco Stronati , Congzheng Song , Vitaly Shmatikov

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

Machine learning models, especially deep neural networks have been shown to be susceptible to privacy attacks such as membership inference where an adversary can detect whether a data point was used for training a black-box model. Such…

Machine Learning · Computer Science 2020-07-20 Shruti Tople , Amit Sharma , Aditya Nori

With the fast adoption of machine learning (ML) techniques, sharing of ML models is becoming popular. However, ML models are vulnerable to privacy attacks that leak information about the training data. In this work, we focus on a particular…

Machine Learning · Computer Science 2022-09-06 Xiuling Wang , Wendy Hui Wang

We study the privacy implications of training recurrent neural networks (RNNs) with sensitive training datasets. Considering membership inference attacks (MIAs), which aim to infer whether or not specific data records have been used in…

Cryptography and Security · Computer Science 2023-01-23 Yunhao Yang , Parham Gohari , Ufuk Topcu

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

The success of deep neural networks has driven numerous research studies and applications from Euclidean to non-Euclidean data. However, there are increasing concerns about privacy leakage, as these networks rely on processing private data.…

Machine Learning · Computer Science 2025-11-03 Zhanke Zhou , Jianing Zhu , Fengfei Yu , Xuan Li , Xiong Peng , Tongliang Liu , Bo Han

The prosperity of machine learning has also brought people's concerns about data privacy. Among them, inference attacks can implement privacy breaches in various MLaaS scenarios and model training/prediction phases. Specifically, inference…

Machine Learning · Computer Science 2024-06-28 Feng Wu , Lei Cui , Shaowen Yao , Shui Yu

As Machine Learning (ML) evolves, the complexity and sophistication of security threats against this paradigm continue to grow as well, threatening data privacy and model integrity. In response, Machine Unlearning (MU) is a recent…

Cryptography and Security · Computer Science 2025-10-13 Muhammed Shafi K. P. , Serena Nicolazzo , Antonino Nocera , Vinod P

Membership inference attacks (MIA) can reveal whether a particular data point was part of the training dataset, potentially exposing sensitive information about individuals. This article provides theoretical guarantees by exploring the…

Machine Learning · Statistics 2025-10-08 Eric Aubinais , Elisabeth Gassiat , Pablo Piantanida

Membership inference attacks (MIAs) aim to determine whether a specific sample was used to train a predictive model. Knowing this may indeed lead to a privacy breach. Most MIAs, however, make use of the model's prediction scores - the…

Machine Learning · Computer Science 2023-01-25 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

Machine learning (ML) models have been shown to be vulnerable to Membership Inference Attacks (MIA), which infer the membership of a given data point in the target dataset by observing the prediction output of the ML model. While the key…

Machine Learning · Computer Science 2020-07-28 Shakila Mahjabin Tonni , Dinusha Vatsalan , Farhad Farokhi , Dali Kaafar , Zhigang Lu , Gioacchino Tangari

This work investigates and evaluates multiple defense strategies against property inference attacks (PIAs), a privacy attack against machine learning models. Given a trained machine learning model, PIAs aim to extract statistical properties…

Cryptography and Security · Computer Science 2023-10-10 Joshua Stock , Jens Wettlaufer , Daniel Demmler , Hannes Federrath

As machine learning expanding application, there are more and more unignorable privacy and safety issues. Especially inference attacks against Machine Learning models allow adversaries to infer sensitive information about the target model,…

Cryptography and Security · Computer Science 2022-12-22 Yang Yang

Machine learning (ML) models are vulnerable to membership inference attacks (MIAs), which determine whether a given input is used for training the target model. While there have been many efforts to mitigate MIAs, they often suffer from…

Cryptography and Security · Computer Science 2023-07-06 Zitao Chen , Karthik Pattabiraman

Membership inference attack (MIA) has become one of the most widely used and effective methods for evaluating the privacy risks of machine learning models. These attacks aim to determine whether a specific sample is part of the model's…

Cryptography and Security · Computer Science 2025-06-04 Jing Xue , Zhishen Sun , Haishan Ye , Luo Luo , Xiangyu Chang , Ivor Tsang , Guang Dai

Membership inference attacks (MIAs) pose a critical threat to the privacy of training data in deep learning. Despite significant progress in attack methodologies, our understanding of when and how models encode membership information during…

Machine Learning · Computer Science 2025-08-05 Yuetian Chen , Zhiqi Wang , Nathalie Baracaldo , Swanand Ravindra Kadhe , Lei Yu