English
Related papers

Related papers: Inferring Sensitive Attributes from Model Explanat…

200 papers

Feature attribution is widely used in interpretable machine learning to explain how influential each measured input feature value is for an output inference. However, measurements can be uncertain, and it is unclear how the awareness of…

Machine Learning · Computer Science 2021-01-26 Danding Wang , Wencan Zhang , Brian Y. Lim

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Many data mining tasks rely on graphs to model relational structures among individuals (nodes). Since relational data are often sensitive, there is an urgent need to evaluate the privacy risks in graph data. One famous privacy attack…

Machine Learning · Computer Science 2022-09-20 Zaixi Zhang , Qi Liu , Zhenya Huang , Hao Wang , Chee-Kong Lee , Enhong Chen

The notion that collaborative machine learning can ensure privacy by just withholding the raw data is widely acknowledged to be flawed. Over the past seven years, the literature has revealed several privacy attacks that enable adversaries…

Cryptography and Security · Computer Science 2024-09-27 Federico Mazzone , Ahmad Al Badawi , Yuriy Polyakov , Maarten Everts , Florian Hahn , Andreas Peter

This paper investigates a class of attacks targeting the confidentiality aspect of security in Deep Reinforcement Learning (DRL) policies. Recent research have established the vulnerability of supervised machine learning models (e.g.,…

Machine Learning · Computer Science 2019-06-05 Vahid Behzadan , William Hsu

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

Machine learning (ML) models are proving to be vulnerable to a variety of attacks that allow the adversary to learn sensitive information, cause mispredictions, and more. While these attacks have been extensively studied, current research…

Cryptography and Security · Computer Science 2025-06-24 Yugeng Liu , Zheng Li , Hai Huang , Michael Backes , Yang Zhang

Machine learning models are currently being deployed in a variety of real-world applications where model predictions are used to make decisions about healthcare, bank loans, and numerous other critical tasks. As the deployment of artificial…

Human-Computer Interaction · Computer Science 2019-10-07 Yuxin Ma , Tiankai Xie , Jundong Li , Ross Maciejewski

The purpose of anonymizing structured data is to protect the privacy of individuals in the data while retaining the statistical properties of the data. An important class of attack on anonymized data is attribute inference, where an…

Cryptography and Security · Computer Science 2025-07-03 Paul Francis , David Wagner

Model extraction attacks are one type of inference-time attacks that approximate the functionality and performance of a black-box victim model by launching a certain number of queries to the model and then leveraging the model's predictions…

Cryptography and Security · Computer Science 2025-01-03 Yixu Wang , Tianle Gu , Yan Teng , Yingchun Wang , Xingjun Ma

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

Cryptography and Security · Computer Science 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

This paper considers the problem of secure parameter estimation when the estimation algorithm is prone to causative attacks. Causative attacks, in principle, target decision-making algorithms to alter their decisions by making them…

Information Theory · Computer Science 2018-12-31 Saurabh Sihag , Ali Tajer

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the past few years,…

Cryptography and Security · Computer Science 2022-08-23 Xinlei He , Zheng Li , Weilin Xu , Cory Cornelius , Yang Zhang

Explainable Artificial Intelligence (XAI) is a crucial pathway in mitigating the risk of non-transparency in the decision-making process of black-box Artificial Intelligence (AI) systems. However, despite the benefits, XAI methods are found…

Artificial Intelligence · Computer Science 2025-12-30 Sonal Allana , Rozita Dara , Xiaodong Lin , Pulei Xiong

Machine learning models were shown to be vulnerable to model stealing attacks, which lead to intellectual property infringement. Among other methods, substitute model training is an all-encompassing attack applicable to any machine learning…

Machine Learning · Computer Science 2025-03-11 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

In recent years, a growing body of work has emerged on how to learn machine learning models under fairness constraints, often expressed with respect to some sensitive attributes. In this work, we consider the setting in which an adversary…

Machine Learning · Computer Science 2022-09-07 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

Cryptography and Security · Computer Science 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

In this paper, we initiate the study of local model reconstruction attacks for federated learning, where a honest-but-curious adversary eavesdrops the messages exchanged between a targeted client and the server, and then reconstructs the…

Machine Learning · Computer Science 2024-05-28 Ilias Driouich , Chuan Xu , Giovanni Neglia , Frederic Giroire , Eoin Thomas