English
Related papers

Related papers: Disparate Privacy Vulnerability: Targeted Attribut…

200 papers

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

Cryptography and Security · Computer Science 2025-11-14 Josep Domingo-Ferrer

Membership inference attacks (MIAs) pose a significant threat to the privacy of machine learning models and are widely used as tools for privacy assessment, auditing, and machine unlearning. While prior MIA research has primarily focused on…

Machine Learning · Computer Science 2025-07-04 Zhiqi Wang , Chengyu Zhang , Yuetian Chen , Nathalie Baracaldo , Swanand Kadhe , Lei Yu

Attribute inference - the process of analyzing publicly available data in order to uncover hidden information - has become a major threat to privacy, given the recent technological leap in machine learning. One way to tackle this threat is…

Artificial Intelligence · Computer Science 2023-04-25 Marcin Waniek , Navya Suri , Abdullah Zameek , Bedoor AlShebli , Talal Rahwan

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Membership Inference Attacks exploit the vulnerabilities of exposing models trained on customer data to queries by an adversary. In a recently proposed implementation of an auditing tool for measuring privacy leakage from sensitive…

Machine Learning · Computer Science 2020-09-21 Abhinav Aggarwal , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

Machine Learning · Computer Science 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Privacy attacks on Machine Learning (ML) models often focus on inferring the existence of particular data points in the training data. However, what the adversary really wants to know is if a particular individual's (subject's) data was…

Machine Learning · Computer Science 2023-06-05 Anshuman Suri , Pallika Kanani , Virendra J. Marathe , Daniel W. Peterson

Ensuring privacy during inference stage is crucial to prevent malicious third parties from reconstructing users' private inputs from outputs of public models. Despite a large body of literature on privacy preserving learning (which ensures…

Cryptography and Security · Computer Science 2024-12-02 Fengwei Tian , Ravi Tandon

Privacy attacks on machine learning models aim to identify the data that is used to train such models. Such attacks, traditionally, are studied on static models that are trained once and are accessible by the adversary. Motivated to meet…

Machine Learning · Computer Science 2022-02-09 Ji Gao , Sanjam Garg , Mohammad Mahmoody , Prashant Nalini Vasudevan

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

Federated learning (FL) is an emerging paradigm for facilitating multiple organizations' data collaboration without revealing their private data to each other. Recently, vertical FL, where the participating organizations hold the same set…

Machine Learning · Computer Science 2022-07-15 Xinjian Luo , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Machine learning (ML) models have been deployed for high-stakes applications. Due to class imbalance in the sensitive attribute observed in the datasets, ML models are unfair on minority subgroups identified by a sensitive attribute, such…

Cryptography and Security · Computer Science 2022-11-28 Jan Aalmoes , Vasisht Duddu , Antoine Boutet

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

Scientific collaborations benefit from collaborative learning of distributed sources, but remain difficult to achieve when data are sensitive. In recent years, privacy preserving techniques have been widely studied to analyze distributed…

Cryptography and Security · Computer Science 2022-06-30 Guanhong Miao , A. Adam Ding , Samuel S. Wu

Machine learning models leak information about the datasets on which they are trained. An adversary can build an algorithm to trace the individual members of a model's training dataset. As a fundamental inference attack, he aims to…

Machine Learning · Statistics 2018-07-17 Milad Nasr , Reza Shokri , Amir Houmansadr

In recent years, recommender systems are crucially important for the delivery of personalized services that satisfy users' preferences. With personalized recommendation services, users can enjoy a variety of recommendations such as movies,…

Information Retrieval · Computer Science 2023-03-21 Shijie Zhang , Wei Yuan , Hongzhi Yin

So far, privacy models follow two paradigms. The first paradigm, termed inferential privacy in this paper, focuses on the risk due to statistical inference of sensitive information about a target record from other records in the database.…

Databases · Computer Science 2012-02-17 Ke Wang , Peng Wang , Ada Waichee Fu , Raywong Chi-Wing Wong

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Collaborative inference has recently emerged as an attractive framework for applying deep learning to Internet of Things (IoT) applications by splitting a DNN model into several subpart models among resource-constrained IoT devices and the…

Cryptography and Security · Computer Science 2022-11-22 Jihyeon Ryu , Yifeng Zheng , Yansong Gao , Sharif Abuadbba , Junyaup Kim , Dongho Won , Surya Nepal , Hyoungshick Kim , Cong Wang

While significant progress has been made in conventional fairness-aware machine learning (ML) and differentially private ML (DPML), the fairness of privacy protection across groups remains underexplored. Existing studies have proposed…

Machine Learning · Computer Science 2025-11-18 Zhi Yang , Changwu Huang , Ke Tang , Xin Yao