English
Related papers

Related papers: Quantifying Membership Privacy via Information Lea…

200 papers

Federated learning algorithms are developed both for efficiency reasons and to ensure the privacy and confidentiality of personal and business data, respectively. Despite no data being shared explicitly, recent studies showed that the…

Machine Learning · Computer Science 2023-05-26 Balázs Pejó , Gergely Biczók

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

Quantum machine learning (QML) has the potential to achieve quantum advantage for specific tasks by combining quantum computation with classical machine learning (ML). In classical ML, a significant challenge is membership-privacy leakage,…

Quantum Physics · Physics 2026-04-24 Junjian Su , Runze He , Guanghui Li , Sujuan Qin , Zhimin He , Haozhen Situ , Fei Gao

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

Deep learning models have an intrinsic privacy issue as they memorize parts of their training data, creating a privacy leakage. Membership Inference Attacks (MIA) exploit it to obtain confidential information about the data used for…

Cryptography and Security · Computer Science 2025-03-13 Daniel Jiménez-López , Nuria Rodríguez-Barroso , M. Victoria Luzón , Francisco Herrera

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

Cryptography and Security · Computer Science 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

Training deep neural networks via federated learning allows clients to share, instead of the original data, only the model trained on their data. Prior work has demonstrated that in practice a client's private information, unrelated to the…

Cryptography and Security · Computer Science 2021-06-01 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Hamed Haddadi , Soteris Demetriou

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

Computation and Language · Computer Science 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Large Language Models (LLMs) memorize, and thus, among huge amounts of uncontrolled data, may memorize Personally Identifiable Information (PII), which should not be stored and, consequently, not leaked. In this paper, we introduce Private…

Cryptography and Security · Computer Science 2025-08-22 Elena Sofia Ruzzetti , Giancarlo A. Xompero , Davide Venditti , Fabio Massimo Zanzotto

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

Machine Learning · Computer Science 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image…

Cryptography and Security · Computer Science 2019-10-28 Lingchen Zhao , Qian Wang , Qin Zou , Yan Zhang , Yanjiao Chen

Recent work~\cite{Liu2016} has shown that dependencies between items in a dataset can lead to privacy leaks. We extend this concept to privacy-preserving transformations, considering a broader set of dependencies captured by correlation…

Cryptography and Security · Computer Science 2025-06-17 Kenneth Odoh

Deep learning models trained on large-scale data have achieved encouraging performance in many real-world tasks. Meanwhile, publishing those models trained on sensitive datasets, such as medical records, could pose serious privacy concerns.…

Machine Learning · Computer Science 2022-11-04 Qiuchen Zhang , Jing Ma , Jian Lou , Li Xiong , Xiaoqian Jiang

Federated Learning (FL) enables collaborative model building among a large number of participants without the need for explicit data sharing. But this approach shows vulnerabilities when privacy inference attacks are applied to it. In…

Machine Learning · Computer Science 2022-10-26 Pretom Roy Ovi , Emon Dey , Nirmalya Roy , Aryya Gangopadhyay

The right to be forgotten states that a data owner has the right to erase their data from an entity storing it. In the context of machine learning (ML), the right to be forgotten requires an ML model owner to remove the data owner's data…

Cryptography and Security · Computer Science 2021-09-15 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Mathias Humbert , Yang Zhang

Protecting the confidentiality of private data and using it for useful collaboration have long been at odds. Modern cryptography is bridging this gap through rapid growth in secure protocols such as multi-party computation,…

Cryptography and Security · Computer Science 2023-06-12 Maximilian Zinkus , Yinzhi Cao , Matthew Green

Machine unlearning (MU) has emerged as a key mechanism for ensuring data privacy and regulatory compliance by enabling models to forget specific training samples. However, recent studies have shown that the removal of data can inadvertently…

Cryptography and Security · Computer Science 2026-05-05 Jie Fu , Nima Naderloui , Da Zhong , Yuan Hong , Wendy Hui Wang

Pointwise maximal leakage (PML) is a per-outcome privacy measure based on threat models from quantitative information flow. Privacy guarantees with PML rely on knowledge about the distribution that generated the private data. In this work,…

Cryptography and Security · Computer Science 2025-09-29 Leonhard Grosse , Sara Saeidian , Mikael Skoglund , Tobias J. Oechtering

In this work, we define a collaborative and privacy-preserving machine teaching paradigm with multiple distributed teachers. We focus on consensus super teaching. It aims at organizing distributed teachers to jointly select a compact while…

Machine Learning · Computer Science 2019-05-09 Yufei Han , Yuzhe Ma , Christopher Gates , Kevin Roundy , Yun Shen