English
Related papers

Related papers: Privacy Auditing Synthetic Data Release through Lo…

200 papers

Artificial intelligence and machine learning have been integrated into all aspects of our lives and the privacy of personal data has attracted more and more attention. Since the generation of the model needs to extract the effective…

Cryptography and Security · Computer Science 2022-02-14 Ruikang Yang , Jianfeng Ma , Yinbin Miao , Xindi Ma

Large language models (LLMs) have demonstrated significant success in various domain-specific tasks, with their performance often improving substantially after fine-tuning. However, fine-tuning with real-world data introduces privacy risks.…

Cryptography and Security · Computer Science 2025-01-30 Atilla Akkus , Masoud Poorghaffar Aghdam , Mingjie Li , Junjie Chu , Michael Backes , Yang Zhang , Sinem Sav

Membership inference attacks aim to detect if a particular data point was used in training a model. We design a novel statistical test to perform robust membership inference attacks (RMIA) with low computational overhead. We achieve this by…

Machine Learning · Statistics 2024-06-13 Sajjad Zarifzadeh , Philippe Liu , Reza Shokri

Deep learning models have an intrinsic privacy issue as they memorize parts of their training data, creating a privacy leakage. Membership Inference Attacks (MIA) exploit it to obtain confidential information about the data used for…

Cryptography and Security · Computer Science 2025-03-13 Daniel Jiménez-López , Nuria Rodríguez-Barroso , M. Victoria Luzón , Francisco Herrera

Sensitive datasets are often underutilized in research and industry due to privacy concerns, limiting the potential of valuable data-driven insights. Synthetic data generation presents a promising solution to address this challenge by…

Computation · Statistics 2026-01-27 Ali Furkan Kalay

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

Membership Inference Attacks (MIA) enable to empirically assess the privacy of a machine learning algorithm. In this paper, we propose TAMIS, a novel MIA against differentially-private synthetic data generation methods that rely on…

Machine Learning · Computer Science 2025-11-13 Paul Andrey , Batiste Le Bars , Marc Tommasi

Synthetic tabular data is essential for machine learning workflows, especially for expanding small or imbalanced datasets and enabling privacy-preserving data sharing. However, state-of-the-art generative models (GANs, VAEs, diffusion…

Machine Learning · Computer Science 2025-07-24 Jessup Byun , Xiaofeng Lin , Joshua Ward , Guang Cheng

When acting as a privacy-enhancing technology, synthetic data generation (SDG) aims to maintain a resemblance to the real data while excluding personally-identifiable information. Many SDG algorithms provide robust differential privacy (DP)…

Cryptography and Security · Computer Science 2025-04-02 Steven Golob , Sikha Pentyala , Anuar Maratkhan , Martine De Cock

Membership inference attacks (MIAs) are widely used to empirically assess privacy risks in machine learning models, both providing model-level vulnerability metrics and identifying the most vulnerable training samples. State-of-the-art…

Machine Learning · Computer Science 2025-06-13 Joseph Pollock , Igor Shilov , Euodia Dodd , Yves-Alexandre de Montjoye

Membership inference attacks (MIAs) aim to determine whether a specific sample was used to train a predictive model. Knowing this may indeed lead to a privacy breach. Most MIAs, however, make use of the model's prediction scores - the…

Machine Learning · Computer Science 2023-01-25 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

Synthetic data refers to artificial samples generated by models. While it has been validated to significantly enhance the performance of large language models (LLMs) during training and has been widely adopted in LLM development, potential…

Cryptography and Security · Computer Science 2025-10-27 Zi Liang , Qingqing Ye , Xuan Liu , Yanyun Wang , Jianliang Xu , Haibo Hu

Membership inference attacks (MIAs) aim to determine whether a data sample was included in a machine learning (ML) model's training set and have become the de facto standard for measuring privacy leakages in ML. We propose an evaluation…

Cryptography and Security · Computer Science 2026-03-25 Najeeb Jebreel , David Sánchez , Josep Domingo-Ferrer

Membership inference attacks (MIA) aim to infer whether a particular data point is part of the training dataset of a model. In this paper, we propose a new task in the context of LLM privacy: entity-level discovery of membership risk…

Machine Learning · Computer Science 2025-11-04 Ali Satvaty , Suzan Verberne , Fatih Turkmen

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

Machine Learning · Computer Science 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

Membership Inference Attack (MIA) determines the presence of a record in a machine learning model's training data by querying the model. Prior work has shown that the attack is feasible when the model is overfitted to its training data or…

Cryptography and Security · Computer Science 2018-02-15 Yunhui Long , Vincent Bindschaedler , Lei Wang , Diyue Bu , Xiaofeng Wang , Haixu Tang , Carl A. Gunter , Kai Chen

Fine-tuned language models pose significant privacy risks, as they may memorize and expose sensitive information from their training data. Membership inference attacks (MIAs) provide a principled framework for auditing these risks, yet…

Computation and Language · Computer Science 2026-04-14 David Ilić , David Stanojević , Kostadin Cvejoski

Membership inference attacks (MIA) can reveal whether a particular data point was part of the training dataset, potentially exposing sensitive information about individuals. This article provides theoretical guarantees by exploring the…

Machine Learning · Statistics 2025-10-08 Eric Aubinais , Elisabeth Gassiat , Pablo Piantanida

Low-rank adaptation (LoRA) is an efficient strategy for adapting latent diffusion models (LDMs) on a private dataset to generate specific images by minimizing the adaptation loss. However, the LoRA-adapted LDMs are vulnerable to membership…

Machine Learning · Computer Science 2024-12-17 Zihao Luo , Xilie Xu , Feng Liu , Yun Sing Koh , Di Wang , Jingfeng Zhang

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

Cryptography and Security · Computer Science 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr