English
Related papers

Related papers: Synth-MIA: A Testbed for Auditing Privacy Leakage …

200 papers

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

Machine Learning · Computer Science 2025-06-03 Yongchao Huang

We propose a new framework for Bayesian estimation of differential privacy, incorporating evidence from multiple membership inference attacks (MIA). Bayesian estimation is carried out via a Markov chain Monte Carlo (MCMC) algorithm, named…

Machine Learning · Computer Science 2025-11-04 Ceren Yildirim , Kamer Kaya , Sinan Yildirim , Erkay Savas

A membership inference attack (MIA) poses privacy risks for the training data of a machine learning model. With an MIA, an attacker guesses if the target data are a member of the training dataset. The state-of-the-art defense against MIAs,…

Cryptography and Security · Computer Science 2022-11-16 Rishav Chourasia , Batnyam Enkhtaivan , Kunihiro Ito , Junki Mori , Isamu Teranishi , Hikaru Tsuchida

In recent years, the widespread adoption of Machine Learning as a Service (MLaaS), particularly in sensitive environments, has raised considerable privacy concerns. Of particular importance are membership inference attacks (MIAs), which…

Cryptography and Security · Computer Science 2026-02-16 Osama Zafar , Shaojie Zhan , Tianxi Ji , Erman Ayday

Tabular data plays an important role in many fields and industries, including those with elevated privacy considerations and risks. As such, there is a rising interest in generating high-quality synthetic proxies for real tabular data as a…

This paper extends the Classification Error Gauge (x-CEG) framework, originally developed for measuring the privacy-utility trade-off in tabular datasets, to privacy auditing of Large Language Models (LLMs). We propose LLM-CEG, a systematic…

Cryptography and Security · Computer Science 2026-04-28 Kato Mivule

Balancing strong privacy guarantees with high predictive performance is critical for time series forecasting (TSF) tasks involving Electronic Health Records (EHR). In this study, we explore how data augmentation can mitigate Membership…

Machine Learning · Computer Science 2025-11-10 Marius Fracarolli , Michael Staniek , Stefan Riezler

Advances in generative models have transformed the field of synthetic image generation for privacy-preserving data synthesis (PPDS). However, the field lacks a comprehensive survey and comparison of synthetic image generation methods across…

Cryptography and Security · Computer Science 2025-06-27 Yunsung Chung , Yunbei Zhang , Nassir Marrouche , Jihun Hamm

Recent Deep Learning (DL) advancements in solving complex real-world tasks have led to its widespread adoption in practical applications. However, this opportunity comes with significant underlying risks, as many of these models rely on…

Cryptography and Security · Computer Science 2024-02-20 Shubhi Shukla , Manaar Alam , Sarani Bhattacharya , Debdeep Mukhopadhyay , Pabitra Mitra

The Synthetic Minority Over-sampling Technique (SMOTE) is one of the most widely used methods for addressing class imbalance and generating synthetic data. Despite its popularity, little attention has been paid to its privacy implications;…

Cryptography and Security · Computer Science 2026-03-03 Georgi Ganev , Reza Nazari , Rees Davison , Amir Dizche , Xinmin Wu , Ralph Abbey , Jorge Silva , Emiliano De Cristofaro

Membership Inference Attacks (MIAs) are widely used to quantify training data memorization and assess privacy risks. Standard evaluation requires repeated retraining, which is computationally costly for large models. One-run methods (single…

Machine Learning · Computer Science 2026-02-06 Mathieu Even , Clément Berenfeld , Linus Bleistein , Tudor Cebere , Julie Josse , Aurélien Bellet

Evaluating the quality of synthetic data remains a key challenge for ensuring privacy and utility in data-driven research. In this work, we present an evaluation framework that quantifies how well synthetic data replicates original…

Machine Learning · Computer Science 2025-04-03 Andrey Sidorenko , Michael Platzer , Mario Scriminaci , Paul Tiwald

Optimization algorithms that seek flatter minima, such as Sharpness-Aware Minimization (SAM), are credited with improved generalization and robustness to noise. We ask whether such gains impact membership privacy. Surprisingly, we find that…

Machine Learning · Computer Science 2026-01-29 Young In Kim , Andrea Agiollo , Pratiksha Agrawal , Johannes O. Royset , Rajiv Khanna

Membership inference attacks are a key measure to evaluate privacy leakage in machine learning (ML) models. These attacks aim to distinguish training members from non-members by exploiting differential behavior of the models on member and…

Cryptography and Security · Computer Science 2021-10-19 Xinyu Tang , Saeed Mahloujifar , Liwei Song , Virat Shejwalkar , Milad Nasr , Amir Houmansadr , Prateek Mittal

Recommender systems (RecSys) have been widely applied to various applications, including E-commerce, finance, healthcare, social media and have become increasingly influential in shaping user behavior and decision-making, highlighting their…

Information Retrieval · Computer Science 2026-01-09 Jiajie He , Xintong Chen , Xinyang Fang , Min-Chun Chen , Yuechun Gu , Keke Chen

Real-world data often exhibits bias, imbalance, and privacy risks. Synthetic datasets have emerged to address these issues. This paradigm relies on generative AI models to generate unbiased, privacy-preserving data while maintaining…

Sharing of tabular data containing valuable but private information is limited due to legal and ethical issues. Synthetic data could be an alternative solution to this sharing problem, as it is artificially generated by machine learning…

Machine Learning · Computer Science 2025-03-06 Fatima J. Sarmin , Atiquer R. Rahman , Christopher J. Henry , Noman Mohammed

Retrieval-augmented generation (RAG) has become central to large language model (LLM) deployments, grounding responses in enterprise or proprietary data to reduce hallucinations. However, this design introduces a new privacy risk: model…

Cryptography and Security · Computer Science 2026-05-26 Nguyen Linh Bao Nguyen , Wanlun Ma , Viet Vo , Alsharif Abuadbba , Minghong Fang , Jun Zhang , Yang Xiang

As large-scale models such as Large Language Models (LLMs) and Large Multimodal Models (LMMs) see increasing deployment, their privacy risks remain underexplored. Membership Inference Attacks (MIAs), which reveal whether a data point was…

Machine Learning · Computer Science 2025-09-03 Hengyu Wu , Yang Cao

With the emergence of powerful large-scale foundation models, the training paradigm is increasingly shifting from from-scratch training to transfer learning. This enables high utility training with small, domain-specific datasets typical in…

Machine Learning · Computer Science 2025-10-09 Yuxuan Bai , Gauri Pradhan , Marlon Tobaben , Antti Honkela