English
Related papers

Related papers: Membership Inference of Diffusion Models

200 papers

The escalating sophistication of cyberattacks has encouraged the integration of machine learning techniques in intrusion detection systems, but the rise of adversarial examples presents a significant challenge. These crafted perturbations…

Cryptography and Security · Computer Science 2024-06-26 Mohamed Amine Merzouk , Erwan Beurier , Reda Yaich , Nora Boulahia-Cuppens , Frédéric Cuppens

Deep learning has attracted broad interest in healthcare and medical communities. However, there has been little research into the privacy issues created by deep networks trained for medical applications. Recently developed inference attack…

Machine Learning · Computer Science 2020-11-03 Maoqiang Wu , Xinyue Zhang , Jiahao Ding , Hien Nguyen , Rong Yu , Miao Pan , Stephen T. Wong

Given the rising popularity of AI-generated art and the associated copyright concerns, identifying whether an artwork was used to train a diffusion model is an important research topic. The work approaches this problem from the membership…

Cryptography and Security · Computer Science 2025-08-14 Jingwei Li , Jing Dong , Tianxing He , Jingzhao Zhang

In this evolving era of machine learning security, membership inference attacks have emerged as a potent threat to the confidentiality of sensitive data. In this attack, adversaries aim to determine whether a particular point was used…

Machine Learning · Computer Science 2024-06-21 Abhishek Sinha , Himanshi Tibrewal , Mansi Gupta , Nikhar Waghela , Shivank Garg

Ensuring the privacy of research participants is vital, even more so in healthcare environments. Deep learning approaches to neuroimaging require large datasets, and this often necessitates sharing data between multiple sites, which is…

Quantitative Methods · Quantitative Biology 2021-06-04 Umang Gupta , Dimitris Stripelis , Pradeep K. Lam , Paul M. Thompson , José Luis Ambite , Greg Ver Steeg

Privacy attacks on Machine Learning (ML) models often focus on inferring the existence of particular data points in the training data. However, what the adversary really wants to know is if a particular individual's (subject's) data was…

Machine Learning · Computer Science 2023-06-05 Anshuman Suri , Pallika Kanani , Virendra J. Marathe , Daniel W. Peterson

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Differentially private models seek to protect the privacy of data the model is trained on, making it an important component of model security and privacy. At the same time, data scientists and machine learning engineers seek to use…

Cryptography and Security · Computer Science 2021-03-17 Erick Galinkin

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an…

Sound · Computer Science 2023-10-10 Fei Kong , Jinhao Duan , RuiPeng Ma , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

The increasingly pervasive facial recognition (FR) systems raise serious concerns about personal privacy, especially for billions of users who have publicly shared their photos on social media. Several attempts have been made to protect…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jiang Liu , Chun Pong Lau , Zhongliang Guo , Yuxiang Guo , Zhaoyang Wang , Rama Chellappa

Data privacy is an important issue for "machine learning as a service" providers. We focus on the problem of membership inference attacks: given a data sample and black-box access to a model's API, determine whether the sample existed in…

Machine Learning · Computer Science 2020-03-17 Sorami Hisamoto , Matt Post , Kevin Duh

As machine learning (ML) technologies become more prevalent in privacy-sensitive areas like healthcare and finance, eventually incorporating sensitive information in building data-driven algorithms, it is vital to scrutinize whether these…

Machine Learning · Computer Science 2025-04-08 Ehsanul Kabir , Lucas Craig , Shagufta Mehnaz

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

Diffusion models have demonstrated remarkable capabilities in image synthesis, but their recently proven vulnerability to Membership Inference Attacks (MIAs) poses a critical privacy concern. This paper introduces two novel and efficient…

Machine Learning · Computer Science 2024-10-23 Bao Q. Tran , Viet Nguyen , Anh Tran , Toan Tran

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership inference attacks exploit…

Cryptography and Security · Computer Science 2021-12-07 Christopher A. Choquette-Choo , Florian Tramer , Nicholas Carlini , Nicolas Papernot

Model explanations provide transparency into a trained machine learning model's blackbox behavior to a model builder. They indicate the influence of different input attributes to its corresponding model prediction. The dependency of…

Cryptography and Security · Computer Science 2022-09-09 Vasisht Duddu , Antoine Boutet

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

Natural language processing models have experienced a significant upsurge in recent years, with numerous applications being built upon them. Many of these applications require fine-tuning generic base models on customized, proprietary…

Machine Learning · Computer Science 2024-03-14 Guy Amit , Abigail Goldsteen , Ariel Farkash