English
Related papers

Related papers: Visual Privacy Auditing with Diffusion Models

200 papers

We present a comprehensive analysis of privacy attacks and countermeasures in data-driven systems. We systematically categorize attacks targeting three domains: anonymous data (linkage and structural attacks), statistical aggregates…

Cryptography and Security · Computer Science 2025-09-30 Baobao Song , Shiva Raj Pokhrel , Mengyue Deng , Qiujun Lan , Robin Doss , Gang Li

Privacy concerns have led to the development of privacy-preserving approaches for learning models from sensitive data. Yet, in practice, even models learned with privacy guarantees can inadvertently memorize unique training examples or leak…

Machine Learning · Statistics 2019-11-11 Mario Diaz , Peter Kairouz , Jiachun Liao , Lalitha Sankar

Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. Prevalent methods tackling this problem use differential privacy (DP) or obfuscation techniques to protect the privacy of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 David Schneider , Sina Sajadmanesh , Vikash Sehwag , Saquib Sarfraz , Rainer Stiefelhagen , Lingjuan Lyu , Vivek Sharma

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Recently, detecting AI-generated images produced by diffusion-based models has attracted increasing attention due to their potential threat to safety. Among existing approaches, reconstruction-based methods have emerged as a prominent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Haoyang Jiang , Mingyang Yi , Shaolei Zhang , Junxian Cai , Qingbin Liu , Xi Chen , Ju Fan

Generative models have demonstrated revolutionary success in various visual creation tasks, but in the meantime, they have been exposed to the threat of leaking private information of their training data. Several membership inference…

Cryptography and Security · Computer Science 2023-10-31 Minxing Zhang , Ning Yu , Rui Wen , Michael Backes , Yang Zhang

As machine learning (ML) technologies become more prevalent in privacy-sensitive areas like healthcare and finance, eventually incorporating sensitive information in building data-driven algorithms, it is vital to scrutinize whether these…

Machine Learning · Computer Science 2025-04-08 Ehsanul Kabir , Lucas Craig , Shagufta Mehnaz

The increasing availability of personal data has enabled significant advances in fields such as machine learning, healthcare, and cybersecurity. However, this data abundance also raises serious privacy concerns, especially in light of…

Cryptography and Security · Computer Science 2026-04-24 Napsu Karmitsa , Antti Airola , Tapio Pahikkala , Tinja Pitkämäki

Machine learning models are increasingly utilized across impactful domains to predict individual outcomes. As such, many models provide algorithmic recourse to individuals who receive negative outcomes. However, recourse can be leveraged by…

Machine Learning · Computer Science 2023-08-09 Catherine Huang , Chelse Swoopes , Christina Xiao , Jiaqi Ma , Himabindu Lakkaraju

The remarkable proliferation of deep learning across various industries has underscored the importance of data privacy and security in AI pipelines. As the evolution of sophisticated Membership Inference Attacks (MIAs) threatens the secrecy…

Cryptography and Security · Computer Science 2023-06-06 Eugenio Lomurno , Alberto Archetti , Francesca Ausonio , Matteo Matteucci

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

Machine Learning · Computer Science 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

Training machine learning models with differential privacy (DP) limits an adversary's ability to infer sensitive information about the training data. It can be interpreted as a bound on adversary's capability to distinguish two adjacent…

Cryptography and Security · Computer Science 2026-04-08 Gauri Pradhan , Joonas Jälkö , Santiago Zanella-Béguelin , Antti Honkela

Recently, Diffusion Models (DMs) boost a wave in AI for Art yet raise new copyright concerns, where infringers benefit from using unauthorized paintings to train DMs to generate novel paintings in a similar style. To address these emerging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Chumeng Liang , Xiaoyu Wu , Yang Hua , Jiaru Zhang , Yiming Xue , Tao Song , Zhengui Xue , Ruhui Ma , Haibing Guan

With the rapid development of face recognition (FR) systems, the privacy of face images on social media is facing severe challenges due to the abuse of unauthorized FR systems. Some studies utilize adversarial attack techniques to defend…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Yuhao Sun , Lingyun Yu , Hongtao Xie , Jiaming Li , Yongdong Zhang

We address the problem of data augmentation in a rotating turbulence set-up, a paradigmatic challenge in geophysical applications. The goal is to reconstruct information in two-dimensional (2D) cuts of the three-dimensional flow fields,…

The availability of rich and vast data sources has greatly advanced machine learning applications in various domains. However, data with privacy concerns comes with stringent regulations that frequently prohibited data access and data…

Machine Learning · Computer Science 2023-09-28 Dingfan Chen , Raouf Kerkouche , Mario Fritz