English
Related papers

Related papers: PriSampler: Mitigating Property Inference of Diffu…

200 papers

Data reconstruction attacks on machine learning models pose a substantial threat to privacy, potentially leaking sensitive information. Although defending against such attacks using differential privacy (DP) provides theoretical guarantees,…

Machine Learning · Computer Science 2025-03-11 Kristian Schwethelm , Johannes Kaiser , Moritz Knolle , Sarah Lockfisch , Daniel Rueckert , Alexander Ziller

Diffusion models showcase strong capabilities in image synthesis, being used in many computer vision tasks with great success. To this end, we propose to explore a new use case, namely to copy black-box classification models without having…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Vlad Hondru , Radu Tudor Ionescu

Learning from a large corpus of data, pre-trained models have achieved impressive progress nowadays. As popular generative pre-training, diffusion models capture both low-level visual knowledge and high-level semantic relations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Jinxiang Liu , Yu Wang , Ya Zhang , Yanfeng Wang

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

In recent years, diffusion models have achieved remarkable success in the realm of high-quality image generation, garnering increased attention. This surge in interest is paralleled by a growing concern over the security threats associated…

Machine Learning · Computer Science 2024-06-04 Sen Li , Junchi Ma , Minhao Cheng

In practical application, the widespread deployment of diffusion models often necessitates substantial investment in training. As diffusion models find increasingly diverse applications, concerns about potential misuse highlight the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Jijia Yang , Sen Peng , Xiaohua Jia

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Although diffusion-based techniques have shown remarkable success in image generation and editing tasks, their abuse can lead to severe negative social impacts. Recently, some works have been proposed to provide defense against the abuse of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zheng Li , Liangbin Xie , Jiantao Zhou , Xintao Wang , Haiwei Wu , Jinyu Tian

Recent advances in diffusion models have introduced a new era of text-guided image manipulation, enabling users to create realistic edited images with simple textual prompts. However, there is significant concern about the potential misuse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 June Suk Choi , Kyungmin Lee , Jongheon Jeong , Saining Xie , Jinwoo Shin , Kimin Lee

With the emerging trend of large generative models, ControlNet is introduced to enable users to fine-tune pre-trained models with their own data for various use cases. A natural question arises: how can we train ControlNet models while…

Machine Learning · Computer Science 2024-09-16 Dixi Yao

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

Cryptography and Security · Computer Science 2022-09-07 Bargav Jayaraman , David Evans

Face recognition poses serious privacy risks due to its reliance on sensitive and immutable biometric data. While modern systems mitigate privacy risks by mapping facial images to embeddings (commonly regarded as privacy-preserving), model…

Cryptography and Security · Computer Science 2026-05-04 Hanrui Wang , Shuo Wang , Chun-Shien Lu , Isao Echizen

Stable Diffusion has established itself as a foundation model in generative AI artistic applications, receiving widespread research and application. Some recent fine-tuning methods have made it feasible for individuals to implant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhengyue Zhao , Jinhao Duan , Kaidi Xu , Chenan Wang , Rui Zhang , Zidong Du , Qi Guo , Xing Hu

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

Thanks to their remarkable denoising capabilities, diffusion models are increasingly being employed as defensive tools to reinforce the security of other models, notably in purifying adversarial examples and certifying adversarial…

Cryptography and Security · Computer Science 2024-06-17 Changjiang Li , Ren Pang , Bochuan Cao , Jinghui Chen , Fenglong Ma , Shouling Ji , Ting Wang

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

Diffusion models are state-of-the-art deep learning empowered generative models that are trained based on the principle of learning forward and reverse diffusion processes via progressive noise-addition and denoising. To gain a better…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Sheng-Yen Chou , Pin-Yu Chen , Tsung-Yi Ho

Diffusion models are the leading approach for tabular data synthesis and are increasingly used to share sensitive records. Whether they actually protect privacy has become a pressing question. Membership inference attacks are the standard…

Machine Learning · Computer Science 2026-05-13 Abtin Mahyar , Masoumeh Shafieinejad , Yuhan Liu , Xi He

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu