English
Related papers

Related papers: Is Diffusion Model Safe? Severe Data Leakage via G…

200 papers

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Diffusion models have been remarkably successful in data synthesis. However, when these models are applied to sensitive datasets, such as banking and human face data, they might bring up severe privacy concerns. This work systematically…

Cryptography and Security · Computer Science 2024-04-30 Hailong Hu , Jun Pang

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

Machine Learning · Computer Science 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

Machine Learning · Computer Science 2025-06-26 Fei Wang , Baochun Li

This study investigates privacy leakage in dimensionality reduction methods through a novel machine learning-based reconstruction attack. Employing an informed adversary threat model, we develop a neural network capable of reconstructing…

Cryptography and Security · Computer Science 2025-06-03 Chayadon Lumbut , Donlapark Ponnoprat

Understanding when and how much a model gradient leaks information about the training sample is an important question in privacy. In this paper, we present a surprising result: even without training or memorizing the data, we can fully…

Machine Learning · Computer Science 2023-06-13 Zihan Wang , Jason D. Lee , Qi Lei

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

This paper presents a novel reconstruction method that leverages Diffusion Models to protect machine learning classifiers against adversarial attacks, all without requiring any modifications to the classifiers themselves. The susceptibility…

Machine Learning · Computer Science 2023-09-08 Hondamunige Prasanna Silva , Lorenzo Seidenari , Alberto Del Bimbo

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

Machine Learning · Computer Science 2025-04-15 Lucas Beerens , Desmond J. Higham

In Federated Learning (FL), clients share gradients with a central server while keeping their data local. However, malicious servers could deliberately manipulate the models to reconstruct clients' data from shared gradients, posing…

Cryptography and Security · Computer Science 2025-04-11 Kunlan Xiang , Haomiao Yang , Meng Hao , Shaofeng Li , Haoxin Wang , Zikang Ding , Wenbo Jiang , Tianwei Zhang

In privacy-preserving machine learning, it is common that the owner of the learned model does not have any physical access to the data. Instead, only a secured remote access to a data lake is granted to the model owner without any ability…

Cryptography and Security · Computer Science 2022-06-08 Huiyu Li , Nicholas Ayache , Hervé Delingette

Federated Learning (FL) enables collaborative model building among a large number of participants without the need for explicit data sharing. But this approach shows vulnerabilities when privacy inference attacks are applied to it. In…

Machine Learning · Computer Science 2022-10-26 Pretom Roy Ovi , Emon Dey , Nirmalya Roy , Aryya Gangopadhyay

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Haotian Xue , Chumeng Liang , Xiaoyu Wu , Yongxin Chen

Diffusion models have recently gained significant attention in both academia and industry due to their impressive generative performance in terms of both sampling quality and distribution coverage. Accordingly, proposals are made for…

Machine Learning · Computer Science 2024-09-20 Xinjian Luo , Yangfan Jiang , Fei Wei , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

Machine Learning · Computer Science 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz

The advance of explainable artificial intelligence, which provides reasons for its predictions, is expected to accelerate the use of deep neural networks in the real world like Machine Learning as a Service (MLaaS) that returns predictions…

Cryptography and Security · Computer Science 2021-07-20 Takayuki Miura , Satoshi Hasegawa , Toshiki Shibahara

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Gihyun Kwon , Jong Chul Ye
‹ Prev 1 3 4 5 6 7 10 Next ›