中文
相关论文

相关论文: Is Diffusion Model Safe? Severe Data Leakage via G…

200 篇论文

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

机器学习 · 计算机科学 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Diffusion models have been remarkably successful in data synthesis. However, when these models are applied to sensitive datasets, such as banking and human face data, they might bring up severe privacy concerns. This work systematically…

密码学与安全 · 计算机科学 2024-04-30 Hailong Hu , Jun Pang

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

机器学习 · 计算机科学 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global…

机器学习 · 计算机科学 2025-06-26 Fei Wang , Baochun Li

This study investigates privacy leakage in dimensionality reduction methods through a novel machine learning-based reconstruction attack. Employing an informed adversary threat model, we develop a neural network capable of reconstructing…

密码学与安全 · 计算机科学 2025-06-03 Chayadon Lumbut , Donlapark Ponnoprat

Understanding when and how much a model gradient leaks information about the training sample is an important question in privacy. In this paper, we present a surprising result: even without training or memorizing the data, we can fully…

机器学习 · 计算机科学 2023-06-13 Zihan Wang , Jason D. Lee , Qi Lei

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

机器学习 · 计算机科学 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

This paper presents a novel reconstruction method that leverages Diffusion Models to protect machine learning classifiers against adversarial attacks, all without requiring any modifications to the classifiers themselves. The susceptibility…

机器学习 · 计算机科学 2023-09-08 Hondamunige Prasanna Silva , Lorenzo Seidenari , Alberto Del Bimbo

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

机器学习 · 计算机科学 2025-04-15 Lucas Beerens , Desmond J. Higham

In Federated Learning (FL), clients share gradients with a central server while keeping their data local. However, malicious servers could deliberately manipulate the models to reconstruct clients' data from shared gradients, posing…

密码学与安全 · 计算机科学 2025-04-11 Kunlan Xiang , Haomiao Yang , Meng Hao , Shaofeng Li , Haoxin Wang , Zikang Ding , Wenbo Jiang , Tianwei Zhang

In privacy-preserving machine learning, it is common that the owner of the learned model does not have any physical access to the data. Instead, only a secured remote access to a data lake is granted to the model owner without any ability…

密码学与安全 · 计算机科学 2022-06-08 Huiyu Li , Nicholas Ayache , Hervé Delingette

Federated Learning (FL) enables collaborative model building among a large number of participants without the need for explicit data sharing. But this approach shows vulnerabilities when privacy inference attacks are applied to it. In…

机器学习 · 计算机科学 2022-10-26 Pretom Roy Ovi , Emon Dey , Nirmalya Roy , Aryya Gangopadhyay

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Haotian Xue , Chumeng Liang , Xiaoyu Wu , Yongxin Chen

Diffusion models have recently gained significant attention in both academia and industry due to their impressive generative performance in terms of both sampling quality and distribution coverage. Accordingly, proposals are made for…

机器学习 · 计算机科学 2024-09-20 Xinjian Luo , Yangfan Jiang , Fei Wei , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

机器学习 · 计算机科学 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz

The advance of explainable artificial intelligence, which provides reasons for its predictions, is expected to accelerate the use of deep neural networks in the real world like Machine Learning as a Service (MLaaS) that returns predictions…

密码学与安全 · 计算机科学 2021-07-20 Takayuki Miura , Satoshi Hasegawa , Toshiki Shibahara

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

计算机视觉与模式识别 · 计算机科学 2023-06-08 Gihyun Kwon , Jong Chul Ye