中文
相关论文

相关论文: Shake to Leak: Fine-tuning Diffusion Models Can Am…

200 篇论文

With the rapid advancements of large-scale text-to-image diffusion models, various practical applications have emerged, bringing significant convenience to society. However, model developers may misuse the unauthorized data to train…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Qiao Li , Xiaomeng Fu , Xi Wang , Jin Liu , Xingyu Gao , Jiao Dai , Jizhong Han

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks,…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Tae-Young Lee , Juwon Seo , Jong Hwan Ko , Gyeong-Moon Park

Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained…

密码学与安全 · 计算机科学 2024-04-02 Shanglun Feng , Florian Tramèr

In recent years, diffusion models have achieved tremendous success in the field of image generation, becoming the stateof-the-art technology for AI-based image processing applications. Despite the numerous benefits brought by recent…

机器学习 · 计算机科学 2023-08-08 Derui Zhu , Dingfan Chen , Jens Grossklags , Mario Fritz

The rapid advancements of large language models (LLMs) have raised public concerns about the privacy leakage of personally identifiable information (PII) within their extensive training datasets. Recent studies have demonstrated that an…

密码学与安全 · 计算机科学 2024-08-01 Xiaoyi Chen , Siyuan Tang , Rui Zhu , Shijun Yan , Lei Jin , Zihao Wang , Liya Su , Zhikun Zhang , XiaoFeng Wang , Haixu Tang

Machine learning models are increasingly used for software security tasks. These models are commonly trained and evaluated on large Internet-derived datasets, which often contain duplicated or highly similar samples. When such samples are…

密码学与安全 · 计算机科学 2026-02-02 Farnaz Soltaniani , Mohammad Ghafari

There is a bias in the inference pipeline of most diffusion models. This bias arises from a signal leak whose distribution deviates from the noise distribution, creating a discrepancy between training and inference processes. We demonstrate…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Martin Nicolas Everaert , Athanasios Fitsios , Marco Bocchio , Sami Arpa , Sabine Süsstrunk , Radhakrishna Achanta

The recent developments of Diffusion Models (DMs) enable generation of astonishingly high-quality synthetic samples. Recent work showed that the synthetic samples generated by the diffusion model, which is pre-trained on public data and…

机器学习 · 计算机科学 2024-06-11 Jing Liu , Andrew Lowy , Toshiaki Koike-Akino , Kieran Parsons , Ye Wang

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

计算与语言 · 计算机科学 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Model editing offers a low-cost technique to inject or correct a particular behavior in a pre-trained model without extensive retraining, supporting applications such as factual correction and bias mitigation. Despite this common practice,…

人工智能 · 计算机科学 2025-06-24 Feng He , Zhenyang Liu , Marco Valentino , Zhixue Zhao

Image diffusion models such as DALL-E 2, Imagen, and Stable Diffusion have attracted significant attention due to their ability to generate high-quality synthetic images. In this work, we show that diffusion models memorize individual…

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

机器学习 · 计算机科学 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

密码学与安全 · 计算机科学 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

密码学与安全 · 计算机科学 2025-05-02 Hao Du , Shang Liu , Yang Cao

Diffusion models excel in many generative modeling tasks, notably in creating images from text prompts, a task referred to as text-to-image (T2I) generation. Despite the ability to generate high-quality images, these models often replicate…

多媒体 · 计算机科学 2024-02-20 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Haonan Wang , Kenji Kawaguchi

The responses generated by Large Language Models (LLMs) can include sensitive information from individuals and organizations, leading to potential privacy leakage. This work implements Influence Functions (IFs) to trace privacy leakage back…

机器学习 · 计算机科学 2024-09-06 Jinxin Liu , Zao Yang

Data publishing under privacy constraints can be achieved with mechanisms that add randomness to data points when released to an untrusted party, thereby decreasing the data's utility. In this paper, we analyze this privacy-utility tradeoff…

信息论 · 计算机科学 2024-08-28 Leonhard Grosse , Sara Saeidian , Tobias Oechtering

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

机器学习 · 计算机科学 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

机器学习 · 计算机科学 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

Text-to-Image (T2I) models have advanced rapidly, yet they remain vulnerable to semantic leakage, the unintended transfer of semantically related features between distinct entities. Existing mitigation strategies are often…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Mor Ventura , Michael Toker , Or Patashnik , Yonatan Belinkov , Roi Reichart