English
Related papers

Related papers: Latent Diffusion Unlearning: Protecting Against Un…

200 papers

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub

The past few years have witnessed substantial advances in image generation powered by diffusion models. However, it was shown that diffusion models are susceptible to training data memorization, raising significant concerns regarding…

Cryptography and Security · Computer Science 2025-08-01 Zhe Ma , Qingming Li , Xuhong Zhang , Tianyu Du , Ruixiao Lin , Zonghui Wang , Shouling Ji , Wenzhi Chen

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Robust invisible watermarking aims to embed hidden messages into images such that they survive various manipulations while remaining imperceptible. However, powerful diffusion-based image generation and editing models now enable realistic…

Cryptography and Security · Computer Science 2025-11-11 Wenkai Fu , Finn Carter , Yue Wang , Emily Davis , Bo Zhang

Text-to-image (T2I) diffusion models have the ability to build high-quality pictures from text prompts, but they pose safety concerns because they can generate offensive or disturbing imagery when provided with harmful inputs. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chi Zhang , Changjia Zhu , Xiaowen Li , Yao Liu , Zhuo Lu

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Haotian Xue , Chumeng Liang , Xiaoyu Wu , Yongxin Chen

Diffusion models have shown remarkable performance in image synthesis, but they demand extensive computational and memory resources for training, fine-tuning and inference. Although advanced quantization techniques have successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Hoigi Seo , Wongi Jeong , Kyungryeol Lee , Se Young Chun

Diffusion models build a new milestone for image generation yet raising public concerns, for they can be fine-tuned on unauthorized images for customization. Protection based on adversarial attacks rises to encounter this unauthorized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Boyang Zheng , Chumeng Liang , Xiaoyu Wu

Diffusion models have recently shown the ability to generate high-quality images. However, controlling its generation process still poses challenges. The image style transfer task is one of those challenges that transfers the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Kento Masui , Mayu Otani , Masahiro Nomura , Hideki Nakayama

Automated scraping stands out as a common method for collecting data in deep learning models without the authorization of data owners. Recent studies have begun to tackle the privacy concerns associated with this data collection method.…

Machine Learning · Computer Science 2026-05-25 Thushari Hapuarachchi , Jing Lin , Kaiqi Xiong , Mohamed Rahouti , Gitte Ost

The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yimeng Zhang , Jinghan Jia , Xin Chen , Aochuan Chen , Yihua Zhang , Jiancheng Liu , Ke Ding , Sijia Liu

Recently, some research show that deep neural networks are vulnerable to the adversarial attacks, the well-trainned samples or patches could be used to trick the neural network detector or human visual perception. However, these adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xianyi Chen , Fazhan Liu , Dong Jiang , Kai Yan

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

Diffusion models have demonstrated remarkable capability in generating high-quality visual content from textual descriptions. However, since these models are trained on large-scale internet data, they inevitably learn undesirable concepts,…

Machine Learning · Computer Science 2025-02-18 Anh Bui , Khanh Doan , Trung Le , Paul Montague , Tamas Abraham , Dinh Phung

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

Machine Learning · Computer Science 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz

Denoising probabilistic diffusion models have shown breakthrough performance to generate more photo-realistic images or human-level illustrations than the prior models such as GANs. This high image-generation capability has stimulated the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Takami Sato , Justin Yue , Nanze Chen , Ningfei Wang , Qi Alfred Chen

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu