English
Related papers

Related papers: Concept Arithmetics for Circumventing Concept Inhi…

200 papers

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

Machine Learning · Computer Science 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

With the rapid advancements of large-scale text-to-image diffusion models, various practical applications have emerged, bringing significant convenience to society. However, model developers may misuse the unauthorized data to train…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Qiao Li , Xiaomeng Fu , Xi Wang , Jin Liu , Xingyu Gao , Jiao Dai , Jizhong Han

Diffusion models have recently gained significant attention in both academia and industry due to their impressive generative performance in terms of both sampling quality and distribution coverage. Accordingly, proposals are made for…

Machine Learning · Computer Science 2024-09-20 Xinjian Luo , Yangfan Jiang , Fei Wei , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Diffusion models have achieved remarkable results in generating high-quality, diverse, and creative images. However, when it comes to text-based image generation, they often fail to capture the intended meaning presented in the text. For…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Kota Sueyoshi , Takashi Matsubara

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

Cryptography and Security · Computer Science 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Although neural networks achieve promising performance in many tasks, they may still fail when encountering some examples and bring about risks to applications. To discover risky samples, previous literature attempts to search for patterns…

Machine Learning · Computer Science 2025-12-23 Han Yu , Hao Zou , Xingxuan Zhang , Zhengyi Wang , Yue He , Kehan Li , Peng Cui

Diffusion models (DMs) have achieved remarkable success in text-to-image generation, but they also pose safety risks, such as the potential generation of harmful content and copyright violations. The techniques of machine unlearning, also…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yimeng Zhang , Xin Chen , Jinghan Jia , Yihua Zhang , Chongyu Fan , Jiancheng Liu , Mingyi Hong , Ke Ding , Sijia Liu

Diffusion models have shown promising results for a wide range of generative tasks with continuous data, such as image and audio synthesis. However, little progress has been made on using diffusion models to generate discrete symbolic music…

Sound · Computer Science 2023-10-24 Jincheng Zhang , György Fazekas , Charalampos Saitis

Large text-to-image diffusion models have demonstrated remarkable image synthesis capabilities, but their indiscriminate training on Internet-scale data has led to learned concepts that enable harmful, copyrighted, or otherwise undesirable…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Finn Carter

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE$\cdot$2 are revolutionizing how people generate visual content. At the same time, society has serious concerns about how adversaries can exploit such models to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yiting Qu , Xinyue Shen , Xinlei He , Michael Backes , Savvas Zannettou , Yang Zhang

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Remarkable progress in text-to-image diffusion models has brought a major concern about potentially generating images on inappropriate or trademarked concepts. Concept erasing has been investigated with the goals of deleting target concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Byung Hyun Lee , Sungjin Lim , Seunggyu Lee , Dong Un Kang , Se Young Chun

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tae-Young Lee , Juwon Seo , Jong Hwan Ko , Gyeong-Moon Park

Autoregressive and diffusion models represent two complementary generative paradigms. Autoregressive models excel at sequential planning and constraint composition, yet struggle with tasks that require explicit spatial or physical…

Artificial Intelligence · Computer Science 2026-02-03 Mu Yuan , Liekang Zeng , Guoliang Xing , Lan Zhang , Yunhao Liu

Modern generative models exhibit unprecedented capabilities to generate extremely realistic data. However, given the inherent compositionality of the real world, reliable use of these models in practical applications requires that they…

Machine Learning · Computer Science 2025-07-29 Maya Okawa , Ekdeep Singh Lubana , Robert P. Dick , Hidenori Tanaka

Text-to-image diffusion models have been demonstrated with undesired generation due to unfiltered large-scale training data, such as sexual images and copyrights, necessitating the erasure of undesired concepts. Most existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zheling Meng , Bo Peng , Xiaochuan Jin , Yue Jiang , Wei Wang , Jing Dong , Tieniu Tan

Text-to-image diffusion models can generate realistic images based on textual inputs, enabling users to convey their opinions visually through language. Meanwhile, within language, emotion plays a crucial role in expressing personal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Tianyu Wei , Shanmin Pang , Qi Guo , Yizhuo Ma , Xiaofeng Cao , Qing Guo

Advancements in diffusion models have enabled effortless image editing via text prompts, raising concerns about image security. Attackers with access to user images can exploit these tools for malicious edits. Recent defenses attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Aniruddha Bala , Rohit Chowdhury , Rohan Jaiswal , Siddharth Roheda