English
Related papers

Related papers: Revealing Vulnerabilities in Stable Diffusion via …

200 papers

Text-to-image models have recently made significant advances in generating realistic and semantically coherent images, driven by advanced diffusion models and large-scale web-crawled datasets. However, these datasets often contain…

Machine Learning · Computer Science 2025-10-29 Byeonghu Na , Mina Kang , Jiseok Kwak , Minsang Park , Jiwoo Shin , SeJoon Jun , Gayoung Lee , Jin-Hwa Kim , Il-Chul Moon

Adversarial attacks, particularly \textbf{targeted} transfer-based attacks, can be used to assess the adversarial robustness of large visual-language models (VLMs), allowing for a more thorough examination of potential security flaws before…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qi Guo , Shanmin Pang , Xiaojun Jia , Yang Liu , Qing Guo

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Recently, the vulnerability of deep image classification models to adversarial attacks has been investigated. However, such an issue has not been thoroughly studied for image-to-image tasks that take an input image and generate an output…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Jun-Ho Choi , Huan Zhang , Jun-Hyuk Kim , Cho-Jui Hsieh , Jong-Seok Lee

Diffusion models excel in many generative modeling tasks, notably in creating images from text prompts, a task referred to as text-to-image (T2I) generation. Despite the ability to generate high-quality images, these models often replicate…

Multimedia · Computer Science 2024-02-20 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Haonan Wang , Kenji Kawaguchi

Despite the impressive capabilities of generating images, text-to-image diffusion models are susceptible to producing undesirable outputs such as NSFW content and copyrighted artworks. To address this issue, recent studies have focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Tianyun Yang , Juan Cao , Chang Xu

Diffusion models have demonstrated remarkable performance in image generation tasks, paving the way for powerful AIGC applications. However, these widely-used generative models can also raise security and privacy concerns, such as copyright…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhengyue Zhao , Jinhao Duan , Xing Hu , Kaidi Xu , Chenan Wang , Rui Zhang , Zidong Du , Qi Guo , Yunji Chen

We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Zhengbo Zhang , Li Xu , Duo Peng , Hossein Rahmani , Jun Liu

In text-to-image generation tasks, the advancements of diffusion models have facilitated the fidelity of generated results. However, these models encounter challenges when processing text prompts containing multiple entities and attributes.…

Computation and Language · Computer Science 2024-04-23 Yihang Wu , Xiao Cao , Kaixin Li , Zitan Chen , Haonan Wang , Lei Meng , Zhiyong Huang

Unrestricted adversarial attacks typically manipulate the semantic content of an image (e.g., color or texture) to create adversarial examples that are both effective and photorealistic, demonstrating their ability to deceive human…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhaoyu Chen , Bo Li , Shuang Wu , Kaixun Jiang , Shouhong Ding , Wenqiang Zhang

Deep learning-based image denoising models demonstrate remarkable performance, but their lack of robustness analysis remains a significant concern. A major issue is that these models are susceptible to adversarial attacks, where small,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Jie Ning , Jiebao Sun , Shengzhu Shi , Zhichang Guo , Yao Li , Hongwei Li , Boying Wu

Text-guided diffusion models (TDMs) are widely applied but can fail unexpectedly. Common failures include: (i) natural-looking text prompts generating images with the wrong content, or (ii) different random samples of the latent variables…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Qihao Liu , Adam Kortylewski , Yutong Bai , Song Bai , Alan Yuille

Adversarial attacks, particularly patch attacks, pose significant threats to the robustness and reliability of deep learning models. Developing reliable defenses against patch attacks is crucial for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Caixin Kang , Yinpeng Dong , Zhengyi Wang , Shouwei Ruan , Yubo Chen , Hang Su , Xingxing Wei

Recent advances in diffusion models have enabled high-quality synthesis of specific subjects, such as identities or objects. This capability, while unlocking new possibilities in content creation, also introduces significant privacy risks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tae-Young Lee , Juwon Seo , Jong Hwan Ko , Gyeong-Moon Park

Images produced by text-to-image diffusion models might not always faithfully represent the semantic intent of the provided text prompt, where the model might overlook or entirely fail to produce certain objects. Existing solutions often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Tuna Han Salih Meral , Enis Simsar , Federico Tombari , Pinar Yanardag

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pose challenges for non-experts to grasp. We introduce…

Human-Computer Interaction · Computer Science 2024-04-26 Seongmin Lee , Benjamin Hoover , Hendrik Strobelt , Zijie J. Wang , ShengYun Peng , Austin Wright , Kevin Li , Haekyu Park , Haoyang Yang , Polo Chau

Natural Adversarial Examples (NAEs), images arising naturally from the environment and capable of deceiving classifiers, are instrumental in robustly evaluating and identifying vulnerabilities in trained models. In this work, unlike prior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Yueqian Lin , Jingyang Zhang , Yiran Chen , Hai Li