中文
相关论文

相关论文: Understanding Implosion in Text-to-Image Generativ…

200 篇论文

Text-to-image diffusion models have been widely adopted in real-world applications due to their ability to generate realistic images from textual descriptions. However, recent studies have shown that these methods are vulnerable to backdoor…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Oscar Chew , Po-Yi Lu , Jayden Lin , Hsuan-Tien Lin

While text-to-image diffusion models can generate highquality images from textual descriptions, they generally lack fine-grained control over the visual composition of the generated images. Some recent works tackle this problem by training…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Denis Lukovnikov , Asja Fischer

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

Text-to-image diffusion models generate images by iteratively denoising random noise, conditioned on a prompt. While these models have enabled impressive progress in image generation, they often fail to accurately reflect all semantic…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Nicola Bernold , Moritz Vandenhirtz , Alice Bizeul , Julia E. Vogt

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Diffusion models (DMs) have achieved state-of-the-art performance on various generative tasks such as image synthesis, text-to-image, and text-guided image-to-image generation. However, the more powerful the DMs, the more harmful they…

密码学与安全 · 计算机科学 2024-08-08 Vu Tuan Truong , Luan Ba Dang , Long Bao Le

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

计算机视觉与模式识别 · 计算机科学 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

State-of-the-art Diffusion Models (DMs) produce highly realistic images. While prior work has successfully mitigated Not Safe For Work (NSFW) content in the visual domain, we identify a novel threat: the generation of NSFW text embedded…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Aditya Kumar , Tom Blanchard , Adam Dziedzic , Franziska Boenisch

Recent research has highlighted the risk of generative model collapse, where performance progressively degrades when continually trained on self-generated data. However, existing exploration on model collapse is limited to single, unimodal…

机器学习 · 计算机科学 2025-05-15 Zizhao Hu , Mohammad Rostami , Jesse Thomason

Diffusion models are a powerful class of generative models that produce images and other content from user prompts, but they are computationally intensive. To mitigate this cost, recent academic and industry work has adopted approximate…

密码学与安全 · 计算机科学 2026-05-26 Desen Sun , Shuncheng Jie , Sihang Liu

As machine learning models are increasingly deployed in safety-critical domains, visual explanation techniques have become essential tools for supporting transparency. In this work, we reveal a new class of attacks that compromise model…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Farhin Farhad Riya , Shahinul Hoque , Jinyuan Stella Sun , Olivera Kotevska

Recent advances in text-to-image diffusion models enable photorealistic image generation, but they also risk producing malicious content, such as NSFW images. To mitigate risk, concept erasure methods are studied to facilitate the model to…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Ruidong Chen , Honglin Guo , Lanjun Wang , Chenyu Zhang , Weizhi Nie , An-An Liu

Recent advances in text-to-image diffusion models have enabled the generation of diverse and high-quality images. While impressive, the images often fall short of depicting subtle details and are susceptible to errors due to ambiguity in…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Idan Schwartz , Vésteinn Snæbjarnarson , Hila Chefer , Ryan Cotterell , Serge Belongie , Lior Wolf , Sagie Benaim

Growing applications of large language models (LLMs) trained by a third party raise serious concerns on the security vulnerability of LLMs.It has been demonstrated that malicious actors can covertly exploit these vulnerabilities in LLMs…

密码学与安全 · 计算机科学 2023-12-11 Shuli Jiang , Swanand Ravindra Kadhe , Yi Zhou , Ling Cai , Nathalie Baracaldo

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

密码学与安全 · 计算机科学 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

机器学习 · 计算机科学 2025-04-15 Lucas Beerens , Desmond J. Higham

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

机器学习 · 计算机科学 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

Motivated by ethical and legal concerns, the scientific community is actively developing methods to limit the misuse of Text-to-Image diffusion models for reproducing copyrighted, violent, explicit, or personal information in the generated…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Vitali Petsiuk , Kate Saenko

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

密码学与安全 · 计算机科学 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Recent text-to-image diffusion models have shown surprising performance in generating high-quality images. However, concerns have arisen regarding the unauthorized data usage during the training or fine-tuning process. One example is when a…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Zhenting Wang , Chen Chen , Lingjuan Lyu , Dimitris N. Metaxas , Shiqing Ma