中文
相关论文

相关论文: Discovering Failure Modes of Text-guided Diffusion…

200 篇论文

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

密码学与安全 · 计算机科学 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Models (DDPM) deliver…

机器学习 · 计算机科学 2023-10-12 Yanwu Xu , Mingming Gong , Shaoan Xie , Wei Wei , Matthias Grundmann , Kayhan Batmanghelich , Tingbo Hou

Despite the record-breaking performance in Text-to-Image (T2I) generation by Stable Diffusion, less research attention is paid to its adversarial robustness. In this work, we study the problem of adversarial attack generation for Stable…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Haomin Zhuang , Yihua Zhang , Sijia Liu

With recent text-to-image models, anyone can generate deceptively realistic images with arbitrary contents, fueling the growing threat of visual disinformation. A key enabler for generating high-resolution images with low computational cost…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jonas Ricker , Denis Lukovnikov , Asja Fischer

Diffusion-based text-to-image (T2I) models enable high-quality image generation but also pose significant risks of misuse, particularly in producing not-safe-for-work (NSFW) content. While prior detection methods have focused on filtering…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Fan Yang , Yihao Huang , Jiayi Zhu , Ling Shi , Geguang Pu , Jin Song Dong , Kailong Wang

Existing unsupervised methods have addressed the challenges of inconsistent paired data and tedious acquisition of ground-truth labels in shadow removal tasks. However, GAN-based training often faces issues such as mode collapse and…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Ziqi Zeng , Chen Zhao , Weiling Cai , Chenyu Dong

Text-to-image generation has witnessed significant progress with the advent of diffusion models. Despite the ability to generate photorealistic images, current text-to-image diffusion models still often struggle to accurately interpret and…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Tsung-Han Wu , Long Lian , Joseph E. Gonzalez , Boyi Li , Trevor Darrell

We introduce a novel, training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs). Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shulei Wang , Wang Lin , Hai Huang , Hanting Wang , Sihang Cai , WenKang Han , Tao Jin , Jingyuan Chen , Jiacheng Sun , Jieming Zhu , Zhou Zhao

Text-to-image diffusion models have recently received a lot of interest for their astonishing ability to produce high-fidelity images from text only. However, achieving one-shot generation that aligns with the user's intent is nearly…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Manuel Brack , Felix Friedrich , Dominik Hintersdorf , Lukas Struppek , Patrick Schramowski , Kristian Kersting

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Recent advances in deep learning have inspired numerous works on data-driven solutions to partial differential equation (PDE) problems. These neural PDE solvers can often be much faster than their numerical counterparts; however, each…

机器学习 · 计算机科学 2025-02-06 Anthony Zhou , Zijie Li , Michael Schneier , John R Buchanan , Amir Barati Farimani

Text-to-image (T2I) diffusion models have the ability to build high-quality pictures from text prompts, but they pose safety concerns because they can generate offensive or disturbing imagery when provided with harmful inputs. Existing…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Chi Zhang , Changjia Zhu , Xiaowen Li , Yao Liu , Zhuo Lu

Traditional adversarial attacks concentrate on manipulating clean examples in the pixel space by adding adversarial perturbations. By contrast, semantic adversarial attacks focus on changing semantic attributes of clean examples, such as…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Chenan Wang , Jinhao Duan , Chaowei Xiao , Edward Kim , Matthew Stamm , Kaidi Xu

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

计算与语言 · 计算机科学 2025-01-07 Jun-Min Lee , Tae-Bin Ha

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

图像与视频处理 · 电气工程与系统科学 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands…

计算与语言 · 计算机科学 2024-04-02 Tong Niu , Weihao Zhang , Rong Zhao

Recently, text-to-image models have been thriving. Despite their powerful generative capacity, our research has uncovered a lack of robustness in this generation process. Specifically, the introduction of small perturbations to the text…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Chengbin Du , Yanxi Li , Zhongwei Qiu , Chang Xu

Diffusion-based models have gained significant popularity for text-to-image generation due to their exceptional image-generation capabilities. A risk with these models is the potential generation of inappropriate content, such as biased or…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Hang Li , Chengzhi Shen , Philip Torr , Volker Tresp , Jindong Gu

Generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) are widely utilized to model the generative process of user interactions. However, these generative models suffer from intrinsic…

信息检索 · 计算机科学 2025-06-26 Wenjie Wang , Yiyan Xu , Fuli Feng , Xinyu Lin , Xiangnan He , Tat-Seng Chua

In recent years, diffusion models (DMs) have drawn significant attention for their success in approximating data distributions, yielding state-of-the-art generative results. Nevertheless, the versatility of these models extends beyond their…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Peter Lorenz , Ricard Durall , Janis Keuper