中文
相关论文

相关论文: ProTIP: Probabilistic Robustness Verification on T…

200 篇论文

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

Text-to-image diffusion models have been widely adopted in real-world applications due to their ability to generate realistic images from textual descriptions. However, recent studies have shown that these methods are vulnerable to backdoor…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Oscar Chew , Po-Yi Lu , Jayden Lin , Hsuan-Tien Lin

Diffusion models (DMs) have demonstrated great potential in the field of adversarial robustness, where DM-based defense methods can achieve superior defense capability without adversarial training. However, they all require huge…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Hefei Mei , Minjing Dong , Chang Xu

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

This work addresses the challenge of quantifying originality in text-to-image (T2I) generative diffusion models, with a focus on copyright originality. We begin by evaluating T2I models' ability to innovate and generalize through controlled…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Adi Haviv , Shahar Sarfaty , Uri Hacohen , Niva Elkin-Koren , Roi Livni , Amit H Bermano

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Huanlei Guo , Hongxin Wei , Bingyi Jing

Existing text-to-image (T2I) benchmarks largely rely on fixed prompt sets, leaving them vulnerable to overfitting and benchmark contamination once publicly released and repeatedly reused. In this work, we propose DynT2I-Eval, a fully…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Juntong Wang , Jiarui Wang , Huiyu Duan , Lewei Li , Guangtao Zhai , Xiongkuo Min

Using risky text prompts, such as pornography and violent prompts, to test the safety of text-to-image (T2I) models is a critical task. However, existing risky prompt datasets are limited in three key areas: 1) limited risky categories, 2)…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Tairen Zhang , Lanjun Wang , Ruidong Chen , Wenhui Li , Anan Liu

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Text-to-image (T2I) diffusion models, when fine-tuned on a few personal images, can generate visuals with a high degree of consistency. However, such fine-tuned models are not robust; they often fail to compose with concepts of pretrained…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Kyungmin Lee , Sangkyung Kwak , Kihyuk Sohn , Jinwoo Shin

Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Binhong Tan , Zhaoxin Wang , Handing Wang

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

密码学与安全 · 计算机科学 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

密码学与安全 · 计算机科学 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Despite the integration of safety alignment and external filters, text-to-image (T2I) generative systems are still susceptible to producing harmful content, such as sexual or violent imagery. This raises serious concerns about unintended…

密码学与安全 · 计算机科学 2025-12-09 Boheng Li , Junjie Wang , Yiming Li , Zhiyang Hu , Leyi Qi , Jianshuo Dong , Run Wang , Han Qiu , Zhan Qin , Tianwei Zhang

Diffusion models excel in many generative modeling tasks, notably in creating images from text prompts, a task referred to as text-to-image (T2I) generation. Despite the ability to generate high-quality images, these models often replicate…

多媒体 · 计算机科学 2024-02-20 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Haonan Wang , Kenji Kawaguchi

Recent advances in text-to-image (T2I) models, especially diffusion-based architectures, have significantly improved the visual quality of generated images. However, these models continue to struggle with a critical limitation: maintaining…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Yifan Shen , Yangyang Shu , Hye-young Paik , Yulei Sui

Text-to-Image (T2I) generation is primarily driven by Diffusion Models (DM) which rely on random Gaussian noise. Thus, like playing the slots at a casino, a DM will produce different results given the same user-defined inputs. This imposes…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Joong Ho Kim , Nicholas Thai , Souhardya Saha Dip , Dong Lao , Keith G. Mills

Deep neural networks (DNNs) offer significant promise for improving breast cancer diagnosis in medical imaging. However, these models are highly susceptible to adversarial attacks--small, imperceptible changes that can mislead…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Yasamin Medghalchi , Moein Heidari , Clayton Allard , Leonid Sigal , Ilker Hacihaliloglu

Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Benlei Cui , Bukun Huang , Zhizeng Ye , Xuemei Dong , Tuo Chen , Hui Xue , Dingkang Yang , Longtao Huang , Jingqun Tang , Haiwen Hong

Test-time scaling (TTS) aims to achieve better results by increasing random sampling and evaluating samples based on rules and metrics. However, in text-to-image(T2I) diffusion models, most related works focus on search strategies and…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Hang Xu , Linjiang Huang , Feng Zhao