中文
相关论文

相关论文: Efficient Input-level Backdoor Defense on Text-to-…

200 篇论文

Backdoor attacks on deep learning represent a recent threat that has gained significant attention in the research community. Backdoor defenses are mainly based on backdoor inversion, which has been shown to be generic, model-agnostic, and…

机器学习 · 计算机科学 2024-11-11 Xiaoyun Xu , Zhuoran Liu , Stefanos Koffas , Shujian Yu , Stjepan Picek

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption. However, this progress has inadvertently opened avenues for potential misuse, particularly in generating inappropriate or…

密码学与安全 · 计算机科学 2024-04-02 Yijun Yang , Ruiyuan Gao , Xiaosen Wang , Tsung-Yi Ho , Nan Xu , Qiang Xu

Backdoor attacks pose a serious security threat for training neural networks as they surreptitiously introduce hidden functionalities into a model. Such backdoors remain silent during inference on clean inputs, evading detection due to…

密码学与安全 · 计算机科学 2023-12-15 Lukas Struppek , Martin B. Hentschel , Clifton Poth , Dominik Hintersdorf , Kristian Kersting

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Recent advances in large-scale text-to-image (T2I) diffusion models have enabled a variety of downstream applications, including style customization, subject-driven personalization, and conditional generation. As T2I models require…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Zilan Wang , Junfeng Guo , Jiacheng Zhu , Yiming Li , Heng Huang , Muhao Chen , Zhengzhong Tu

Backdoor attacks targeting text-to-image diffusion models have advanced rapidly. However, current backdoor samples often exhibit two key abnormalities compared to benign samples: 1) Semantic Consistency, where backdoor prompts tend to…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Jie Zhang , Zhongqi Wang , Shiguang Shan , Xilin Chen

Text-to-image (T2I) models can generate not-safe-for-work (NSFW) content, motivating multi-stage safety pipelines with both text and image filters. Newer LLM-based filters detect latent intent beyond keywords, making token-level…

机器学习 · 计算机科学 2026-05-26 Zixuan Chen , Hao Lin , Ke Xu , Xinghao Jiang , Tanfeng Sun

The rise in popularity of text-to-image generative artificial intelligence (AI) has attracted widespread public interest. We demonstrate that this technology can be attacked to generate content that subtly manipulates its users. We propose…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Text-to-image (T2I) diffusion models have drawn attention for their ability to generate high-quality images with precise text alignment. However, these models can also be misused to produce inappropriate content. Existing safety measures,…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Hongxiang Zhang , Yifeng He , Hao Chen

Text-to-Image (T2I) models have gained widespread adoption across various applications. Despite the success, the potential misuse of T2I models poses significant risks of generating Not-Safe-For-Work (NSFW) content. To investigate the…

密码学与安全 · 计算机科学 2025-08-07 Xinqi Lyu , Yihao Liu , Yanjie Li , Bin Xiao

Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a self-attention mechanism that processes images as a sequence of…

计算机视觉与模式识别 · 计算机科学 2022-06-20 Akshayvarun Subramanya , Aniruddha Saha , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Visual generation grounded in Visual Foundation Model (VFM) representations offers a highly promising unified pathway for integrating visual understanding, perception, and generation. Despite this potential, training large-scale…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Minglei Shi , Haolin Wang , Borui Zhang , Wenzhao Zheng , Bohan Zeng , Ziyang Yuan , Xiaoshi Wu , Yuanxing Zhang , Huan Yang , Xintao Wang , Pengfei Wan , Kun Gai , Jie Zhou , Jiwen Lu

Text-to-image (T2I) models have significantly advanced in producing high-quality images. However, such models have the ability to generate images containing not-safe-for-work (NSFW) content, such as pornography, violence, political content,…

密码学与安全 · 计算机科学 2025-05-15 Longtian Wang , Xiaofei Xie , Tianlin Li , Yuhan Zhi , Chao Shen

Text-to-Image (T2I) models have recently achieved remarkable success in generating images from textual descriptions. However, challenges still persist in accurately rendering complex scenes where actions and interactions form the primary…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Vatsal Malaviya , Agneet Chatterjee , Maitreya Patel , Yezhou Yang , Chitta Baral

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

Using risky text prompts, such as pornography and violent prompts, to test the safety of text-to-image (T2I) models is a critical task. However, existing risky prompt datasets are limited in three key areas: 1) limited risky categories, 2)…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Tairen Zhang , Lanjun Wang , Ruidong Chen , Wenhui Li , Anan Liu

Recently, the strong latent Diffusion Probabilistic Model (DPM) has been applied to high-quality Text-to-Image (T2I) generation (e.g., Stable Diffusion), by injecting the encoded target text prompt into the gradually denoised diffusion…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Mingyang Yi , Aoxue Li , Yi Xin , Zhenguo Li

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

Text-to-image (T2I) diffusion models have achieved remarkable success in image synthesis, but their reliance on large-scale data and open ecosystems introduces serious backdoor security risks. Existing defenses, particularly input-level…

密码学与安全 · 计算机科学 2026-04-15 Zida Li , Jun Li , Yuzhe Sha , Ziqiang Li , Lizhi Xiong , Zhangjie Fu