English
Related papers

Related papers: An indicator for effectiveness of text-to-image gu…

200 papers

Emerging self-supervised learning (SSL) has become a popular image representation encoding method to obviate the reliance on labeled data and learn rich representations from large-scale, ubiquitous unlabelled data. Then one can train a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jiaqi Xue , Qian Lou

With the rapid advancement and widespread application of vision-language pre-training (VLP) models, their vulnerability to adversarial attacks has become a critical concern. In general, the adversarial examples can typically be designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuanbo Li , Tianyang Xu , Cong Hu , Tao Zhou , Xiao-Jun Wu , Josef Kittler

Text-to-image (T2I) models can be maliciously used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. Previous attacks largely depend on the availability of the diffusion…

Cryptography and Security · Computer Science 2025-05-27 Jiachen Ma , Yijiang Li , Zhiqing Xiao , Anda Cao , Jie Zhang , Chao Ye , Junbo Zhao

Utilizing large-scale pretrained models is a well-known strategy to enhance performance on various target tasks. It is typically achieved through fine-tuning pretrained models on target tasks. However, na\"{\i}ve fine-tuning may not fully…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Seungwon Seo , Suho Lee , Sangheum Hwang

As AI agents move from chat interfaces to systems that read private data, call tools, and execute multi-step workflows, guardrails become a last line of defense against concrete deployment harms. In these settings, guardrail failures are no…

The rise of text-to-video generation models has raised growing concerns over content authenticity, copyright protection, and malicious misuse. Watermarking serves as an effective mechanism for regulating such AI-generated content, where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yang Yang , Xinze Zou , Zehua Ma , Han Fang , Weiming Zhang

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Text-to-image diffusion models are increasingly vulnerable to backdoor attacks, where malicious modifications to the training data cause the model to generate unintended outputs when specific triggers are present. While classification…

Cryptography and Security · Computer Science 2025-04-29 Abha Jha , Ashwath Vaithinathan Aravindan , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

Text-to-image diffusion models, such as Stable Diffusion, have shown exceptional potential in generating high-quality images. However, recent studies highlight concerns over the use of unauthorized data in training these models, which may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Soumil Datta , Shih-Chieh Dai , Leo Yu , Guanhong Tao

Text-to-image (T2I) diffusion models have achieved remarkable success in image synthesis, but their reliance on large-scale data and open ecosystems introduces serious backdoor security risks. Existing defenses, particularly input-level…

Cryptography and Security · Computer Science 2026-04-15 Zida Li , Jun Li , Yuzhe Sha , Ziqiang Li , Lizhi Xiong , Zhangjie Fu

Text-to-image diffusion models can emit copyrighted, unsafe, or private content. Safety alignment aims to suppress specific concepts, yet evaluations seldom test whether safety persists under benign downstream fine-tuning routinely applied…

Cryptography and Security · Computer Science 2025-11-26 Mohammed Talha Alam , Nada Saadi , Fahad Shamshad , Nils Lukas , Karthik Nandakumar , Fahkri Karray , Samuele Poppi

With the successful creation of high-quality image-to-image (Img2Img) translation GANs comes the non-ethical applications of DeepFake and DeepNude. Such misuses of img2img techniques present a challenging problem for society. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Chin-Yuan Yeh , Hsi-Wen Chen , Hong-Han Shuai , De-Nian Yang , Ming-Syan Chen

Text-to-Image (T2I) models have gained widespread adoption across various applications. Despite the success, the potential misuse of T2I models poses significant risks of generating Not-Safe-For-Work (NSFW) content. To investigate the…

Cryptography and Security · Computer Science 2025-08-07 Xinqi Lyu , Yihao Liu , Yanjie Li , Bin Xiao

Text-to-image diffusion models have recently become highly capable, yet their behavior in multi-object scenes remains unreliable: models often produce an incorrect number of instances and exhibit semantics leaking across objects. We trace…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Sanghyun Jo , Wooyeol Lee , Ziseok Lee , Kyungsu Kim

As large language models transition from bounded generative engines to agents with expansive execution privileges, AI going out of control precipitates a fundamental crisis in artificial intelligence security. Existing defense architectures…

Artificial Intelligence · Computer Science 2026-05-29 Benlong Wu , Weiming Zhang , Kejiang Chen , Han Fang , Nenghai Yu

With advances in diffusion models, image generation has shown significant performance improvements. This raises concerns about the potential abuse of image generation, such as the creation of explicit or violent images, commonly referred to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Junha Park , Jaehui Hwang , Ian Ryu , Hyungkeun Park , Jiyoon Kim , Jong-Seok Lee

Recent advances in large text-conditional diffusion models have revolutionized image generation by enabling users to create realistic, high-quality images from textual prompts, significantly enhancing artistic creation and visual…

Machine Learning · Computer Science 2025-07-08 Ali Naseh , Jaechul Roh , Eugene Bagdasarian , Amir Houmansadr

Most graph-to-text works are built on the encoder-decoder framework with cross-attention mechanism. Recent studies have shown that explicitly modeling the input graph structure can significantly improve the performance. However, the vanilla…

Computation and Language · Computer Science 2022-09-16 Liang Li , Ruiying Geng , Bowen Li , Can Ma , Yinliang Yue , Binhua Li , Yongbin Li

In the context of widespread global information sharing, information security and privacy protection have become focal points. Steganographic systems enhance information security by embedding confidential information into public carriers;…

Cryptography and Security · Computer Science 2024-10-29 Zezheng Qin , Congcong Sun , Taiyi He , Yuke He , Azizol Abdullah , Normalia Samian , Nuur Alifah Roslan

Despite the notable advancements and versatility of multi-modal diffusion models, such as text-to-image models, their susceptibility to adversarial inputs remains underexplored. Contrary to expectations, our investigations reveal that the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Xiaosen Wang , Zhijin Ge , Shaokang Wang