English
Related papers

Related papers: Attacks on Approximate Caches in Text-to-Image Dif…

200 papers

Large Language Models (LLMs) remain vulnerable to prompt injection attacks, representing the most significant security threat in production deployments. We present Prompt Fencing, a novel architectural approach that applies cryptographic…

Cryptography and Security · Computer Science 2025-11-26 Steven Peh

Recent studies show that text to image (T2I) diffusion models are vulnerable to backdoor attacks, where a trigger in the input prompt can steer generation toward harmful or unintended content. Beyond the trigger token itself, backdoor…

Computation and Language · Computer Science 2026-03-19 Oscar Chew , Po-Yi Lu , Jayden Lin , Kuan-Hao Huang , Hsuan-Tien Lin

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Text-to-image diffusion models can create stunning images from natural language descriptions that rival the work of professional artists and photographers. However, these models are large, with complex network architectures and tens of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yanyu Li , Huan Wang , Qing Jin , Ju Hu , Pavlo Chemerys , Yun Fu , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Diffusion models are vulnerable to backdoor attacks, where malicious attackers inject backdoors by poisoning certain training samples during the training stage. This poses a significant threat to real-world applications in the…

Cryptography and Security · Computer Science 2025-02-05 Zihan Guan , Mengxuan Hu , Sheng Li , Anil Vullikanti

Diffusion Models (DMs) have achieved remarkable success in image generation, yet recent studies reveal their vulnerability to backdoor attacks, where adversaries manipulate outputs via covert triggers embedded in inputs. Existing defenses,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Lei Zhang , Yu Pan , Bingrong Dai , Lin Wang

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. Recent research has extended these models to support text-guided image editing. While text guidance is an intuitive editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jooyoung Choi , Yunjey Choi , Yunji Kim , Junho Kim , Sungroh Yoon

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

In a model extraction attack, an adversary steals a copy of a remotely deployed machine learning model, given oracle prediction access. We taxonomize model extraction attacks around two objectives: *accuracy*, i.e., performing well on the…

Machine Learning · Computer Science 2020-03-05 Matthew Jagielski , Nicholas Carlini , David Berthelot , Alex Kurakin , Nicolas Papernot

Object detection is fundamental to various real-world applications, such as security monitoring and surveillance video analysis. Despite their advancements, state-of-the-art object detectors are still vulnerable to adversarial patch…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jin Ma , Mohammed Aldeen , Christopher Salas , Feng Luo , Mashrur Chowdhury , Mert Pesé , Long Cheng

It has been shown that Large Language Model (LLM) alignments can be circumvented by appending specially crafted attack suffixes with harmful queries to elicit harmful responses. To conduct attacks against private target models whose…

Traditional ML models utilize controlled approximations during high loads, employing faster, but less accurate models in a process called accuracy scaling. However, this method is less effective for generative text-to-image models due to…

Machine Learning · Computer Science 2025-02-12 Shubham Agarwal , Saud Iqbal , Subrata Mitra

Text-conditioned image generation has made significant progress in recent years with generative adversarial networks and more recently, diffusion models. While diffusion models conditioned on text prompts have produced impressive and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Azade Farshad , Yousef Yeganeh , Yu Chi , Chengzhi Shen , Björn Ommer , Nassir Navab

Diffusion models (DMs) embark a new era of generative modeling and offer more opportunities for efficient generating high-quality and realistic data samples. However, their widespread use has also brought forth new challenges in model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jingyao Xu , Yuetong Lu , Yandong Li , Siyang Lu , Dongdong Wang , Xiang Wei

Graph generative diffusion models have recently emerged as a powerful paradigm for generating complex graph structures, effectively capturing intricate dependencies and relationships within graph data. However, the privacy risks associated…

Machine Learning · Computer Science 2026-01-08 Xiuling Wang , Xin Huang , Guibo Luo , Jianliang Xu

The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in…

Cryptography and Security · Computer Science 2024-02-21 Zeyang Sha , Yang Zhang

Text-to-image generative models are widely deployed in creative tools and online platforms. To mitigate misuse, these systems rely on safety filters and moderation pipelines that aim to block harmful or policy violating content. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ahmed B Mustafa , Zihan Ye , Yang Lu , Michael P Pound , Shreyank N Gowda

Large-scale text-to-image (T2I) diffusion models have revolutionized image generation, enabling the synthesis of highly detailed visuals from textual descriptions. However, these models may inadvertently generate inappropriate content, such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Huiqiang Chen , Tianqing Zhu , Linlin Wang , Xin Yu , Longxiang Gao , Wanlei Zhou

Covert channels can be utilized to secretly deliver information from high privileged processes to low privileged processes in the context of a high-assurance computing system. In this case study, we investigate the possibility of covert…

Cryptography and Security · Computer Science 2015-08-24 Wolfgang Schmidt , Michael Hanspach , Jörg Keller

Diffusion models have recently revolutionized the field of image synthesis due to their ability to generate photorealistic images. However, one of the major drawbacks of diffusion models is that the image generation process is costly. A…