English
Related papers

Related papers: BSPA: Exploring Black-box Stealthy Prompt Attacks …

200 papers

Deep learning models for medical image classification tasks are becoming widely implemented in AI-assisted diagnostic tools, aiming to enhance diagnostic accuracy, reduce clinician workloads, and improve patient outcomes. However, their…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Due to the remarkable generative potential of diffusion-based models, numerous researches have investigated jailbreak attacks targeting these frameworks. A particularly concerning threat within image models is the generation of…

Cryptography and Security · Computer Science 2024-12-12 Xin Zhao , Xiaojun Chen , Haoyu Gao

The misuse of large language models (LLMs), such as academic plagiarism, has driven the development of detectors to identify LLM-generated texts. To bypass these detectors, paraphrase attacks have emerged to purposely rewrite these texts to…

Computation and Language · Computer Science 2025-09-11 Hao Fang , Jiawei Kong , Tianqu Zhuang , Yixiang Qiu , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Yaowei Wang , Min Zhang

Estimating the risk level of adversarial examples is essential for safely deploying machine learning models in the real world. One popular approach for physical-world attacks is to adopt the "sticker-pasting" strategy, which however suffers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Deep neural networks (DNNs) have been found to be vulnerable to adversarial examples. Adversarial examples are malicious images with visually imperceptible perturbations. While these carefully crafted perturbations restricted with tight…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Yajie Wang , Shangbo Wu , Wenyi Jiang , Shengang Hao , Yu-an Tan , Quanxin Zhang

Graph Prompt Learning (GPL) has been introduced as a promising approach that uses prompts to adapt pre-trained GNN models to specific downstream tasks without requiring fine-tuning of the entire model. Despite the advantages of GPL, little…

Machine Learning · Computer Science 2025-05-30 Minhua Lin , Zhiwei Zhang , Enyan Dai , Zongyu Wu , Yilong Wang , Xiang Zhang , Suhang Wang

With the great development of generative model techniques, face forgery detection draws more and more attention in the related field. Researchers find that existing face forgery models are still vulnerable to adversarial examples with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Decheng Liu , Qixuan Su , Chunlei Peng , Nannan Wang , Xinbo Gao

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

When a small number of poisoned samples are injected into the training dataset of a deep neural network, the network can be induced to exhibit malicious behavior during inferences, which poses potential threats to real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Haoheng Lan , Jindong Gu , Philip Torr , Hengshuang Zhao

Text-to-image models have shown remarkable capabilities in generating high-quality images from natural language descriptions. However, these models are highly vulnerable to adversarial prompts, which can bypass safety measures and produce…

Cryptography and Security · Computer Science 2025-10-16 Peigui Qi , Kunsheng Tang , Wenbo Zhou , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Qing Guo , Jie Zhang

The security of AI-generated content (AIGC) detection is crucial for ensuring multimedia content credibility. To enhance detector security, research on adversarial attacks has become essential. However, most existing adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Caiyun Xie , Dengpan Ye , Yunming Zhang , Long Tang , Yunna Lv , Jiacheng Deng , Jiawei Song

This work focuses on generating high-quality images with specific style of reference images and content of provided textual descriptions. Current leading algorithms, i.e., DreamBooth and LoRA, require fine-tuning for each style, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Zhouxia Wang , Xintao Wang , Liangbin Xie , Zhongang Qi , Ying Shan , Wenping Wang , Ping Luo

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Text-to-image models are vulnerable to the stepwise "Divide-and-Conquer Attack" (DACA) that utilize a large language model to obfuscate inappropriate content in prompts by wrapping sensitive text in a benign narrative. To mitigate stepwise…

Cryptography and Security · Computer Science 2024-12-18 Portia Cooper , Harshita Narnoli , Mihai Surdeanu

Despite excellent average-case performance of many image classifiers, their performance can substantially deteriorate on semantically coherent subgroups of the data that were under-represented in the training data. These systematic errors…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jan Hendrik Metzen , Robin Hutmacher , N. Grace Hua , Valentyn Boreiko , Dan Zhang

Large Language Models (LLMs) have become integral to automated code analysis, enabling tasks such as vulnerability detection and code comprehension. However, their integration introduces novel attack surfaces. In this paper, we identify and…

Cryptography and Security · Computer Science 2025-07-23 Yue Li , Xiao Li , Hao Wu , Yue Zhang , Fengyuan Xu , Xiuzhen Cheng , Sheng Zhong

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

Computation and Language · Computer Science 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

As Generative AI continues to become more accessible, the case for robust detection of generated images in order to combat misinformation is stronger than ever. Invisible watermarking methods act as identifiers of generated content,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Dongjun Hwang , Sungwon Woo , Tom Gao , Raymond Luo , Sunghwan Baek