English
Related papers

Related papers: BSPA: Exploring Black-box Stealthy Prompt Attacks …

200 papers

Recent advancements in diffusion models have enabled high-fidelity and photorealistic image generation across diverse applications. However, these models also present security and privacy risks, including copyright violations, sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jiacheng Shi , Yanfu Zhang , Huajie Shao , Ashley Gao

Text-to-image (T2I) models have raised increasing safety concerns due to their capacity to generate NSFW and other banned objects. To mitigate these risks, safety filters and concept removal techniques have been introduced to block…

Cryptography and Security · Computer Science 2026-01-13 Xi Ye , Yiwen Liu , Lina Wang , Run Wang , Geying Yang , Yufei Hou , Jiayi Yu

The rise of deep learning models in the digital era has raised substantial concerns regarding the generation of Not-Safe-for-Work (NSFW) content. Existing defense methods primarily involve model fine-tuning and post-hoc content moderation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xin Zhao , Xiaojun Chen , Yuexin Xuan , Zhendong Zhao , Xiaojun Jia , Xinfeng Li , Xiaofeng Wang

The rapid evolution of generative models has precipitated a proliferation of fabricated content, posing significant challenges to existing Synthetic Image Detection (SID) methods. Capitalizing on advancements in vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Senyuan Shi , Hao Tan , Zichang Tan , Shuhan Feng , Ajian Liu , Sergio Escalera , Jun Wan

Large Language Models (LLMs) are increasingly equipped with capabilities of real-time web search and integrated with protocols like Model Context Protocol (MCP). This extension could introduce new security vulnerabilities. We present a…

Cryptography and Security · Computer Science 2025-05-23 Junjie Xiong , Changjia Zhu , Shuhang Lin , Chong Zhang , Yongfeng Zhang , Yao Liu , Lingyao Li

Text-to-image generative models are widely deployed in creative tools and online platforms. To mitigate misuse, these systems rely on safety filters and moderation pipelines that aim to block harmful or policy violating content. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ahmed B Mustafa , Zihan Ye , Yang Lu , Michael P Pound , Shreyank N Gowda

The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yimeng Zhang , Jinghan Jia , Xin Chen , Aochuan Chen , Yihua Zhang , Jiancheng Liu , Ke Ding , Sijia Liu

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

Computation and Language · Computer Science 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

With advances in diffusion models, image generation has shown significant performance improvements. This raises concerns about the potential abuse of image generation, such as the creation of explicit or violent images, commonly referred to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Junha Park , Jaehui Hwang , Ian Ryu , Hyungkeun Park , Jiyoon Kim , Jong-Seok Lee

The vulnerabilities to backdoor attacks have recently threatened the trustworthiness of machine learning models in practical applications. Conventional wisdom suggests that not everyone can be an attacker since the process of designing the…

Cryptography and Security · Computer Science 2023-09-06 Sze Jue Yang , Quang Nguyen , Chee Seng Chan , Khoa D. Doan

The rapid adoption of large language models (LLMs) in critical domains has spurred extensive research into their security issues. While input manipulation attacks (e.g., prompt injection) have been well studied, Bit-Flip Attacks (BFAs) --…

Cryptography and Security · Computer Science 2025-09-24 Haotian Xu , Qingsong Peng , Jie Shi , Huadi Zheng , Yu Li , Cheng Zhuo

Diffusion models are a powerful class of generative models that produce images and other content from user prompts, but they are computationally intensive. To mitigate this cost, recent academic and industry work has adopted approximate…

Cryptography and Security · Computer Science 2026-05-26 Desen Sun , Shuncheng Jie , Sihang Liu

Recent studies demonstrate that Large Language Models (LLMs) are vulnerable to different prompt-based attacks, generating harmful content or sensitive information. Both closed-source and open-source LLMs are underinvestigated for these…

Cryptography and Security · Computer Science 2025-05-21 Jiawen Wang , Pritha Gupta , Ivan Habernal , Eyke Hüllermeier

With social media growth, users employ stylistic fonts and font-like emoji to express individuality, creating visually appealing text that remains human-readable. However, these fonts introduce hidden vulnerabilities in NLP models: while…

Computation and Language · Computer Science 2025-10-23 Yangshijie Zhang , Xinda Wang , Jialin Liu , Wenqiang Wang , Zhicong Ma , Xingxing Jia

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

Cryptography and Security · Computer Science 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

Deep neural networks (DNNs) offer significant promise for improving breast cancer diagnosis in medical imaging. However, these models are highly susceptible to adversarial attacks--small, imperceptible changes that can mislead…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yasamin Medghalchi , Moein Heidari , Clayton Allard , Leonid Sigal , Ilker Hacihaliloglu

Previous insertion-based and paraphrase-based backdoors have achieved great success in attack efficacy, but they ignore the text quality and semantic consistency between poisoned and clean texts. Although recent studies introduce LLMs to…

Computation and Language · Computer Science 2025-04-22 Zhengxian Wu , Juan Wen , Wanli Peng , Ziwei Zhang , Yinghan Zhou , Yiming Xue

Textual backdoor attacks pose a practical threat to existing systems, as they can compromise the model by inserting imperceptible triggers into inputs and manipulating labels in the training dataset. With cutting-edge generative models such…

Cryptography and Security · Computer Science 2023-05-01 Jiazhao Li , Yijin Yang , Zhuofeng Wu , V. G. Vinod Vydiswaran , Chaowei Xiao

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei