English
Related papers

Related papers: SafeRedir: Prompt Embedding Redirection for Robust…

200 papers

Recent advances in image generation models (IGMs), particularly diffusion-based architectures such as Stable Diffusion (SD), have markedly enhanced the quality and diversity of AI-generated visual content. However, their generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Renyang Liu , Guanlin Li , Tianwei Zhang , See-Kiong Ng

The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yimeng Zhang , Jinghan Jia , Xin Chen , Aochuan Chen , Yihua Zhang , Jiancheng Liu , Ke Ding , Sijia Liu

Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands --…

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

Training multimodal generative models on large, uncurated datasets can result in users being exposed to harmful, unsafe and controversial or culturally-inappropriate outputs. While model editing has been proposed to remove or filter…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jordan Vice , Naveed Akhtar , Mubarak Shah , Richard Hartley , Ajmal Mian

Recent progress in image generation models (IGMs) enables high-fidelity content creation but also amplifies risks, including the reproduction of copyrighted content and the generation of offensive content. Image Generation Model Unlearning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yong Zou , Haoran Li , Fanxiao Li , Shenyang Wei , Yunyun Dong , Li Tang , Wei Zhou , Renyang Liu

Recent advances in text-to-image generative models have raised concerns about their potential to produce harmful content when provided with malicious input text prompts. To address this issue, two main approaches have emerged: (1)…

Machine Learning · Computer Science 2025-11-13 Jiwoo Shin , Byeonghu Na , Mina Kang , Wonhyeok Choi , Il-Chul Moon

Recent Text-to-Image (T2I) models based on rectified-flow transformers (e.g., SD3, FLUX) achieve high generative fidelity but remain vulnerable to unsafe semantics, especially when triggered by multi-token interactions. Existing mitigation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Xiang Yang , Feifei Li , Mi Zhang , Geng Hong , Xiaoyu You , Min Yang

Visual Generative AI models have demonstrated remarkable capability in generating high-quality images from user inputs like text prompts. However, because these models have billions of parameters, they risk memorizing certain parts of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Lena Reissinger , Yuanyuan Li , Anna-Carolina Haensch , Neeraj Sarna

Text-to-image models have shown remarkable capabilities in generating high-quality images from natural language descriptions. However, these models are highly vulnerable to adversarial prompts, which can bypass safety measures and produce…

Cryptography and Security · Computer Science 2025-10-16 Peigui Qi , Kunsheng Tang , Wenbo Zhou , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Qing Guo , Jie Zhang

State-of-the-art generative models exhibit powerful image-generation capabilities, introducing various ethical and legal challenges to service providers hosting these models. Consequently, Content Removal Techniques (CRTs) have emerged as a…

Machine Learning · Computer Science 2025-04-03 Piyush Nagasubramaniam , Neeraj Karamchandani , Chen Wu , Sencun Zhu

In text-to-image (T2I) generation applications, negative embeddings have proven to be a simple yet effective approach for enhancing generation quality. Typically, these negative embeddings are derived from user-defined negative prompts,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaomin Li , Yixuan Liu , Takashi Isobe , Xu Jia , Qinpeng Cui , Dong Zhou , Dong Li , You He , Huchuan Lu , Zhongdao Wang , Emad Barsoum

Text-to-image (T2I) models have demonstrated remarkable generative capabilities but remain vulnerable to producing not-safe-for-work (NSFW) content, such as violent or explicit imagery. While recent moderation efforts have introduced soft…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zonglei Jing , Xiao Yang , Xiaoqian Li , Siyuan Liang , Aishan Liu , Mingchuan Zhang , Xianglong Liu

The remarkable ability of diffusion models to generate high-fidelity images has led to their widespread adoption. However, concerns have also arisen regarding their potential to produce Not Safe for Work (NSFW) content and exhibit social…

Computation and Language · Computer Science 2025-05-22 Zhiwen Li , Die Chen , Mingyuan Fan , Cen Chen , Yaliang Li , Yanhao Wang , Wenmeng Zhou

In recent years, text-to-image (T2I) generation models have made significant progress in generating high-quality images that align with text descriptions. However, these models also face the risk of unsafe generation, potentially producing…

Cryptography and Security · Computer Science 2025-04-16 Huming Qiu , Guanxu Chen , Mi Zhang , Xiaohan Zhang , Xiaoyu You , Min Yang

Effectively adapting powerful pretrained foundation models to diverse tasks remains a key challenge in AI deployment. Current approaches primarily follow two paradigms:discrete optimization of text prompts through prompt engineering, or…

Computation and Language · Computer Science 2025-08-06 Xiaoming Hou , Jiquan Zhang , Zibin Lin , DaCheng Tao , Shengli Zhang

As large language models (LLMs) are increasingly adopted in safety-critical and regulated sectors, the retention of sensitive or prohibited knowledge introduces escalating risks, ranging from privacy leakage to regulatory non-compliance to…

Machine Learning · Computer Science 2025-12-19 Taozhao Chen , Linghan Huang , Kim-Kwang Raymond Choo , Huaming Chen

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprietary features. While…

Machine Learning · Computer Science 2026-01-28 Divya Kothandaraman , Jaclyn Pytlarz

With the rapid progress of diffusion-based content generation, significant efforts are being made to unlearn harmful or copyrighted concepts from pretrained diffusion models (DMs) to prevent potential model misuse. However, it is observed…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hongcheng Gao , Tianyu Pang , Chao Du , Taihang Hu , Zhijie Deng , Min Lin

Video generative models achieve high-quality synthesis from natural-language prompts by leveraging large-scale web data. However, this training paradigm inherently exposes them to unsafe biases and harmful concepts, introducing the risk of…

‹ Prev 1 2 3 10 Next ›