English
Related papers

Related papers: Antelope: Potent and Concealed Jailbreak Attack St…

200 papers

Deepfake technology, driven by Generative Adversarial Networks (GANs), poses significant risks to privacy and societal security. Existing detection methods are predominantly passive, focusing on post-event analysis without preventing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mengxiao Huang , Minglei Shu , Shuwang Zhou , Zhaoyang Liu

Recent advances in diffusion models have significantly enhanced the quality of image synthesis, yet they have also introduced serious safety concerns, particularly the generation of Not Safe for Work (NSFW) content. Previous research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yaopei Zeng , Yuanpu Cao , Bochuan Cao , Yurui Chang , Jinghui Chen , Lu Lin

With advances in diffusion models, image generation has shown significant performance improvements. This raises concerns about the potential abuse of image generation, such as the creation of explicit or violent images, commonly referred to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Junha Park , Jaehui Hwang , Ian Ryu , Hyungkeun Park , Jiyoon Kim , Jong-Seok Lee

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu

Generative AI deployment poses unprecedented challenges to content safety and privacy. However, existing defense mechanisms are often tailored to specific architectures (e.g., Diffusion Models or GANs), creating fragile "defense silos" that…

Cryptography and Security · Computer Science 2026-03-17 Bingxue Zhang , Yang Gao , Feida Zhu , Yanyan Shen , Yang Shi

Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image generation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Decheng Liu , Xijun Wang , Chunlei Peng , Nannan Wang , Ruiming Hu , Xinbo Gao

Due to their powerful image generation capabilities, diffusion-based adversarial example generation methods through image editing are rapidly gaining popularity. However, due to reliance on the discriminative capability of the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Gaozheng Pei , Ke Ma , Dongpeng Zhang , Chengzhi Sun , Qianqian Xu , Qingming Huang

Text-to-image generative models are widely deployed in creative tools and online platforms. To mitigate misuse, these systems rely on safety filters and moderation pipelines that aim to block harmful or policy violating content. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ahmed B Mustafa , Zihan Ye , Yang Lu , Michael P Pound , Shreyank N Gowda

The outstanding capability of diffusion models in generating high-quality images poses significant threats when misused by adversaries. In particular, we assume malicious adversaries exploiting diffusion models for inpainting tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Joonsung Jeon , Woo Jae Kim , Suhyeon Ha , Sooel Son , Sung-eui Yoon

As machine learning models become increasingly deployed across the edge of internet of things environments, a partitioned deep learning paradigm in which models are split across multiple computational nodes introduces a new dimension of…

Machine Learning · Computer Science 2025-07-11 Giulio Rossolini , Fabio Brau , Alessandro Biondi , Battista Biggio , Giorgio Buttazzo

Researches have shown that deep neural networks are vulnerable to malicious attacks, where adversarial images are created to trick a network into misclassification even if the images may give rise to totally different labels by human eyes.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Yuzhen Ding , Nupur Thakur , Baoxin Li

The growing accessibility of diffusion models has revolutionized image editing but also raised significant concerns about unauthorized modifications, such as misinformation and plagiarism. Existing countermeasures largely rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Yaopei Zeng , Yuanpu Cao , Lu Lin

With the rapid development of deep learning, object detectors have demonstrated impressive performance; however, vulnerabilities still exist in certain scenarios. Current research exploring the vulnerabilities using adversarial patches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Boming Miao , Chunxiao Li , Yao Zhu , Weixiang Sun , Zizhe Wang , Xiaoyi Wang , Chuanlong Xie

Text-to-image diffusion models have gained widespread application across various domains, demonstrating remarkable creative potential. However, the strong generalization capabilities of diffusion models can inadvertently lead to the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Die Chen , Zhiwen Li , Cen Chen , Yuexiang Xie , Xiaodan Li , Jinyan Ye , Yingda Chen , Yaliang Li

State-of-the-art Diffusion Models (DMs) produce highly realistic images. While prior work has successfully mitigated Not Safe For Work (NSFW) content in the visual domain, we identify a novel threat: the generation of NSFW text embedded…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Aditya Kumar , Tom Blanchard , Adam Dziedzic , Franziska Boenisch

With the rapid proliferation of Natural Language Processing (NLP), especially Large Language Models (LLMs), generating adversarial examples to jailbreak LLMs remains a key challenge for understanding model vulnerabilities and improving…

Computation and Language · Computer Science 2025-08-15 Huizhen Shu , Xuying Li , Qirui Wang , Yuji Kosuga , Mengqiu Tian , Zhuo Li

In this paper, we propose a novel generative model-based attack on learnable image encryption methods proposed for privacy-preserving deep learning. Various learnable encryption methods have been studied to protect the sensitive visual…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 AprilPyone MaungMaung , Hitoshi Kiya

Diffusion models have revolutionized generative modeling with their exceptional ability to produce high-fidelity images. However, misuse of such potent tools can lead to the creation of fake news or disturbing content targeting individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yiren Song , Shengtao Lou , Xiaokang Liu , Hai Ci , Pei Yang , Jiaming Liu , Mike Zheng Shou

Despite the intrinsic risk-awareness of Large Language Models (LLMs), current defenses often result in shallow safety alignment, rendering models vulnerable to disguised attacks (e.g., prefilling) while degrading utility. To bridge this…

Cryptography and Security · Computer Science 2026-01-26 Xianya Fang , Xianying Luo , Yadong Wang , Xiang Chen , Yu Tian , Zequn Sun , Rui Liu , Jun Fang , Naiqiang Tan , Yuanning Cui , Sheng-Jun Huang

The success of diffusion models has enabled effortless, high-quality image modifications that precisely align with users' intentions, thereby raising concerns about their potential misuse by malicious actors. Previous studies have attempted…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Hohyun Na , Seunghoo Hong , Simon S. Woo