English
Related papers

Related papers: Lazy Layers to Make Fine-Tuned Diffusion Models Mo…

200 papers

Watermarking images is critical for tracking image provenance and proving ownership. With the advent of generative models, such as stable diffusion, that can create fake but realistic images, watermarking has become particularly important…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Lijun Zhang , Xiao Liu , Antoni Viros Martin , Cindy Xiong Bearfield , Yuriy Brun , Hui Guan

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

Computation and Language · Computer Science 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

Deep neural networks are vulnerable to malicious fine-tuning attacks such as data poisoning and backdoor attacks. Therefore, in recent research, it is proposed how to detect malicious fine-tuning of neural network models. However, it…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhaoxia Yin , Heng Yin , Xinpeng Zhang

Diffusion models are vulnerable to backdoor attacks, where malicious attackers inject backdoors by poisoning certain training samples during the training stage. This poses a significant threat to real-world applications in the…

Cryptography and Security · Computer Science 2025-02-05 Zihan Guan , Mengxuan Hu , Sheng Li , Anil Vullikanti

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Diffusion models have gained prominence in the image domain for their capabilities in data generation and transformation, achieving state-of-the-art performance in various tasks in both image and audio domains. In the rapidly evolving field…

Sound · Computer Science 2023-11-02 Xirong Cao , Xiang Li , Divyesh Jadav , Yanzhao Wu , Zhehui Chen , Chen Zeng , Wenqi Wei

Deep neural networks have significantly improved the performance of face forgery detection models in discriminating Artificial Intelligent Generated Content (AIGC). However, their security is significantly threatened by the injection of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xiaoxuan Han , Songlin Yang , Wei Wang , Ziwen He , Jing Dong

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Recent studies have revealed that text-to-image diffusion models are vulnerable to backdoor attacks, where attackers implant stealthy textual triggers to manipulate model outputs. Previous backdoor detection methods primarily focus on the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

The rapid adoption of diffusion-based generative models has intensified concerns over the attribution and integrity of AI-generated content (AIGC). Existing single-domain watermarking methods either fail under regeneration, remain…

Cryptography and Security · Computer Science 2026-04-22 JinFeng Xie , Chengfu Ou , Peipeng Yu , Xiaoyu Zhou , Dingding Huang , Jianwei Fei , Zixuan Shen , Zhihua Xia

Backdoor attacks become a significant security concern for deep neural networks in recent years. An image classification model can be compromised if malicious backdoors are injected into it. This corruption will cause the model to function…

Cryptography and Security · Computer Science 2024-03-13 Hongwei Zhang , Xiaoyin Xu , Dongsheng An , Xianfeng Gu , Min Zhang

Typical deep neural network (DNN) backdoor attacks are based on triggers embedded in inputs. Existing imperceptible triggers are computationally expensive or low in attack success. In this paper, we propose a new backdoor trigger, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Yulong Wang , Minghui Zhao , Shenghong Li , Xin Yuan , Wei Ni

In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and…

Cryptography and Security · Computer Science 2024-02-06 Yang Sui , Huy Phan , Jinqi Xiao , Tianfang Zhang , Zijie Tang , Cong Shi , Yan Wang , Yingying Chen , Bo Yuan

AI systems are rapidly advancing in capability, and frontier model developers broadly acknowledge the need for safeguards against serious misuse. However, this paper demonstrates that fine-tuning, whether via open weights or closed…

Cryptography and Security · Computer Science 2025-09-23 Brendan Murphy , Dillon Bowen , Shahrad Mohammadzadeh , Tom Tseng , Julius Broomfield , Adam Gleave , Kellin Pelrine

Diffusion models (DM) have become state-of-the-art generative models because of their capability to generate high-quality images from noises without adversarial training. However, they are vulnerable to backdoor attacks as reported by…

Cryptography and Security · Computer Science 2024-02-06 Shengwei An , Sheng-Yen Chou , Kaiyuan Zhang , Qiuling Xu , Guanhong Tao , Guangyu Shen , Siyuan Cheng , Shiqing Ma , Pin-Yu Chen , Tsung-Yi Ho , Xiangyu Zhang

Deep learning-based lane detection (LD) plays a critical role in autonomous driving and advanced driver assistance systems. However, its vulnerability to backdoor attacks presents a significant security concern. Existing backdoor attack…

Cryptography and Security · Computer Science 2026-03-26 Yifan Liao , Yuxin Cao , Yedi Zhang , Wentao He , Yan Xiao , Xianglong Du , Zhiyong Huang , Jin Song Dong

The growing accessibility of diffusion models has revolutionized image editing but also raised significant concerns about unauthorized modifications, such as misinformation and plagiarism. Existing countermeasures largely rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Yaopei Zeng , Yuanpu Cao , Lu Lin

As the quality of image generators continues to improve, deepfakes become a topic of considerable societal debate. Image watermarking allows responsible model owners to detect and label their AI-generated content, which can mitigate the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Kasra Arabi , Benjamin Feuer , R. Teal Witter , Chinmay Hegde , Niv Cohen

Autoregressive (AR) image generation models have gained increasing attention for their breakthroughs in synthesis quality, highlighting the need for robust watermarking to prevent misuse. However, existing in-generation watermarking…

Cryptography and Security · Computer Science 2025-06-03 Siqi Hui , Yiren Song , Sanping Zhou , Ye Deng , Wenli Huang , Jinjun Wang