English

Evading Watermark based Detection of AI-Generated Content

Machine Learning 2023-11-09 v5 Cryptography and Security Computer Vision and Pattern Recognition

Abstract

A generative AI model can generate extremely realistic-looking content, posing growing challenges to the authenticity of information. To address the challenges, watermark has been leveraged to detect AI-generated content. Specifically, a watermark is embedded into an AI-generated content before it is released. A content is detected as AI-generated if a similar watermark can be decoded from it. In this work, we perform a systematic study on the robustness of such watermark-based AI-generated content detection. We focus on AI-generated images. Our work shows that an attacker can post-process a watermarked image via adding a small, human-imperceptible perturbation to it, such that the post-processed image evades detection while maintaining its visual quality. We show the effectiveness of our attack both theoretically and empirically. Moreover, to evade detection, our adversarial post-processing method adds much smaller perturbations to AI-generated images and thus better maintain their visual quality than existing popular post-processing methods such as JPEG compression, Gaussian blur, and Brightness/Contrast. Our work shows the insufficiency of existing watermark-based detection of AI-generated content, highlighting the urgent needs of new methods. Our code is publicly available: https://github.com/zhengyuan-jiang/WEvade.

Keywords

Cite

@article{arxiv.2305.03807,
  title  = {Evading Watermark based Detection of AI-Generated Content},
  author = {Zhengyuan Jiang and Jinghuai Zhang and Neil Zhenqiang Gong},
  journal= {arXiv preprint arXiv:2305.03807},
  year   = {2023}
}

Comments

To appear in ACM Conference on Computer and Communications Security (CCS), 2023

R2 v1 2026-06-28T10:27:20.872Z