English

Detecting Generative Parroting through Overfitting Masked Autoencoders

Machine Learning 2024-06-21 v3 Artificial Intelligence

Abstract

The advent of generative AI models has revolutionized digital content creation, yet it introduces challenges in maintaining copyright integrity due to generative parroting, where models mimic their training data too closely. Our research presents a novel approach to tackle this issue by employing an overfitted Masked Autoencoder (MAE) to detect such parroted samples effectively. We establish a detection threshold based on the mean loss across the training dataset, allowing for the precise identification of parroted content in modified datasets. Preliminary evaluations demonstrate promising results, suggesting our method's potential to ensure ethical use and enhance the legal compliance of generative models.

Keywords

Cite

@article{arxiv.2403.19050,
  title  = {Detecting Generative Parroting through Overfitting Masked Autoencoders},
  author = {Saeid Asgari Taghanaki and Joseph Lambourne},
  journal= {arXiv preprint arXiv:2403.19050},
  year   = {2024}
}

Comments

Accepted to CVPR 2024, Responsible Generative AI workshop

R2 v1 2026-06-28T15:36:27.611Z