English

Mitigating data replication in text-to-audio generative diffusion models through anti-memorization guidance

Audio and Speech Processing 2026-01-30 v2 Machine Learning Sound Signal Processing

Abstract

A persistent challenge in generative audio models is data replication, where the model unintentionally generates parts of its training data during inference. In this work, we address this issue in text-to-audio diffusion models by exploring the use of anti-memorization strategies. We adopt Anti-Memorization Guidance (AMG), a technique that modifies the sampling process of pre-trained diffusion models to discourage memorization. Our study explores three types of guidance within AMG, each designed to reduce replication while preserving generation quality. We use Stable Audio Open as our backbone, leveraging its fully open-source architecture and training dataset. Our comprehensive experimental analysis suggests that AMG significantly mitigates memorization in diffusion-based text-to-audio generation without compromising audio fidelity or semantic alignment.

Keywords

Cite

@article{arxiv.2509.14934,
  title  = {Mitigating data replication in text-to-audio generative diffusion models through anti-memorization guidance},
  author = {Francisco Messina and Francesca Ronchini and Luca Comanducci and Paolo Bestagini and Fabio Antonacci},
  journal= {arXiv preprint arXiv:2509.14934},
  year   = {2026}
}

Comments

Accepted at ICASSP 2026

R2 v1 2026-07-01T05:43:48.688Z