English

Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion

Computation and Language 2025-07-01 v2 Artificial Intelligence Sound Audio and Speech Processing

Abstract

The rapid advancement of AI-based music generation tools is revolutionizing the music industry but also posing challenges to artists, copyright holders, and providers alike. This necessitates reliable methods for detecting such AI-generated content. However, existing detectors, relying on either audio or lyrics, face key practical limitations: audio-based detectors fail to generalize to new or unseen generators and are vulnerable to audio perturbations; lyrics-based methods require cleanly formatted and accurate lyrics, unavailable in practice. To overcome these limitations, we propose a novel, practically grounded approach: a multimodal, modular late-fusion pipeline that combines automatically transcribed sung lyrics and speech features capturing lyrics-related information within the audio. By relying on lyrical aspects directly from audio, our method enhances robustness, mitigates susceptibility to low-level artifacts, and enables practical applicability. Experiments show that our method, DE-detect, outperforms existing lyrics-based detectors while also being more robust to audio perturbations. Thus, it offers an effective, robust solution for detecting AI-generated music in real-world scenarios. Our code is available at https://github.com/deezer/robust-AI-lyrics-detection.

Keywords

Cite

@article{arxiv.2506.15981,
  title  = {Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion},
  author = {Markus Frohmann and Gabriel Meseguer-Brocal and Markus Schedl and Elena V. Epure},
  journal= {arXiv preprint arXiv:2506.15981},
  year   = {2025}
}

Comments

Accepted to ACL 2025 Findings

R2 v1 2026-07-01T03:24:36.984Z