English

Evaluating Disentangled Representations for Controllable Music Generation

Sound 2026-02-17 v2 Machine Learning Audio and Speech Processing

Abstract

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored. In this work, we evaluate such disentangled representations in a set of music audio models for controllable generation using a probing-based framework that goes beyond standard downstream tasks. The selected models reflect diverse unsupervised disentanglement strategies, including inductive biases, data augmentations, adversarial objectives, and staged training procedures. We further isolate specific strategies to analyze their effect. Our analysis spans four key axes: informativeness, equivariance, invariance, and disentanglement, which are assessed across datasets, tasks, and controlled transformations. Our findings reveal inconsistencies between intended and actual semantics of the embeddings, suggesting that current strategies fall short of producing truly disentangled representations, and prompting a re-examination of how controllability is approached in music generation.

Keywords

Cite

@article{arxiv.2602.10058,
  title  = {Evaluating Disentangled Representations for Controllable Music Generation},
  author = {Laura Ibáñez-Martínez and Chukwuemeka Nkama and Andrea Poltronieri and Xavier Serra and Martín Rocamora},
  journal= {arXiv preprint arXiv:2602.10058},
  year   = {2026}
}

Comments

Accepted at ICASSP 2026

R2 v1 2026-07-01T10:30:10.630Z