English

Towards Evaluating Generative Audio: Insights from Neural Audio Codec Embedding Distances

Audio and Speech Processing 2026-01-23 v2

Abstract

Neural audio codecs (NACs) achieve low-bitrate compression by learning compact audio representations, which can also serve as features for perceptual quality evaluation. We introduce DACe, an enhanced, higher-fidelity version of the Descript Audio Codec (DAC), trained on diverse real and synthetic tonal data with balanced sampling. We systematically compare Fr\'echet Audio Distance (FAD) and Maximum Mean Discrepancy (MMD) on MUSHRA tests across speech, music, and mixed content. FAD consistently outperforms MMD, and embeddings from higher-fidelity NACs (such as DACe) show stronger correlations with human judgments. While CLAP LAION Music (CLAP-M) and OpenL3 Mel128 (OpenL3-128M) embeddings achieve higher correlations, NAC embeddings provide a practical zero-shot approach to audio quality assessment, requiring only unencoded audio for training. These results demonstrate the dual utility of NACs for compression and perceptually informed audio evaluation.

Keywords

Cite

@article{arxiv.2509.18823,
  title  = {Towards Evaluating Generative Audio: Insights from Neural Audio Codec Embedding Distances},
  author = {Arijit Biswas and Lars Villemoes},
  journal= {arXiv preprint arXiv:2509.18823},
  year   = {2026}
}

Comments

Accepted to 51st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 04-08 May 2026

R2 v1 2026-07-01T05:51:46.345Z