English

Explaining Speaker and Spoof Embeddings via Probing

Sound 2024-12-25 v1 Audio and Speech Processing

Abstract

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker embedding explainability, we examine how well these spoof embeddings capture speaker-related information. We train simple neural classifiers using either speaker or spoof embeddings as input, with speaker-related attributes as target labels. These attributes are categorized into two groups: metadata-based traits (e.g., gender, age) and acoustic traits (e.g., fundamental frequency, speaking rate). Our experiments on the ASVspoof 2019 LA evaluation set demonstrate that spoof embeddings preserve several key traits, including gender, speaking rate, F0, and duration. Further analysis of gender and speaking rate indicates that the spoofing detector partially preserves these traits, potentially to ensure the decision process remains robust against them.

Keywords

Cite

@article{arxiv.2412.18191,
  title  = {Explaining Speaker and Spoof Embeddings via Probing},
  author = {Xuechen Liu and Junichi Yamagishi and Md Sahidullah and Tomi kinnunen},
  journal= {arXiv preprint arXiv:2412.18191},
  year   = {2024}
}

Comments

To appear in IEEE ICASSP 2025

R2 v1 2026-06-28T20:47:44.844Z