English

Can Emotion Fool Anti-spoofing?

Audio and Speech Processing 2025-06-02 v1 Machine Learning Sound

Abstract

Traditional anti-spoofing focuses on models and datasets built on synthetic speech with mostly neutral state, neglecting diverse emotional variations. As a result, their robustness against high-quality, emotionally expressive synthetic speech is uncertain. We address this by introducing EmoSpoof-TTS, a corpus of emotional text-to-speech samples. Our analysis shows existing anti-spoofing models struggle with emotional synthetic speech, exposing risks of emotion-targeted attacks. Even trained on emotional data, the models underperform due to limited focus on emotional aspect and show performance disparities across emotions. This highlights the need for emotion-focused anti-spoofing paradigm in both dataset and methodology. We propose GEM, a gated ensemble of emotion-specialized models with a speech emotion recognition gating network. GEM performs effectively across all emotions and neutral state, improving defenses against spoofing attacks. We release the EmoSpoof-TTS Dataset: https://emospoof-tts.github.io/Dataset/

Keywords

Cite

@article{arxiv.2505.23962,
  title  = {Can Emotion Fool Anti-spoofing?},
  author = {Aurosweta Mahapatra and Ismail Rasim Ulgen and Abinay Reddy Naini and Carlos Busso and Berrak Sisman},
  journal= {arXiv preprint arXiv:2505.23962},
  year   = {2025}
}

Comments

Accepted to Interspeech 2025

R2 v1 2026-07-01T02:49:23.888Z