English

Using Deep Learning Techniques and Inferential Speech Statistics for AI Synthesised Speech Recognition

Machine Learning 2021-07-27 v1 Multimedia Sound Audio and Speech Processing

Abstract

The recent developments in technology have re-warded us with amazing audio synthesis models like TACOTRON and WAVENETS. On the other side, it poses greater threats such as speech clones and deep fakes, that may go undetected. To tackle these alarming situations, there is an urgent need to propose models that can help discriminate a synthesized speech from an actual human speech and also identify the source of such a synthesis. Here, we propose a model based on Convolutional Neural Network (CNN) and Bidirectional Recurrent Neural Network (BiRNN) that helps to achieve both the aforementioned objectives. The temporal dependencies present in AI synthesized speech are exploited using Bidirectional RNN and CNN. The model outperforms the state-of-the-art approaches by classifying the AI synthesized audio from real human speech with an error rate of 1.9% and detecting the underlying architecture with an accuracy of 97%.

Keywords

Cite

@article{arxiv.2107.11412,
  title  = {Using Deep Learning Techniques and Inferential Speech Statistics for AI Synthesised Speech Recognition},
  author = {Arun Kumar Singh and Priyanka Singh and Karan Nathwani},
  journal= {arXiv preprint arXiv:2107.11412},
  year   = {2021}
}

Comments

13 Pages, 13 Figures, 6 Tables. arXiv admin note: substantial text overlap with arXiv:2009.01934

R2 v1 2026-06-24T04:28:28.775Z