English

Joint Language Identification of Code-Switching Speech using Attention based E2E Network

Computation and Language 2019-07-16 v1 Sound Audio and Speech Processing

Abstract

Language identification (LID) has relevance in many speech processing applications. For the automatic recognition of code-switching speech, the conventional approaches often employ an LID system for detecting the languages present within an utterance. In the existing works, the LID on code-switching speech involves modelling of the underlying languages separately. In this work, we propose a joint modelling based LID system for code-switching speech. To achieve the same, an attention-based end-to-end (E2E) network has been explored. For the development and evaluation of the proposed approach, a recently created Hindi-English code-switching corpus has been used. For the contrast purpose, an LID system employing the connectionist temporal classification-based E2E network is also developed. On comparing both the LID systems, the attention based approach is noted to result in better LID accuracy. The effective location of code-switching boundaries within the utterance by the proposed approach has been demonstrated by plotting the attention weights of E2E network.

Keywords

Cite

@article{arxiv.1907.06342,
  title  = {Joint Language Identification of Code-Switching Speech using Attention based E2E Network},
  author = {Sreeram Ganji and Kunal Dhawan and Kumar Priyadarshi and Rohit Sinha},
  journal= {arXiv preprint arXiv:1907.06342},
  year   = {2019}
}
R2 v1 2026-06-23T10:20:49.795Z