English

Mondegreen: A Post-Processing Solution to Speech Recognition Error Correction for Voice Search Queries

Sound 2021-05-21 v1 Computation and Language Machine Learning Audio and Speech Processing

Abstract

As more and more online search queries come from voice, automatic speech recognition becomes a key component to deliver relevant search results. Errors introduced by automatic speech recognition (ASR) lead to irrelevant search results returned to the user, thus causing user dissatisfaction. In this paper, we introduce an approach, Mondegreen, to correct voice queries in text space without depending on audio signals, which may not always be available due to system constraints or privacy or bandwidth (for example, some ASR systems run on-device) considerations. We focus on voice queries transcribed via several proprietary commercial ASR systems. These queries come from users making internet, or online service search queries. We first present an analysis showing how different the language distribution coming from user voice queries is from that in traditional text corpora used to train off-the-shelf ASR systems. We then demonstrate that Mondegreen can achieve significant improvements in increased user interaction by correcting user voice queries in one of the largest search systems in Google. Finally, we see Mondegreen as complementing existing highly-optimized production ASR systems, which may not be frequently retrained and thus lag behind due to vocabulary drifts.

Keywords

Cite

@article{arxiv.2105.09930,
  title  = {Mondegreen: A Post-Processing Solution to Speech Recognition Error Correction for Voice Search Queries},
  author = {Sukhdeep S. Sodhi and Ellie Ka-In Chio and Ambarish Jash and Santiago Ontañón and Ajit Apte and Ankit Kumar and Ayooluwakunmi Jeje and Dima Kuzmin and Harry Fung and Heng-Tze Cheng and Jon Effrat and Tarush Bali and Nitin Jindal and Pei Cao and Sarvjeet Singh and Senqiang Zhou and Tameen Khan and Amol Wankhede and Moustafa Alzantot and Allen Wu and Tushar Chandra},
  journal= {arXiv preprint arXiv:2105.09930},
  year   = {2021}
}

Comments

Accepted in KDD 2021

R2 v1 2026-06-24T02:18:53.782Z