English
Related papers

Related papers: Phoneme-aware Encoding for Prefix-tree-based Conte…

200 papers

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet

There is an implicit assumption that traditional hybrid approaches for automatic speech recognition (ASR) cannot directly model graphemes and need to rely on phonetic lexicons to get competitive performance, especially on English which has…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-15 Duc Le , Xiaohui Zhang , Weiyi Zheng , Christian Fügen , Geoffrey Zweig , Michael L. Seltzer

Automatic detection of phoneme or word-like units is one of the core objectives in zero-resource speech processing. Recent attempts employ self-supervised training methods, such as contrastive predictive coding (CPC), where the next frame…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Saurabhchand Bhati , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velazquez , Najim Dehak

We investigate the efficiency of two very different spoken term detection approaches for transcription when the available data is insufficient to train a robust ASR system. This work is grounded in very low-resource language documentation…

Computation and Language · Computer Science 2021-06-14 Éric Le Ferrand , Steven Bird , Laurent Besacier

Code-switching (CS) presents a significant challenge for general Auto-Speech Recognition (ASR) systems. Existing methods often fail to capture the sub tle phonological shifts inherent in CS scenarios. The challenge is particu larly…

Sound · Computer Science 2026-03-06 Tran Nguyen Anh , Truong Dinh Dung , Vo Van Nam , Minh N. H. Nguyen

Grapheme-to-phoneme (G2P) models are a key component in Automatic Speech Recognition (ASR) systems, such as the ASR system in Alexa, as they are used to generate pronunciations for out-of-vocabulary words that do not exist in the…

Computation and Language · Computer Science 2020-06-30 Alex Sokolov , Tracy Rohlin , Ariya Rastrow

This study addresses unsupervised subword modeling, i.e., learning acoustic feature representations that can distinguish between subword units of a language. We propose a two-stage learning framework that combines self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Siyuan Feng , Odette Scharenborg

End-to-End (E2E) automatic speech recognition (ASR) systems used in voice assistants often have difficulties recognizing infrequent words personalized to the user, such as names and places. Rare words often have non-trivial pronunciations,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Rahul Pandey , Roger Ren , Qi Luo , Jing Liu , Ariya Rastrow , Ankur Gandhe , Denis Filimonov , Grant Strimel , Andreas Stolcke , Ivan Bulyko

Automatic Phoneme Recognition (APR) systems are often trained using pseudo phoneme-level annotations generated from text through Grapheme-to-Phoneme (G2P) systems. These G2P systems frequently output multiple possible pronunciations per…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-09 Henry Grafé , Hugo Van hamme

Large-scale pre-trained language models have been shown to be helpful in improving the naturalness of text-to-speech (TTS) models by enabling them to produce more naturalistic prosodic patterns. However, these models are usually word-level…

Computation and Language · Computer Science 2023-01-24 Yinghao Aaron Li , Cong Han , Xilin Jiang , Nima Mesgarani

We introduce a novel neural network module that adeptly handles recursive data flow in neural network architectures. At its core, this module employs a self-consistent approach where a set of recursive equations is solved iteratively,…

Computation and Language · Computer Science 2024-10-07 Konstantin Kolokolov , Pavel Pekichev , Karthik Raghunathan

We investigate the performance on phoneme categorization and phoneme and word segmentation of several self-supervised learning (SSL) methods based on Contrastive Predictive Coding (CPC). Our experiments show that with the existing…

Grapheme-based acoustic modeling has recently been shown to outperform phoneme-based approaches in both hybrid and end-to-end automatic speech recognition (ASR), even on non-phonemic languages like English. However, graphemic ASR still has…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Duc Le , Thilo Koehler , Christian Fuegen , Michael L. Seltzer

Code-Switching (CS) remains a challenge for Automatic Speech Recognition (ASR), especially character-based models. With the combined choice of characters from multiple languages, the outcome from character-based models suffers from phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-24 Burin Naowarat , Thananchai Kongthaworn , Korrawe Karunratanakul , Sheng Hui Wu , Ekapol Chuangsuwanich

Accurate recognition of rare and new words remains a pressing problem for contextualized Automatic Speech Recognition (ASR) systems. Most context-biasing methods involve modification of the ASR model or the beam-search decoding algorithm,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Andrei Andrusenko , Aleksandr Laptev , Vladimir Bataev , Vitaly Lavrukhin , Boris Ginsburg

State-of-the-art automatic speech recognition (ASR) systems struggle with the lack of data for rare accents. For sufficiently large datasets, neural engines tend to outshine statistical models in most natural language processing problems.…

Sound · Computer Science 2018-07-11 Fedor Kitashov , Elizaveta Svitanko , Debojyoti Dutta

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

Recognizing specific key phrases is an essential task for contextualized Automatic Speech Recognition (ASR). However, most existing context-biasing approaches have limitations associated with the necessity of additional model training,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Andrei Andrusenko , Vladimir Bataev , Lilit Grigoryan , Vitaly Lavrukhin , Boris Ginsburg

End-to-end (E2E) automatic speech recognition (ASR) systems often have difficulty recognizing uncommon words, that appear infrequently in the training data. One promising method, to improve the recognition accuracy on such rare words, is to…

Computation and Language · Computer Science 2021-11-08 Feng-Ju Chang , Jing Liu , Martin Radfar , Athanasios Mouchtaris , Maurizio Omologo , Ariya Rastrow , Siegfried Kunzmann

UniSpeech has achieved superior performance in cross-lingual automatic speech recognition (ASR) by explicitly aligning latent representations to phoneme units using multi-task self-supervised learning. While the learned representations…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Hongfei Xue , Qijie Shao , Peikun Chen , Pengcheng Guo , Lei Xie , Jie Liu