English
Related papers

Related papers: Recognize Foreign Low-Frequency Words with Similar…

200 papers

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

Computation and Language · Computer Science 2023-06-16 Muhammad Umar Farooq , Thomas Hain

Among the six challenges of neural machine translation (NMT) coined by (Koehn and Knowles, 2017), rare-word problem is considered the most severe one, especially in translation of low-resource languages. In this paper, we propose three…

Computation and Language · Computer Science 2020-12-17 Thi-Vinh Ngo , Thanh-Le Ha , Phuong-Thai Nguyen , Le-Minh Nguyen

This paper addresses the challenge of integrating low-resource languages into multilingual automatic speech recognition (ASR) systems. We introduce a novel application of weighted cross-entropy, typically used for unbalanced datasets, to…

Rare word recognition can be improved by adapting ASR models to synthetic data that includes these words. Further improvements can be achieved through contextual biasing, which trains and adds a biasing module into the model architecture to…

Computation and Language · Computer Science 2025-09-12 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng

It is challenging to train and deploy Transformer LMs for hybrid speech recognition 2nd pass re-ranking in low-resource languages due to (1) data scarcity in low-resource languages, (2) expensive computing costs for training and refreshing…

Computation and Language · Computer Science 2022-09-12 Li Miao , Jian Wu , Piyush Behre , Shuangyu Chang , Sarangarajan Parthasarathy

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

Fine-tuning pretrained language models (LMs) is a popular approach to automatic speech recognition (ASR) error detection during post-processing. While error detection systems often take advantage of statistical language archetypes captured…

Computation and Language · Computer Science 2021-08-05 Seongmin Park , Dongchan Shin , Sangyoun Paik , Subong Choi , Alena Kazakova , Jihwa Lee

Neural networks are among the state-of-the-art techniques for language modeling. Existing neural language models typically map discrete words to distributed, dense vector representations. After information processing of the preceding…

Computation and Language · Computer Science 2016-10-14 Yunchuan Chen , Lili Mou , Yan Xu , Ge Li , Zhi Jin

How predictable a word is can be quantified in two ways: using human responses to the cloze task or using probabilities from language models (LMs).When used as predictors of processing effort, LM probabilities outperform probabilities…

Computation and Language · Computer Science 2026-05-27 Sathvik Nair , Byung-Doh Oh

The rate of occurrence of words is not uniform but varies from document to document. Despite this observation, parameters for conventional n-gram language models are usually derived using the assumption of a constant word rate. In this…

Computation and Language · Computer Science 2007-05-23 Yoshihiko Gotoh , Steve Renals

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

We present an algorithm that takes an unannotated corpus as its input, and returns a ranked list of probable morphologically related pairs as its output. The algorithm tries to discover morphologically related pairs by looking for pairs…

Computation and Language · Computer Science 2007-05-23 Marco Baroni , Johannes Matiasek , Harald Trost

Generative error correction (GER) with large language models (LLMs) has emerged as an effective post-processing approach to improve automatic speech recognition (ASR) performance. However, it often struggles with rare or domain-specific…

Sound · Computer Science 2025-05-26 Natsuo Yamashita , Masaaki Yamamoto , Hiroaki Kokubo , Yohei Kawaguchi

Low-frequency word prediction remains a challenge in modern neural machine translation (NMT) systems. Recent adaptive training methods promote the output of infrequent words by emphasizing their weights in the overall training objectives.…

Computation and Language · Computer Science 2021-12-30 Tong Zhang , Wei Ye , Baosong Yang , Long Zhang , Xingzhang Ren , Dayiheng Liu , Jinan Sun , Shikun Zhang , Haibo Zhang , Wen Zhao

Language models (LMs) have been commonly adopted to boost the performance of automatic speech recognition (ASR) particularly in domain adaptation tasks. Conventional way of LM training treats all the words in corpora equally, resulting in…

Computation and Language · Computer Science 2023-10-18 Yingyi Ma , Zhe Liu , Ozlem Kalinli

The proposed algorithmic approach deals with finding the sense of a word in an electronic data. Now a day,in different communication mediums like internet, mobile services etc. people use few words, which are slang in nature. This approach…

Computation and Language · Computer Science 2017-02-15 Alok Ranjan Pal , Diganta Saha

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

Sequence-to-sequence attention-based models integrate an acoustic, pronunciation and language model into a single neural network, which make them very suitable for multilingual automatic speech recognition (ASR). In this paper, we are…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-15 Shiyu Zhou , Shuang Xu , Bo Xu

This paper introduces Latent Relational Analysis (LRA), a method for measuring relational similarity. LRA has potential applications in many areas, including information extraction, word sense disambiguation, machine translation, and…

Computation and Language · Computer Science 2007-05-23 Peter D. Turney

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet