English
Related papers

Related papers: Unsupervised Stemming based Language Model for Tel…

200 papers

We address the problem of language model customization in applications where the ASR component needs to manage domain-specific terminology; although current state-of-the-art speech recognition technology provides excellent results for…

Computation and Language · Computer Science 2021-07-22 Roberto Gretter , Marco Matassoni , Daniele Falavigna

Despite rapid progress in the recent past, current speech recognition systems still require labeled training data which limits this technology to a small fraction of the languages spoken around the globe. This paper describes wav2vec-U,…

Computation and Language · Computer Science 2022-05-04 Alexei Baevski , Wei-Ning Hsu , Alexis Conneau , Michael Auli

Training a conventional automatic speech recognition (ASR) system to support multiple languages is challenging because the sub-word unit, lexicon and word inventories are typically language specific. In contrast, sequence-to-sequence models…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-16 Shubham Toshniwal , Tara N. Sainath , Ron J. Weiss , Bo Li , Pedro Moreno , Eugene Weinstein , Kanishka Rao

Sequence-to-sequence automatic speech recognition (ASR) models require large quantities of data to attain high performance. For this reason, there has been a recent surge in interest for unsupervised and semi-supervised training in such…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-21 Murali Karthick Baskar , Shinji Watanabe , Ramon Astudillo , Takaaki Hori , Lukáš Burget , Jan Černocký

Contextual automatic speech recognition (ASR) systems allow for recognizing out-of-vocabulary (OOV) words, such as named entities or rare words. However, it remains challenging due to limited training data and ambiguous or inconsistent…

Computation and Language · Computer Science 2025-09-03 Changsong Liu , Yizhou Peng , Eng Siong Chng

Recent advancements in text-to-speech (TTS) synthesis show that large-scale models trained with extensive web data produce highly natural-sounding output. However, such data is scarce for Indian languages due to the lack of high-quality,…

An independent, automated method of decoding and transcribing oral speech is known as automatic speech recognition (ASR). A typical ASR system extracts feature from audio recordings or streams and run one or more algorithms to map the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-21 Tushar Talukder Showrav

We present a language independent, unsupervised approach for transforming word embeddings from source language to target language using a transformation matrix. Our model handles the problem of data scarcity which is faced by many languages…

Computation and Language · Computer Science 2017-11-21 Syed Sarfaraz Akhtar , Arihant Gupta , Avijit Vajpayee , Arjit Srivastava , Madan Gopal Jhawar , Manish Shrivastava

In this paper, we introduce an unsupervised approach for Speech Segmentation, which builds on previously researched approaches, e.g., Speaker Diarization, while being applicable to an inclusive set of acoustic-semantic distinctions, paving…

Computation and Language · Computer Science 2025-01-08 Avishai Elmakies , Omri Abend , Yossi Adi

Unsupervised speech recognition (unsupervised ASR) aims to learn the ASR system with non-parallel speech and text corpus only. Wav2vec-U has shown promising results in unsupervised ASR by self-supervised speech representations coupled with…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Guan-Ting Lin , Chan-Jan Hsu , Da-Rong Liu , Hung-Yi Lee , Yu Tsao

Although over 300M around the world speak Bangla, scant work has been done in improving Bangla voice-to-text transcription due to Bangla being a low-resource language. However, with the introduction of the Bengali Common Voice 9.0 speech…

Computation and Language · Computer Science 2022-09-27 Mohammed Rakib , Md. Ismail Hossain , Nabeel Mohammed , Fuad Rahman

We present improvements in automatic speech recognition (ASR) for Somali, a currently extremely under-resourced language. This forms part of a continuing United Nations (UN) effort to employ ASR-based keyword spotting systems to support…

Computation and Language · Computer Science 2019-07-09 Astik Biswas , Raghav Menon , Ewald van der Westhuizen , Thomas Niesler

Modern topic identification (topic ID) systems for speech use automatic speech recognition (ASR) to produce speech transcripts, and perform supervised classification on such ASR outputs. However, under resource-limited conditions, the…

Computation and Language · Computer Science 2017-07-12 Chunxi Liu , Jan Trmal , Matthew Wiesner , Craig Harman , Sanjeev Khudanpur

Self-supervised learning (SSL) has been able to leverage unlabeled data to boost the performance of automatic speech recognition (ASR) models when we have access to only a small amount of transcribed speech data. However, this raises the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Reem Gody , David Harwath

The utilization of speech Self-Supervised Learning (SSL) models achieves impressive performance on Automatic Speech Recognition (ASR). However, in low-resource language ASR, they encounter the domain mismatch problem between pre-trained and…

Recent studies find existing self-supervised speech encoders contain primarily acoustic rather than semantic information. As a result, pipelined supervised automatic speech recognition (ASR) to large language model (LLM) systems achieve…

Unsupervised speech recognition (ASR-U) is the problem of learning automatic speech recognition (ASR) systems from unpaired speech-only and text-only corpora. While various algorithms exist to solve this problem, a theoretical framework is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Liming Wang , Mark Hasegawa-Johnson , Chang D. Yoo

Self-supervised automatic speech recognition (SSL-ASR) is an ASR approach that uses speech encoders pretrained on large amounts of unlabeled audio (e.g., wav2vec2.0 or HuBERT) and then fine-tunes them with limited labeled data to perform…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-07 Eyal Cohen , Bhiksha Raj , Joseph Keshet

Differentiating intrinsic language words from transliterable words is a key step aiding text processing tasks involving different natural languages. We consider the problem of unsupervised separation of transliterable words from native…

Computation and Language · Computer Science 2018-03-28 Deepak P

Semi-supervised training (SST) is a common approach to leverage untranscribed/unlabeled speech data to improve automatic speech recognition performance in low-resource languages. However, if the available unlabeled speech is mismatched to…

Computation and Language · Computer Science 2021-06-03 Jayadev Billa