English
Related papers

Related papers: Unsupervised Stemming based Language Model for Tel…

200 papers

One of the major challenges for developing automatic speech recognition (ASR) for low-resource languages is the limited access to labeled data with domain-specific variations. In this study, we propose a pseudo-labeling approach to develop…

Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-resource languages like…

Computation and Language · Computer Science 2021-02-22 Radia Rayan Chowdhury , Mir Tafseer Nayeem , Tahsin Tasnim Mim , Md. Saifur Rahman Chowdhury , Taufiqul Jannat

We propose a semi-supervised learning method for building end-to-end rich transcription-style automatic speech recognition (RT-ASR) systems from small-scale rich transcription-style and large-scale common transcription-style datasets. In…

Computation and Language · Computer Science 2021-07-13 Tomohiro Tanaka , Ryo Masumura , Mana Ihori , Akihiko Takashima , Shota Orihashi , Naoki Makishima

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

The current trend in automatic speech recognition is to leverage large amounts of labeled data to train supervised neural network models. Unfortunately, obtaining data for a wide range of domains to train robust models can be costly.…

Computation and Language · Computer Science 2018-06-14 Wei-Ning Hsu , Hao Tang , James Glass

The present study tackles the problem of automatically discovering spoken keywords from untranscribed audio archives without requiring word-by-word speech transcription by automatic speech recognition (ASR) technology. The problem is of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Man-Ling Sung , Siyuan Feng , Tan Lee

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

Computation and Language · Computer Science 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

Recent advances in machine learning have demonstrated that multi-modal pre-training can improve automatic speech recognition (ASR) performance compared to randomly initialized models, even when models are fine-tuned on uni-modal tasks.…

Computation and Language · Computer Science 2024-04-01 Yash Jain , David Chan , Pranav Dheram , Aparna Khare , Olabanji Shonibare , Venkatesh Ravichandran , Shalini Ghosh

Document summarization aims to create a precise and coherent summary of a text document. Many deep learning summarization models are developed mainly for English, often requiring a large training corpus and efficient pre-trained language…

Computation and Language · Computer Science 2022-12-27 Lakshmi Sireesha Vakada , Anudeep Ch , Mounika Marreddy , Subba Reddy Oota , Radhika Mamidi

Subword modeling for zero-resource languages aims to learn low-level representations of speech audio without using transcriptions or other resources from the target language (such as text corpora or pronunciation dictionaries). A good…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-20 Enno Hermann , Herman Kamper , Sharon Goldwater

Training state-of-the-art Automated Speech Recognition (ASR) models typically requires a substantial amount of transcribed speech. In this work, we demonstrate that a modality-matched joint speech and text model can be leveraged to train a…

Computation and Language · Computer Science 2022-10-24 Zhehuai Chen , Ankur Bapna , Andrew Rosenberg , Yu Zhang , Bhuvana Ramabhadran , Pedro Moreno , Nanxin Chen

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee

Performance in Speech Emotion Recognition (SER) on a single language has increased greatly in the last few years thanks to the use of deep learning techniques. However, cross-lingual SER remains a challenge in real-world applications due to…

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

We present OOD-Speech, the first out-of-distribution (OOD) benchmarking dataset for Bengali automatic speech recognition (ASR). Being one of the most spoken languages globally, Bengali portrays large diversity in dialects and prosodic…

Multilingual speech data often suffer from long-tailed language distribution, resulting in performance degradation. However, multilingual text data is much easier to obtain, yielding a more useful general language model. Hence, we are…

Computation and Language · Computer Science 2022-06-28 Kwanghee Choi , Hyung-Min Park

Automatic evaluation of ST systems is typically performed by comparing translation hypotheses with one or more reference translations. While effective to some extent, this approach inherits the limitation of reference-based evaluation that…

Computation and Language · Computer Science 2026-04-09 Mauro Cettolo , Marco Gaido , Matteo Negri , Sara Papi , Luisa Bentivogli

Existing Indic ASR benchmarks often use scripted, clean speech and leaderboard driven evaluation that encourages dataset specific overfitting. In addition, strict single reference WER penalizes natural spelling variation in Indian…

A recent line of research on automated speaking assessment (ASA) has benefited from self-supervised learning (SSL) representations, which capture rich acoustic and linguistic patterns in non-native speech without underlying assumptions of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-23 Tien-Hong Lo , Szu-Yu Chen , Yao-Ting Sung , Berlin Chen

Unsupervised pre-training is now the predominant approach for both text and speech understanding. Self-attention models pre-trained on large amounts of unannotated data have been hugely successful when fine-tuned on downstream tasks from a…

Computation and Language · Computer Science 2021-10-22 Ankur Bapna , Yu-an Chung , Nan Wu , Anmol Gulati , Ye Jia , Jonathan H. Clark , Melvin Johnson , Jason Riesa , Alexis Conneau , Yu Zhang