English
Related papers

Related papers: Can we train ASR systems on Code-switch without re…

200 papers

Accented automatic speech recognition (ASR) often degrades due to the limited availability of accented training data. Prior work has explored accent modeling in low-resource settings, but existing approaches typically require minutes to…

Developing Automatic Speech Recognition (ASR) for low-resource languages is a challenge due to the small amount of transcribed audio data. For many such languages, audio and text are available separately, but not audio with transcriptions.…

Computation and Language · Computer Science 2022-07-21 Nathaniel Robinson , Perez Ogayo , Swetha Gangu , David R. Mortensen , Shinji Watanabe

This paper presents our latest effort on improving Code-switching language models that suffer from data scarcity. We investigate methods to augment Code-switching training text data by artificially generating them. Concretely, we propose a…

Computation and Language · Computer Science 2021-12-14 Chia-Yu Li , Ngoc Thang Vu

Speech accents pose a significant challenge to state-of-the-art automatic speech recognition (ASR) systems. Degradation in performance across underrepresented accents is a severe deterrent to the inclusive adoption of ASR. In this work, we…

Computation and Language · Computer Science 2023-10-30 Darshan Prabhu , Preethi Jyothi , Sriram Ganapathy , Vinit Unni

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

Recent work has shown that it is possible to train an $\textit{unsupervised}$ automatic speech recognition (ASR) system using only unpaired audio and text. Existing unsupervised ASR methods assume that no labeled data can be used for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Tatiana Likhomanenko , Loren Lugosch , Ronan Collobert

In recent years, end-to-end speech recognition has emerged as a technology that integrates the acoustic, pronunciation dictionary, and language model components of the traditional Automatic Speech Recognition model. It is possible to…

Computation and Language · Computer Science 2023-12-18 Tzu-Ting Yang , Hsin-Wei Wang , Berlin Chen

Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this work, we focus on the…

Computation and Language · Computer Science 2024-06-18 Bhavani Shankar , Preethi Jyothi , Pushpak Bhattacharyya

Sequence-to-sequence automatic speech recognition (ASR) models require large quantities of data to attain high performance. For this reason, there has been a recent surge in interest for unsupervised and semi-supervised training in such…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-21 Murali Karthick Baskar , Shinji Watanabe , Ramon Astudillo , Takaaki Hori , Lukáš Burget , Jan Černocký

Code-switching (CS) presents a significant challenge for general Auto-Speech Recognition (ASR) systems. Existing methods often fail to capture the sub tle phonological shifts inherent in CS scenarios. The challenge is particu larly…

Sound · Computer Science 2026-03-06 Tran Nguyen Anh , Truong Dinh Dung , Vo Van Nam , Minh N. H. Nguyen

Cross-lingual Summarization (CLS) aims at producing a summary in the target language for an article in the source language. Traditional solutions employ a two-step approach, i.e. translate then summarize or summarize then translate.…

Computation and Language · Computer Science 2020-10-20 Ruochen Xu , Chenguang Zhu , Yu Shi , Michael Zeng , Xuedong Huang

End-to-end neural automatic speech recognition systems achieved recently state-of-the-art results, but they require large datasets and extensive computing resources. Transfer learning has been proposed to overcome these difficulties even…

Computation and Language · Computer Science 2021-09-03 Peter Polák , Ondřej Bojar

Measuring the semantic similarity between two sentences (or Semantic Textual Similarity - STS) is fundamental in many NLP applications. Despite the remarkable results in supervised settings with adequate labeling, little attention has been…

Computation and Language · Computer Science 2018-10-31 Xin Tang , Shanbo Cheng , Loc Do , Zhiyu Min , Feng Ji , Heng Yu , Ji Zhang , Haiqin Chen

Automatic speech recognition (ASR) for low-resource languages remains a challenge due to the scarcity of labeled training data. Parameter-efficient fine-tuning and text-only adaptation are two popular methods that have been used to address…

Computation and Language · Computer Science 2024-10-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

The success of end-to-end speech-to-text translation (ST) is often achieved by utilizing source transcripts, e.g., by pre-training with automatic speech recognition (ASR) and machine translation (MT) tasks, or by introducing additional ASR…

Computation and Language · Computer Science 2023-05-16 Qingkai Fang , Yang Feng

Sequence-to-sequence attention-based models integrate an acoustic, pronunciation and language model into a single neural network, which make them very suitable for multilingual automatic speech recognition (ASR). In this paper, we are…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-15 Shiyu Zhou , Shuang Xu , Bo Xu

Despite having hundreds of millions of speakers, Chinese dialects lag behind Mandarin in speech and language technologies. Most varieties are primarily spoken, making dialect-to-Mandarin speech-LLMs (large language models) more practical…

Computation and Language · Computer Science 2026-01-13 Kalvin Chang , Yiwen Shao , Jiahong Li , Dong Yu

Code-switching, also called code-mixing, is the linguistics phenomenon where in casual settings, multilingual speakers mix words from different languages in one utterance. Due to its spontaneous nature, code-switching is extremely…

Computation and Language · Computer Science 2023-06-01 Shuyue Stella Li , Cihan Xiao , Tianjian Li , Bismarck Odoom

Speech synthesis (text to speech, TTS) and recognition (automatic speech recognition, ASR) are important speech tasks, and require a large amount of text and speech pairs for model training. However, there are more than 6,000 languages in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Jin Xu , Xu Tan , Yi Ren , Tao Qin , Jian Li , Sheng Zhao , Tie-Yan Liu

Despite remarkable achievements, automatic speech recognition (ASR) in low-resource scenarios still faces two challenges: high-quality data scarcity and high computational demands. This paper proposes EThai-ASR, the first to apply large…

Sound · Computer Science 2025-05-29 Mingchen Shao , Xinfa Zhu , Chengyou Wang , Bingshen Mu , Hai Li , Ying Yan , Junhui Liu , Danming Xie , Lei Xie