English
Related papers

Related papers: Monolingual Data Selection Analysis for English-Ma…

200 papers

Although Singing Voice Synthesis (SVS) has made great strides with Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains relatively unexplored. This paper presents BiSinger, a bilingual pop SVS system for English and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Huali Zhou , Yueqian Lin , Yao Shi , Peng Sun , Ming Li

Code-switching (CS) is the process of speakers interchanging between two or more languages which in the modern world becomes increasingly common. In order to better describe CS speech the Matrix Language Frame (MLF) theory introduces the…

Computation and Language · Computer Science 2024-12-03 Olga Iakovenko , Thomas Hain

Code-switching (CS) refers to the phenomenon that languages switch within a speech signal and leads to language confusion for automatic speech recognition (ASR). This paper aims to address language confusion for improving CS-ASR from two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Hexin Liu , Haihua Xu , Leibny Paola Garcia , Andy W. H. Khong , Yi He , Sanjeev Khudanpur

Code-switching (CS), the alternating use of two or more languages, challenges automatic speech recognition (ASR) due to scarce training data and linguistic similarities. The lack of dedicated CS datasets limits ASR performance, as most…

Computation and Language · Computer Science 2025-07-21 Carlos Mena , Pol Serra , Jacobo Romero , Abir Messaoudi , Jose Giraldo , Carme Armentano-Oller , Rodolfo Zevallos , Ivan Meza , Javier Hernando

In this work, we present a simple and elegant approach to language modeling for bilingual code-switched text. Since code-switching is a blend of two or more different languages, a standard bilingual language model can be improved upon by…

Computation and Language · Computer Science 2018-08-06 Saurabh Garg , Tanmay Parekh , Preethi Jyothi

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung

Code-switching in automatic speech recognition (ASR) is an important challenge due to globalization. Recent research in multilingual ASR shows potential improvement over monolingual systems. We study key issues related to multilingual…

Computation and Language · Computer Science 2021-07-06 Ahmed Ali , Shammur Chowdhury , Amir Hussein , Yasser Hifny

The Mandarin Chinese language is known to be strongly influenced by a rich set of regional accents, while Mandarin speech with each accent is quite low resource. Hence, an important task in Mandarin speech recognition is to appropriately…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Xurong Xie , Xiang Sui , Xunying Liu , Lan Wang

Modeling voices for multiple speakers and multiple languages in one text-to-speech system has been a challenge for a long time. This paper presents an extension on Tacotron2 to achieve bilingual multispeaker speech synthesis when there are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-22 Zexin Cai , Yaogen Yang , Ming Li

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

Building cross-lingual voice conversion (VC) systems for multiple speakers and multiple languages has been a challenging task for a long time. This paper describes a parallel non-autoregressive network to achieve bilingual and code-switched…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-23 Yaogen Yang , Haozhe Zhang , Xiaoyi Qin , Shanshan Liang , Huahua Cui , Mingyang Xu , Ming Li

Training multilingual automatic speech recognition (ASR) systems is challenging because acoustic and lexical information is typically language specific. Training multilingual system for Indic languages is even more tougher due to lack of…

Computation and Language · Computer Science 2022-06-14 Harveen Singh Chadha , Priyanshi Shah , Ankur Dhuriya , Neeraj Chhimwal , Anirudh Gupta , Vivek Raghavan

While many speakers of low-resource languages regularly code-switch between their languages and other regional languages or English, datasets of codeswitched speech are too small to train bespoke acoustic models from scratch or do language…

Computation and Language · Computer Science 2023-11-28 Tolúlopé Ògúnrèmí , Christopher D. Manning , Dan Jurafsky

We live in a world where 60% of the population can speak two or more languages fluently. Members of these communities constantly switch between languages when having a conversation. As automatic speech recognition (ASR) systems are being…

Computation and Language · Computer Science 2021-02-16 Siddharth Dalmia , Yuzong Liu , Srikanth Ronanki , Katrin Kirchhoff

In the FAME! Project, a code-switching (CS) automatic speech recognition (ASR) system for Frisian-Dutch speech is developed that can accurately transcribe the local broadcaster's bilingual archives with CS speech. This archive contains…

Computation and Language · Computer Science 2019-07-01 Emre Yılmaz , Samuel Cohen , Xianghu Yue , David van Leeuwen , Haizhou Li

Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages. While today's neural end-to-end (E2E) models deliver state-of-the-art performances on the task of automatic speech…

Computation and Language · Computer Science 2023-07-04 Enes Yavuz Ugan , Christian Huber , Juan Hussain , Alexander Waibel

Code-switching automatic speech recognition (CS-ASR) presents unique challenges due to language confusion introduced by spontaneous intra-sentence switching and accent bias that blurs the phonetic boundaries. Although the constituent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Hexin Liu , Haoyang Zhang , Qiquan Zhang , Xiangyu Zhang , Dongyuan Shi , Eng Siong Chng , Haizhou Li

Code-Switching refers to the phenomenon of switching languages within a sentence or discourse. However, limited code-switching , different language phoneme-sets and high rebuilding costs throw a challenge to make the specialized acoustic…

Sound · Computer Science 2022-10-27 Wei Wang , Chao Zhang , Xiaopei Wu

Code-switching (CSW) is a common phenomenon among multilingual speakers where multiple languages are used in a single discourse or utterance. Mixed language utterances may still contain grammatical errors however, yet most existing Grammar…

Computation and Language · Computer Science 2024-08-13 Kelvin Wey Han Chan , Christopher Bryant , Li Nguyen , Andrew Caines , Zheng Yuan

Code-switching (CS), defined as the mixing of languages in conversations, has become a worldwide phenomenon. The prevalence of CS has been recently met with a growing demand and interest to build CS ASR systems. In this paper, we present…

Computation and Language · Computer Science 2021-08-31 Injy Hamed , Pavel Denisov , Chia-Yu Li , Mohamed Elmahdy , Slim Abdennadher , Ngoc Thang Vu