English
Related papers

Related papers: Simple yet Effective Code-Switching Language Ident…

200 papers

Code-switching, the interleaving of two or more languages within a sentence or discourse is pervasive in multilingual societies. Accurate language models for code-switched text are critical for NLP tasks. State-of-the-art data-intensive…

Computation and Language · Computer Science 2019-06-24 Bidisha Samanta , Sharmila Reddy , Hussain Jagirdar , Niloy Ganguly , Soumen Chakrabarti

Recently, sequence-to-sequence (seq-to-seq) models have been successfully applied in text-to-speech (TTS) to synthesize speech for single-language text. To synthesize speech for multiple languages usually requires multi-lingual speech from…

Sound · Computer Science 2022-11-18 Haitong Zhang , Yue Lin

Multilingual Speech Recognition is one of the most costly AI problems, because each language (7,000+) and even different accents require their own acoustic models to obtain best recognition performance. Even though they all use the same…

Computation and Language · Computer Science 2018-07-06 Markus Müller , Sebastian Stüker , Alex Waibel

The pre-trained multi-lingual XLSR model generalizes well for language identification after fine-tuning on unseen languages. However, the performance significantly degrades when the languages are not very distinct from each other, for…

Machine Learning · Computer Science 2023-02-17 Shangeth Rajaa , Kriti Anandan , Swaraj Dalmia , Tarun Gupta , Eng Siong Chng

Training a code-switching (CS) language model using only monolingual data is still an ongoing research problem. In this paper, a CS language model is trained using only monolingual training data. As recurrent neural network (RNN) models are…

Computation and Language · Computer Science 2020-12-25 Asad Ullah , Tauseef Ahmed

Code-switching automatic speech recognition becomes one of the most challenging and the most valuable scenarios of automatic speech recognition, due to the code-switching phenomenon between multilingual language and the frequent occurrence…

Computation and Language · Computer Science 2022-10-14 Shuhao Deng , Chengfei Li , Jinfeng Bai , Qingqing Zhang , Wei-Qiang Zhang , Runyan Yang , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

Conversational bilingual speech encompasses three types of utterances: two purely monolingual types and one intra-sententially code-switched type. In this work, we propose a general framework to jointly model the likelihoods of the…

Computation and Language · Computer Science 2021-12-01 Brian Yan , Chunlei Zhang , Meng Yu , Shi-Xiong Zhang , Siddharth Dalmia , Dan Berrebbi , Chao Weng , Shinji Watanabe , Dong Yu

Linguistic Code-switching (CS) is still an understudied phenomenon in natural language processing. The NLP community has mostly focused on monolingual and multi-lingual scenarios, but little attention has been given to CS in particular.…

Computation and Language · Computer Science 2020-05-05 Gustavo Aguilar , Thamar Solorio

Multilingual models have demonstrated impressive cross-lingual transfer performance. However, test sets like XNLI are monolingual at the example level. In multilingual communities, it is common for polyglots to code-mix when conversing with…

Computation and Language · Computer Science 2021-06-08 Samson Tan , Shafiq Joty

Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to…

Computation and Language · Computer Science 2021-07-15 Ishan Tarunesh , Syamantak Kumar , Preethi Jyothi

Code switching is a linguistic phenomenon that may occur within a multilingual setting where speakers share more than one language. With the increasing communication between groups with different languages, this phenomenon is more and more…

Computation and Language · Computer Science 2020-09-10 Jiaxiang Liu , Xuyi Chen , Shikun Feng , Shuohuan Wang , Xuan Ouyang , Yu Sun , Zhengjie Huang , Weiyue Su

While Self-supervised Learning (SSL) has significantly improved Spoken Language Identification (LID), existing models often struggle to consistently classify dialects and accents of the same language as a unified class. To address this…

Computation and Language · Computer Science 2025-08-26 Qingzheng Wang , Hye-jin Shim , Jiancheng Sun , Shinji Watanabe

There is a lack of an evaluation methodology that estimates the extent to which large language models (LLMs) use code-switching (CS) in the same way as bilinguals. Existing methods do not have wide language coverage, fail to account for the…

Computation and Language · Computer Science 2025-07-29 Igor Sterner , Simone Teufel

Code-Switching, a common phenomenon in written text and conversation, has been studied over decades by the natural language processing (NLP) research community. Initially, code-switching is intensively explored by leveraging linguistic…

Computation and Language · Computer Science 2023-05-26 Genta Indra Winata , Alham Fikri Aji , Zheng-Xin Yong , Thamar Solorio

Code-mixing is the phenomenon of using multiple languages in the same utterance of a text or speech. It is a frequently used pattern of communication on various platforms such as social media sites, online gaming, product reviews, etc.…

Computation and Language · Computer Science 2020-07-24 Vivek Srivastava , Mayank Singh

In this work, we study whether multilingual language models (MultiLMs) can transfer logical reasoning abilities to other languages when they are fine-tuned for reasoning in a different language. We evaluate the cross-lingual reasoning…

Computation and Language · Computer Science 2023-10-25 Negar Foroutan , Mohammadreza Banaei , Karl Aberer , Antoine Bosselut

The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non-homogeneous characteristics. Significantly, the language identification in a multilingual document is…

Computation and Language · Computer Science 2021-06-30 M Zeeshan Ansari , Tanvir Ahmad , M M Sufyan Beg , Asma Ikram

Code-switching and language identification in child-directed scenarios present significant challenges, particularly in bilingual environments. This paper addresses this challenge by using Zipformer to handle the nuances of speech, which…

Computation and Language · Computer Science 2025-08-14 Lavanya Shankar , Leibny Paola Garcia Perera

Multilingual text-to-speech systems convert text into speech across multiple languages. In many cases, text sentences may contain segments in different languages, a phenomenon known as code-switching. This is particularly common in…

Computation and Language · Computer Science 2024-12-30 Ahmad Alfani Handoyo , Chung Tran , Dessi Puji Lestari , Sakriani Sakti

In this paper, we present our initial efforts for building a code-switching (CS) speech recognition system leveraging existing acoustic models (AMs) and language models (LMs), i.e., no training required, and specifically targeting…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-03 Zhen Huang , Xiaodan Zhuang , Daben Liu , Xiaoqiang Xiao , Yuchen Zhang , Sabato Marco Siniscalchi