English
Related papers

Related papers: Methods of Automatic Matrix Language Determination…

200 papers

Due to the inherent difficulty in modeling phonetic similarities across different languages, code-switching speech recognition presents a formidable challenge. This study proposes a Collaborative-MoE, a Mixture of Experts (MoE) model that…

Computation and Language · Computer Science 2024-09-06 Hukai Huang , Jiayan Lin , Kaidi Wang , Yishuang Li , Wenhao Guan , Lin Li , Qingyang Hong

Code-mixing, the blending of linguistic elements from distinct languages to form meaningful sentences, is common in multilingual settings, yielding hybrid languages like Hinglish and Minglish. Marathi, India's third most spoken language,…

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung

Most people are multilingual, and most multilinguals code-switch, yet the characteristics of code-switched language are not fully understood. We developed a chatbot capable of completing a Map Task with human participants using…

Computation and Language · Computer Science 2025-08-12 Dean Geckt , Melinda Fricke , Shuly Wintner

The bi-encoder structure has been intensively investigated in code-switching (CS) automatic speech recognition (ASR). However, most existing methods require the structures of two monolingual ASR models (MAMs) should be the same and only use…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Tongtong Song , Qiang Xu , Haoyu Lu , Longbiao Wang , Hao Shi , Yuqin Lin , Yanbing Yang , Jianwu Dang

We propose a) a Language Agnostic end-to-end Speech Translation model (LAST), and b) a data augmentation strategy to increase code-switching (CS) performance. With increasing globalization, multiple languages are increasingly used…

Computation and Language · Computer Science 2022-11-10 Christian Huber , Enes Yavuz Ugan , Alexander Waibel

As large language models (LLMs) have advanced rapidly, concerns regarding their safety have become prominent. In this paper, we discover that code-switching in red-teaming queries can effectively elicit undesirable behaviors of LLMs, which…

Artificial Intelligence · Computer Science 2025-06-12 Haneul Yoo , Yongjin Yang , Hwaran Lee

In this paper, we particularly work on the code-switched text, one of the most common occurrences in the bilingual communities across the world. Due to the discrepancies in the extraction of code-switched text from an Automated Speech…

Computation and Language · Computer Science 2020-06-17 Ahan M. R. , Shreyas Sunil Kulkarni

Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of an individual recording. However, language identification…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Suzy J. Styles , Victoria Y. H. Chua , Fei Ting Woon , Hexin Liu , Leibny Paola Garcia Perera , Sanjeev Khudanpur , Andy W. H. Khong , Justin Dauwels

Code-switching (CS) speech refers to the phenomenon of mixing two or more languages within the same sentence. Despite the recent advances in automatic speech recognition (ASR), CS-ASR is still a challenging task ought to the grammatical…

Computation and Language · Computer Science 2023-10-23 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Hexin Liu , Sabato Marco Siniscalchi , Eng Siong Chng

Language Identification (LID) is a crucial preliminary process in the field of Automatic Speech Recognition (ASR) that involves the identification of a spoken language from audio samples. Contemporary systems that can process speech in…

Machine Learning · Computer Science 2026-03-04 Atanu Mandal , Santanu Pal , Indranil Dutta , Mahidas Bhattacharya , Sudip Kumar Naskar

Multilingual pre-trained language models, such as mBERT and XLM-R, have shown impressive cross-lingual ability. Surprisingly, both of them use multilingual masked language model (MLM) without any cross-lingual supervision or aligned data.…

Computation and Language · Computer Science 2022-03-17 Yuan Chai , Yaobo Liang , Nan Duan

A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from English. To…

Computation and Language · Computer Science 2020-05-22 Aaron Mueller , Garrett Nicolai , Panayiota Petrou-Zeniou , Natalia Talmina , Tal Linzen

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

Computation and Language · Computer Science 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

Code-switching describes the practice of using more than one language in the same sentence. In this study, we investigate how to optimize a neural transducer based bilingual automatic speech recognition (ASR) model for code-switching…

Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While…

Computation and Language · Computer Science 2024-10-18 Caroline Sabty

In this work, we use language modeling to investigate the factors that influence insertional code-switching. Code-switching occurs when a speaker alternates between one language variety (the primary language) and another (the secondary…

Computation and Language · Computer Science 2026-05-05 Debasmita Bhattacharya , Marten van Schijndel

Training multilingual automatic speech recognition (ASR) systems is challenging because acoustic and lexical information is typically language specific. Training multilingual system for Indic languages is even more tougher due to lack of…

Computation and Language · Computer Science 2022-06-14 Harveen Singh Chadha , Priyanshi Shah , Ankur Dhuriya , Neeraj Chhimwal , Anirudh Gupta , Vivek Raghavan

Code-switching is the use of more than one language in the same conversation or utterance. Recently, multilingual contextual embedding models, trained on multiple monolingual corpora, have shown promising results on cross-lingual and…

Computation and Language · Computer Science 2020-05-15 Simran Khanuja , Sandipan Dandapat , Anirudh Srinivasan , Sunayana Sitaram , Monojit Choudhury

Training a code-switching (CS) language model using only monolingual data is still an ongoing research problem. In this paper, a CS language model is trained using only monolingual training data. As recurrent neural network (RNN) models are…

Computation and Language · Computer Science 2020-12-25 Asad Ullah , Tauseef Ahmed