English
Related papers

Related papers: Code-switching in text and speech challenges infor…

200 papers

Recently, large pre-trained multilingual speech models have shown potential in scaling Automatic Speech Recognition (ASR) to many low-resource languages. Some of these models employ language adapters in their formulation, which helps to…

Computation and Language · Computer Science 2023-10-12 Atharva Kulkarni , Ajinkya Kulkarni , Miguel Couceiro , Hanan Aldarmaki

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of both acoustic and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-13 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Berlin Chen

Code-switching, the phenomenon of alternating between two or more languages in a single conversation, presents unique challenges for Natural Language Processing (NLP). Most existing research focuses on either syntactic constraints or neural…

Computation and Language · Computer Science 2024-10-31 Garry Kuwanto , Chaitanya Agarwal , Genta Indra Winata , Derry Tanti Wijaya

Code-switching (CS) is a widespread phenomenon among bilingual and multilingual societies. The lack of CS resources hinders the performance of many NLP tasks. In this work, we explore the potential use of bilingual word embeddings for…

Computation and Language · Computer Science 2019-09-25 Injy Hamed , Moritz Zhu , Mohamed Elmahdy , Slim Abdennadher , Ngoc Thang Vu

Code-switching, alternating between languages within a conversation, is natural for multilingual users, yet poses fundamental challenges for large language models (LLMs). When a user code-switches in their prompt to an LLM, they typically…

Computation and Language · Computer Science 2026-01-08 Juhyun Oh , Haneul Yoo , Faiz Ghifari Haznitrama , Alice Oh

An important and difficult task in code-switched speech recognition is to recognize the language, as lots of words in two languages can sound similar, especially in some accents. We focus on improving performance of end-to-end Automatic…

Computation and Language · Computer Science 2024-03-14 Yash Sharma , Basil Abraham , Preethi Jyothi

Code-switching speech refers to a means of expression by mixing two or more languages within a single utterance. Automatic Speech Recognition (ASR) with End-to-End (E2E) modeling for such speech can be a challenging task due to the lack of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Haibin Yu , Yuxuan Hu , Yao Qian , Ma Jin , Linquan Liu , Shujie Liu , Yu Shi , Yanmin Qian , Edward Lin , Michael Zeng

Code-switching is a pervasive phenomenon in multilingual communication, yet the robustness of large language models (LLMs) in mixed-language settings remains insufficiently understood. In this work, we present a comprehensive evaluation of…

Code-Switching (CS) is a common linguistic phenomenon in multilingual communities that consists of switching between languages while speaking. This paper presents our investigations on end-to-end speech recognition for Mandarin-English CS…

Computation and Language · Computer Science 2021-12-21 Chia-Yu Li , Ngoc Thang Vu

Recent developments in reasoning capabilities have enabled large language models to solve increasingly complex mathematical, symbolic, and logical tasks. Interestingly, while reasoning models are often trained to generate monolingual text,…

Computation and Language · Computer Science 2026-04-20 Eleanor M. Lin , David Jurgens

Lack of text data has been the major issue on code-switching language modeling. In this paper, we introduce multi-task learning based language model which shares syntax representation of languages to leverage linguistic information and…

Computation and Language · Computer Science 2018-10-05 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

The analysis of data in which multiple languages are represented has gained popularity among computational linguists in recent years. So far, much of this research focuses mainly on the improvement of computational methods and largely…

Computation and Language · Computer Science 2023-01-10 A. Seza Doğruöz , Sunayana Sitaram , Barbara E. Bullock , Almeida Jacqueline Toribio

Code-switching is a widespread practice among the world's multilingual majority, yet few benchmarks accurately reflect its complexity in everyday communication. We present PingPong, a benchmark for natural multi-party code-switching…

In contrast to many decades of research on oral code-switching, the study of written multilingual productions has only recently enjoyed a surge of interest. Many open questions remain regarding the sociolinguistic underpinnings of written…

Computation and Language · Computer Science 2019-09-02 Ella Rabinovich , Masih Sultani , Suzanne Stevenson

Code-switching, the interleaving of two or more languages within a sentence or discourse is pervasive in multilingual societies. Accurate language models for code-switched text are critical for NLP tasks. State-of-the-art data-intensive…

Computation and Language · Computer Science 2019-06-24 Bidisha Samanta , Sharmila Reddy , Hussain Jagirdar , Niloy Ganguly , Soumen Chakrabarti

Code-switching (CS) refers to a linguistic phenomenon where a speaker uses different languages in an utterance or between alternating utterances. In this work, we study end-to-end (E2E) approaches to the Mandarin-English code-switching…

Computation and Language · Computer Science 2019-07-12 Zhiping Zeng , Yerbolat Khassanov , Van Tung Pham , Haihua Xu , Eng Siong Chng , Haizhou Li

Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to…

Computation and Language · Computer Science 2021-07-15 Ishan Tarunesh , Syamantak Kumar , Preethi Jyothi

Code-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP community that the application of…

Computation and Language · Computer Science 2018-04-25 Irshad Ahmad Bhat , Riyaz Ahmad Bhat , Manish Shrivastava , Dipti Misra Sharma

Code-switching (CS) occurs when a speaker alternates words of two or more languages within a single sentence or across sentences. Automatic speech recognition (ASR) of CS speech has to deal with two or more languages at the same time. In…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-19 Xinyuan Zhou , Emre Yılmaz , Yanhua Long , Yijie Li , Haizhou Li

An increasing number of people in the world today speak a mixed-language as a result of being multilingual. However, building a speech recognition system for code-switching remains difficult due to the availability of limited resources and…

Computation and Language · Computer Science 2020-04-30 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Peng Xu , Pascale Fung