English
Related papers

Related papers: Code-Switching Information Retrieval: Benchmarks, …

200 papers

Cutting-edge LLMs have emerged as powerful tools for multilingual communication and understanding. However, LLMs perform worse in Common Sense Reasoning (CSR) tasks when prompted in low-resource languages (LRLs) like Hindi or Swahili…

Computation and Language · Computer Science 2025-08-19 Tanay Nagar , Grigorii Khvatskii , Anna Sokol , Nitesh V. Chawla

Training multilingual automatic speech recognition (ASR) systems is challenging because acoustic and lexical information is typically language specific. Training multilingual system for Indic languages is even more tougher due to lack of…

Computation and Language · Computer Science 2022-06-14 Harveen Singh Chadha , Priyanshi Shah , Ankur Dhuriya , Neeraj Chhimwal , Anirudh Gupta , Vivek Raghavan

Code-switching (CS) poses a significant challenge for Large Language Models (LLMs), yet its comprehensibility remains underexplored in LLMs. We introduce CS-Sum, to evaluate the comprehensibility of CS by the LLMs through CS dialogue to…

Computation and Language · Computer Science 2025-05-21 Sathya Krishnan Suresh , Tanmay Surana , Lim Zhi Hao , Eng Siong Chng

Recently, there is increasing interest in multilingual automatic speech recognition (ASR) where a speech recognition system caters to multiple low resource languages by taking advantage of low amounts of labeled corpora in multiple…

In recent years, end-to-end speech recognition has emerged as a technology that integrates the acoustic, pronunciation dictionary, and language model components of the traditional Automatic Speech Recognition model. It is possible to…

Computation and Language · Computer Science 2023-12-18 Tzu-Ting Yang , Hsin-Wei Wang , Berlin Chen

The pervasiveness of intra-utterance code-switching (CS) in spoken content requires that speech recognition (ASR) systems handle mixed language. Designing a CS-ASR system has many challenges, mainly due to data scarcity, grammatical…

Computation and Language · Computer Science 2023-01-12 Amir Hussein , Shammur Absar Chowdhury , Ahmed Abdelali , Najim Dehak , Ahmed Ali , Sanjeev Khudanpur

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

Computation and Language · Computer Science 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

Code-switching is a data augmentation scheme mixing words from multiple languages into source lingual text. It has achieved considerable generalization performance of cross-lingual transfer tasks by aligning cross-lingual contextual word…

Computation and Language · Computer Science 2024-06-21 Zhuoran Li , Chunming Hu , Junfan Chen , Zhijun Chen , Xiaohui Guo , Richong Zhang

Code-switching (CS) refers to a linguistic phenomenon where a speaker uses different languages in an utterance or between alternating utterances. In this work, we study end-to-end (E2E) approaches to the Mandarin-English code-switching…

Computation and Language · Computer Science 2019-07-12 Zhiping Zeng , Yerbolat Khassanov , Van Tung Pham , Haihua Xu , Eng Siong Chng , Haizhou Li

Recently, there has been significant progress made in Automatic Speech Recognition (ASR) of code-switched speech, leading to gains in accuracy on code-switched datasets in many language pairs. Code-switched speech co-occurs with monolingual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Sanket Shah , Basil Abraham , Gurunath Reddy M , Sunayana Sitaram , Vikas Joshi

We live in a world where 60% of the population can speak two or more languages fluently. Members of these communities constantly switch between languages when having a conversation. As automatic speech recognition (ASR) systems are being…

Computation and Language · Computer Science 2021-02-16 Siddharth Dalmia , Yuzong Liu , Srikanth Ronanki , Katrin Kirchhoff

Code-switching (CS) is a common phenomenon and recognizing CS speech is challenging. But CS speech data is scarce and there' s no common testbed in relevant research. This paper describes the design and main outcomes of the ASRU 2019…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Xian Shi , Qiangze Feng , Lei Xie

Multi-condition information retrieval (IR) presents a significant, yet underexplored challenge for existing systems. This paper introduces MultiConIR, a benchmark specifically designed to evaluate retrieval and reranking models under…

Information Retrieval · Computer Science 2025-09-05 Xuan Lu , Sifan Liu , Bochao Yin , Yongqi Li , Xinghao Chen , Hui Su , Yaohui Jin , Wenjun Zeng , Xiaoyu Shen

Code-switching (CS) is a widespread phenomenon among bilingual and multilingual societies. The lack of CS resources hinders the performance of many NLP tasks. In this work, we explore the potential use of bilingual word embeddings for…

Computation and Language · Computer Science 2019-09-25 Injy Hamed , Moritz Zhu , Mohamed Elmahdy , Slim Abdennadher , Ngoc Thang Vu

Code-switching automatic speech recognition becomes one of the most challenging and the most valuable scenarios of automatic speech recognition, due to the code-switching phenomenon between multilingual language and the frequent occurrence…

Computation and Language · Computer Science 2022-10-14 Shuhao Deng , Chengfei Li , Jinfeng Bai , Qingqing Zhang , Wei-Qiang Zhang , Runyan Yang , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

Large language models (LLMs) now exhibit near human-level performance in various tasks, but their performance drops drastically after a handful of high-resource languages due to the imbalance in pre-training data. Inspired by the human…

Computation and Language · Computer Science 2025-06-12 Haneul Yoo , Cheonbok Park , Sangdoo Yun , Alice Oh , Hwaran Lee

Code-mixing, the practice of switching between languages within a conversation, poses unique challenges for traditional NLP. Existing benchmarks are limited by their narrow language pairs and tasks, failing to adequately assess large…

Computation and Language · Computer Science 2025-09-09 Yilun Yang , Yekun Chai

Recent studies proposed to leverage large language models (LLMs) with In-Context Learning (ICL) to handle code intelligence tasks without fine-tuning. ICL employs task instructions and a set of examples as demonstrations to guide the model…

Software Engineering · Computer Science 2024-10-16 Jiawei Lu , Haoye Wang , Zhongxin Liu , Keyu Liang , Lingfeng Bao , Xiaohu Yang

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existing pipelines often…

Information Retrieval · Computer Science 2025-11-25 Roksana Goworek , Olivia Macmillan-Scott , Eda B. Özyiğit

We introduce a new zero resource code-switched speech benchmark designed to directly assess the code-switching capabilities of self-supervised speech encoders. We showcase a baseline system of language modeling on discrete units to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-19 Kuan-Po Huang , Chih-Kai Yang , Yu-Kuan Fu , Ewan Dunbar , Hung-yi Lee