English
Related papers

Related papers: IndoRobusta: Towards Robustness Against Diverse Co…

200 papers

Multilingual large language models (LLMs) are increasingly deployed in linguistically diverse regions like India, yet most interpretability tools remain tailored to English. Prior work reveals that LLMs often operate in English centric…

Computation and Language · Computer Science 2026-02-19 Mihir Panchal , Deeksha Varshney , Mamta , Asif Ekbal

Bengali is an underrepresented language in NLP research. However, it remains a challenge due to its unique linguistic structure and computational constraints. In this work, we systematically investigate the challenges that hinder Bengali…

Computation and Language · Computer Science 2025-08-01 Shimanto Bhowmik , Tawsif Tashwar Dipto , Md Sazzad Islam , Sheryl Hsu , Tahsin Reasat

Safety alignment of large language models (LLMs) is mostly evaluated in English and contract-bound, leaving multilingual vulnerabilities understudied. We introduce \textbf{Indic Jailbreak Robustness (IJR)}, a judge-free benchmark for…

Artificial Intelligence · Computer Science 2026-02-20 Priyaranjan Pattnayak , Sanchari Chowdhuri

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

Computation and Language · Computer Science 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

Code-mixing is a frequent communication style among multilingual speakers where they mix words and phrases from two different languages in the same utterance of text or speech. Identifying and filtering code-mixed text is a challenging task…

Computation and Language · Computer Science 2021-06-21 Vivek Srivastava , Mayank Singh

The term "Code Mixed" refers to the use of more than one language in the same text. This phenomenon is predominantly observed on social media platforms, with an increasing amount of adaptation as time goes on. It is critical to detect…

Computation and Language · Computer Science 2023-05-29 Aryan Patil , Varad Patwardhan , Abhishek Phaltankar , Gauri Takawane , Raviraj Joshi

This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date…

Computation and Language · Computer Science 2023-10-23 Ashok Urlana , Pinzhen Chen , Zheng Zhao , Shay B. Cohen , Manish Shrivastava , Barry Haddow

Code-mixing is the phenomenon of using more than one language in a sentence. It is a very frequently observed pattern of communication on social media platforms. Flexibility to use multiple languages in one text message might help to…

Computation and Language · Computer Science 2020-04-21 Vivek Srivastava , Mayank Singh

NLP applications for code-mixed (CM) or mix-lingual text have gained a significant momentum recently, the main reason being the prevalence of language mixing in social media communications in multi-lingual societies like India, Mexico,…

Computation and Language · Computer Science 2021-11-15 Mohsin Ali , Kandukuri Sai Teja , Sumanth Manduru , Parth Patwa , Amitava Das

Even though over seven hundred ethnic languages are spoken in Indonesia, the available technology remains limited that could support communication within indigenous communities as well as with people outside the villages. As a result,…

Computation and Language · Computer Science 2020-11-05 Sashi Novitasari , Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Motivation. Large language models (LLMs) have exhibited remarkable proficiency in diverse software engineering (SE) tasks. Handling such tasks typically involves acquiring foundational coding knowledge on large, general-purpose datasets…

Software Engineering · Computer Science 2024-08-02 José Antonio Hernández López , Boqi Chen , Mootez Saaz , Tushar Sharma , Dániel Varró

Hate detection has long been a challenging task for the NLP community. The task becomes complex in a code-mixed environment because the models must understand the context and the hate expressed through language alteration. Compared to the…

Computation and Language · Computer Science 2024-10-22 Debajyoti Mazumder , Aakash Kumar , Jasabanta Patro

Large language models have exhibited significant proficiency in languages endowed with extensive linguistic resources, such as English and Chinese. Nevertheless, their effectiveness notably diminishes when applied to languages characterized…

Computation and Language · Computer Science 2024-04-16 Sophia Maria

Building Natural Language Understanding (NLU) capabilities for Indic languages, which have a collective speaker base of more than one billion speakers is absolutely crucial. In this work, we aim to improve the NLU capabilities of Indic…

Computation and Language · Computer Science 2023-05-25 Sumanth Doddapaneni , Rahul Aralikatte , Gowtham Ramesh , Shreya Goyal , Mitesh M. Khapra , Anoop Kunchukuttan , Pratyush Kumar

In this work, we present an extensive study of statistical machine translation involving languages of the Indian subcontinent. These languages are related by genetic and contact relationships. We describe the similarities between Indic…

Computation and Language · Computer Science 2020-03-20 Anoop Kunchukuttan , Pushpak Bhattacharyya

Code-switching is a widespread practice among the world's multilingual majority, yet few benchmarks accurately reflect its complexity in everyday communication. We present PingPong, a benchmark for natural multi-party code-switching…

Recent advances in Unsupervised Neural Machine Translation (UNMT) have minimized the gap between supervised and unsupervised machine translation performance for closely related language pairs. However, the situation is very different for…

Computation and Language · Computer Science 2021-06-10 Tamali Banerjee , Rudra Murthy , Pushpak Bhattacharyya

Evaluations of Large Language Models (LLMs) often overlook intersectional and culturally specific biases, particularly in underrepresented multilingual regions like South Asia. This work addresses these gaps by conducting a multilingual and…

Computation and Language · Computer Science 2026-05-07 Mamnuya Rinki , Chahat Raj , Anjishnu Mukherjee , Ziwei Zhu

Multilingual language models (LMs) promise broader NLP access, yet current systems deliver uneven performance across the world's languages. This survey examines why these gaps persist and whether they reflect intrinsic linguistic difficulty…

Computation and Language · Computer Science 2026-04-13 Chen Shani , Yuval Reif , Nathan Roll , Dan Jurafsky , Ekaterina Shutova

Previous work in Indonesian part-of-speech (POS) tagging are hard to compare as they are not evaluated on a common dataset. Furthermore, in spite of the success of neural network models for English POS tagging, they are rarely explored for…

Computation and Language · Computer Science 2019-02-27 Kemal Kurniawan , Alham Fikri Aji