English
Related papers

Related papers: Harnessing Code Switching to Transcend the Linguis…

200 papers

Large language models (LLMs) are being deployed across the Global South, where everyday use involves low-resource languages, code-mixing, and culturally specific norms. Yet safety pipelines, benchmarks, and alignment still largely target…

Computation and Language · Computer Science 2026-02-17 Somnath Banerjee , Rima Hazra , Animesh Mukherjee

Multilingual transformer language models have recently attracted much attention from researchers and are used in cross-lingual transfer learning for many NLP tasks such as text classification and named entity recognition. However, similar…

Computation and Language · Computer Science 2022-10-27 Sudhanshu Ranjan , Dheeraj Mekala , Jingbo Shang

Many multilingual communities, including numerous in Africa, frequently engage in code-switching during conversations. This behaviour stresses the need for natural language processing technologies adept at processing code-switched text.…

Computation and Language · Computer Science 2024-04-29 Michelle Terblanche , Kayode Olaleye , Vukosi Marivate

An evaluation metric is an absolute necessity for measuring the performance of any system and complexity of any data. In this paper, we have discussed how to determine the level of complexity of code-mixed social media texts that are…

Computation and Language · Computer Science 2017-07-06 Souvick Ghosh , Satanu Ghosh , Dipankar Das

To tackle the conundrum of detecting offensive comments/posts which are considerably informal, unstructured, miswritten and code-mixed, we introduce two inventive methods in this research paper. Offensive comments/posts on the social media…

The extensive rise in consumption of online social media (OSMs) by a large number of people poses a critical problem of curbing the spread of hateful content on these platforms. With the growing usage of OSMs in multiple languages, the task…

In contrast to many decades of research on oral code-switching, the study of written multilingual productions has only recently enjoyed a surge of interest. Many open questions remain regarding the sociolinguistic underpinnings of written…

Computation and Language · Computer Science 2019-09-02 Ella Rabinovich , Masih Sultani , Suzanne Stevenson

Code-Switching (CS) is a common linguistic phenomenon in multilingual communities that consists of switching between languages while speaking. This paper presents our investigations on end-to-end speech recognition for Mandarin-English CS…

Computation and Language · Computer Science 2021-12-21 Chia-Yu Li , Ngoc Thang Vu

Between February 14, 2019 and March 4, 2019, a terrorist attack in Pulwama, Kashmir followed by retaliatory airstrikes led to rising tensions between India and Pakistan, two nuclear-armed countries. In this work, we examine polarizing…

Social and Information Networks · Computer Science 2020-07-30 Aman Tyagi , Anjalie Field , Priyank Lathwal , Yulia Tsvetkov , Kathleen M. Carley

Cutting-edge LLMs have emerged as powerful tools for multilingual communication and understanding. However, LLMs perform worse in Common Sense Reasoning (CSR) tasks when prompted in low-resource languages (LRLs) like Hindi or Swahili…

Computation and Language · Computer Science 2025-08-19 Tanay Nagar , Grigorii Khvatskii , Anna Sokol , Nitesh V. Chawla

Sentiment Analysis and other semantic tasks are commonly used for social media textual analysis to gauge public opinion and make sense from the noise on social media. The language used on social media not only commonly diverges from the…

Computation and Language · Computer Science 2019-06-19 Anirudh Dahiya , Neeraj Battan , Manish Shrivastava , Dipti Mishra Sharma

Multilingual speakers often switch between languages to express themselves on social communication platforms. Sometimes, the original script of the language is preserved, while using a common script for all the languages is quite popular as…

Computation and Language · Computer Science 2018-03-19 Soumil Mandal , Dipankar Das

Code-mixing is a well-studied linguistic phenomenon that occurs when two or more languages are mixed in text or speech. Several studies have been conducted on building datasets and performing downstream NLP tasks on code-mixed data.…

Computation and Language · Computer Science 2024-05-14 Nishat Raihan , Dhiman Goswami , Antara Mahmud , Antonios Anastasopoulos , Marcos Zampieri

The text generated on social media platforms is essentially a mixed lingual text. The mixing of language in any form produces considerable amount of difficulty in language processing systems. Moreover, the advancements in language…

Information Retrieval · Computer Science 2018-10-09 Mohd Zeeshan Ansari , Tanvir Ahmad , Md Arshad Ali

In this work, we present a simple and elegant approach to language modeling for bilingual code-switched text. Since code-switching is a blend of two or more different languages, a standard bilingual language model can be improved upon by…

Computation and Language · Computer Science 2018-08-06 Saurabh Garg , Tanmay Parekh , Preethi Jyothi

Code-switching is a pervasive phenomenon in multilingual communication, yet the robustness of large language models (LLMs) in mixed-language settings remains insufficiently understood. In this work, we present a comprehensive evaluation of…

This paper addresses challenges of Natural Language Processing (NLP) on non-canonical multilingual data in which two or more languages are mixed. It refers to code-switching which has become more popular in our daily life and therefore…

Computation and Language · Computer Science 2016-10-10 Özlem Çetinoğlu , Sarah Schulz , Ngoc Thang Vu

Culture moderates the way individuals perceive and express mental distress. Current understandings of mental health expressions on social media, however, are predominantly derived from WEIRD (Western, Educated, Industrialized, Rich, and…

Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to…

Computation and Language · Computer Science 2021-07-15 Ishan Tarunesh , Syamantak Kumar , Preethi Jyothi

Language representations are efficient tools used across NLP applications, but they are strife with encoded societal biases. These biases are studied extensively, but with a primary focus on English language representations and biases…

Computation and Language · Computer Science 2022-05-10 Vijit Malik , Sunipa Dev , Akihiro Nishi , Nanyun Peng , Kai-Wei Chang