English
Related papers

Related papers: Share What You Already Know: Cross-Language-Script…

200 papers

Language Identification (LID) is a core task in multilingual NLP, yet current systems often overfit to clean, monolingual data. This work introduces DIVERS-BENCH, a comprehensive evaluation of state-of-the-art LID models across diverse…

Computation and Language · Computer Science 2025-09-23 Jessica Ojo , Zina Kamel , David Ifeoluwa Adelani

Unsupervised cross-lingual transfer involves transferring knowledge between languages without explicit supervision. Although numerous studies have been conducted to improve performance in such tasks by focusing on cross-lingual knowledge,…

Computation and Language · Computer Science 2024-04-26 Jianyu Zheng , Fengfei Fan , Jianquan Li

The tremendous amount of user generated data through social networking sites led to the gaining popularity of automatic text classification in the field of computational linguistics over the past decade. Within this domain, one problem that…

Computation and Language · Computer Science 2018-06-15 Ankush Khandelwal , Sahil Swami , Syed S. Akhtar , Manish Shrivastava

Developers are increasingly sharing images in social coding environments alongside the growth in visual interactions within social networks. The analysis of the ratio between the textual and visual content of Mozilla's change requests and…

Software Engineering · Computer Science 2020-01-20 Maleknaz Nayebi

Language identification for code-switching (CS), the phenomenon of alternating between two or more languages in conversations, has traditionally been approached under the assumption of a single language per token. However, if at least one…

Computation and Language · Computer Science 2019-04-04 Manuel Mager , Özlem Çetinoğlu , Katharina Kann

Recently, large pre-trained multilingual speech models have shown potential in scaling Automatic Speech Recognition (ASR) to many low-resource languages. Some of these models employ language adapters in their formulation, which helps to…

Computation and Language · Computer Science 2023-10-12 Atharva Kulkarni , Ajinkya Kulkarni , Miguel Couceiro , Hanan Aldarmaki

Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages. While today's neural end-to-end (E2E) models deliver state-of-the-art performances on the task of automatic speech…

Computation and Language · Computer Science 2023-07-04 Enes Yavuz Ugan , Christian Huber , Juan Hussain , Alexander Waibel

Code-Mixed text data consists of sentences having words or phrases from more than one language. Most multi-lingual communities worldwide communicate using multiple languages, with English usually one of them. Hinglish is a Code-Mixed text…

Computation and Language · Computer Science 2022-06-20 Shaz Furniturewala , Vijay Kumari , Amulya Ratna Dash , Hriday Kedia , Yashvardhan Sharma

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

Code-switching is the communication phenomenon where speakers switch between different languages during a conversation. With the widespread adoption of conversational agents and chat platforms, code-switching has become an integral part of…

Emotion classification is a challenging task in NLP due to the inherent idiosyncratic and subjective nature of linguistic expression, especially with code-mixed data. Pre-trained language models (PLMs) have achieved high performance for…

Computation and Language · Computer Science 2024-02-06 Kushal Tatariya , Heather Lent , Johannes Bjerva , Miryam de Lhoneux

Code switching (CS) is a very common phenomenon in written and spoken communication but one that is handled poorly by many natural language processing applications. Looking to the application of building CS corpora, we explore CS language…

Computation and Language · Computer Science 2024-02-05 Laurie Burchell , Alexandra Birch , Robert P. Thompson , Kenneth Heafield

In this paper, we propose efficient and less resource-intensive strategies for parsing of code-mixed data. These strategies are not constrained by in-domain annotations, rather they leverage pre-existing monolingual annotated resources for…

Computation and Language · Computer Science 2017-04-03 Irshad Ahmad Bhat , Riyaz Ahmad Bhat , Manish Shrivastava , Dipti Misra Sharma

Multilingual language models have shown decent performance in multilingual and cross-lingual natural language understanding tasks. However, the power of these multilingual models in code-switching tasks has not been fully explored. In this…

Computation and Language · Computer Science 2021-03-25 Genta Indra Winata , Samuel Cahyawijaya , Zihan Liu , Zhaojiang Lin , Andrea Madotto , Pascale Fung

It is now established that modern neural language models can be successfully trained on multiple languages simultaneously without changes to the underlying architecture. But what kind of knowledge is really shared among languages within…

Computation and Language · Computer Science 2021-04-15 Prajit Dhar , Arianna Bisazza

NLP applications for code-mixed (CM) or mix-lingual text have gained a significant momentum recently, the main reason being the prevalence of language mixing in social media communications in multi-lingual societies like India, Mexico,…

Computation and Language · Computer Science 2021-11-15 Mohsin Ali , Kandukuri Sai Teja , Sumanth Manduru , Parth Patwa , Amitava Das

Being a popular mode of text-based communication in multilingual communities, code-mixing in online social media has became an important subject to study. Learning the semantics and morphology of code-mixed language remains a key challenge,…

Computation and Language · Computer Science 2022-04-28 Ayan Sengupta , Tharun Suresh , Md Shad Akhtar , Tanmoy Chakraborty

Using code-mixed data in natural language processing (NLP) research currently gets a lot of attention. Language identification of social media code-mixed text has been an interesting problem of study in recent years due to the advancement…

Computation and Language · Computer Science 2022-11-29 Atnafu Lambebo Tonja , Mesay Gemeda Yigezu , Olga Kolesnikova , Moein Shahiki Tash , Grigori Sidorov , Alexander Gelbuk

Semantic Retrieval (SR) has become an indispensable part of the FAQ system in the task-oriented question-answering (QA) dialogue scenario. The demands for a cross-lingual smart-customer-service system for an e-commerce platform or some…

Computation and Language · Computer Science 2025-07-11 Mieradilijiang Maimaiti , Yuanhang Zheng , Ji Zhang , Yue Zhang , Wenpei Luo , Kaiyu Huang

An important and difficult task in code-switched speech recognition is to recognize the language, as lots of words in two languages can sound similar, especially in some accents. We focus on improving performance of end-to-end Automatic…

Computation and Language · Computer Science 2024-03-14 Yash Sharma , Basil Abraham , Preethi Jyothi