English
Related papers

Related papers: CoLI-Machine Learning Approaches for Code-mixed La…

200 papers

Language Identification (LID) is a core task in multilingual NLP, yet current systems often overfit to clean, monolingual data. This work introduces DIVERS-BENCH, a comprehensive evaluation of state-of-the-art LID models across diverse…

Computation and Language · Computer Science 2025-09-23 Jessica Ojo , Zina Kamel , David Ifeoluwa Adelani

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non-homogeneous characteristics. Significantly, the language identification in a multilingual document is…

Computation and Language · Computer Science 2021-06-30 M Zeeshan Ansari , Tanvir Ahmad , M M Sufyan Beg , Asma Ikram

The rapid expansion in the usage of social media networking sites leads to a huge amount of unprocessed user generated data which can be used for text mining. Author profiling is the problem of automatically determining profiling aspects…

Computation and Language · Computer Science 2018-06-15 Ankush Khandelwal , Sahil Swami , Syed Sarfaraz Akhtar , Manish Shrivastava

An accurate language identification tool is an absolute necessity for building complex NLP systems to be used on code-mixed data. Lot of work has been recently done on the same, but there's still room for improvement. Inspired from the…

Computation and Language · Computer Science 2018-08-23 Soumil Mandal , Anil Kumar Singh

Sentiment Analysis for Indian Languages (SAIL)-Code Mixed tools contest aimed at identifying the sentence level sentiment polarity of the code-mixed dataset of Indian languages pairs (Hi-En, Ben-Hi-En). Hi-En dataset is henceforth referred…

Computation and Language · Computer Science 2018-08-13 Pruthwik Mishra , Prathyusha Danda , Pranav Dhakras

Complex Word Identification (CWI) is the task of identifying which words or phrases in a sentence are difficult to understand by a target audience. The latest CWI Shared Task released data for two settings: monolingual (i.e. train and test…

Computation and Language · Computer Science 2019-04-15 Pierre Finnimore , Elisabeth Fritzsch , Daniel King , Alison Sneyd , Aneeq Ur Rehman , Fernando Alva-Manchego , Andreas Vlachos

Sentiment analysis is essential in many real-world applications such as stance detection, review analysis, recommendation system, and so on. Sentiment analysis becomes more difficult when the data is noisy and collected from social media.…

Computation and Language · Computer Science 2018-03-20 Braja Gopal Patra , Dipankar Das , Amitava Das

Natural Language Inference (NLI) is a fundamental task in natural language processing. While NLI has developed many sub-directions such as sentence-level NLI, document-level NLI and cross-lingual NLI, Cross-Document Cross-Lingual NLI…

Computation and Language · Computer Science 2025-10-08 Mengying Yuan , Wenhao Wang , Zixuan Wang , Yujie Huang , Kangli Wei , Fei Li , Chong Teng , Donghong Ji

State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models. These models are generally trained on data in a single language (usually English), and cannot be directly used…

Computation and Language · Computer Science 2018-09-14 Alexis Conneau , Guillaume Lample , Ruty Rinott , Adina Williams , Samuel R. Bowman , Holger Schwenk , Veselin Stoyanov

Language identification (LI) is the problem of determining the natural language that a document or part thereof is written in. Automatic LI has been extensively researched for over fifty years. Today, LI is a key part of many text…

Computation and Language · Computer Science 2018-11-22 Tommi Jauhiainen , Marco Lui , Marcos Zampieri , Timothy Baldwin , Krister Lindén

This paper presents CoLLIE: a simple, yet effective model for continual learning of how language is grounded in vision. Given a pre-trained multimodal embedding model, where language and images are projected in the same semantic space (in…

Computation and Language · Computer Science 2022-07-12 Gabriel Skantze , Bram Willemsen

The tremendous amount of user generated data through social networking sites led to the gaining popularity of automatic text classification in the field of computational linguistics over the past decade. Within this domain, one problem that…

Computation and Language · Computer Science 2018-06-15 Ankush Khandelwal , Sahil Swami , Syed S. Akhtar , Manish Shrivastava

Language Identification (LID) systems are used to classify the spoken language from a given audio sample and are typically the first step for many spoken language processing tasks, such as Automatic Speech Recognition (ASR) systems. Without…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Christian Bartz , Tom Herold , Haojin Yang , Christoph Meinel

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the…

Computation and Language · Computer Science 2016-11-03 Ameya Prabhu , Aditya Joshi , Manish Shrivastava , Vasudeva Varma

Language Identification (LID) is a challenging task, especially when the input texts are short and noisy such as posts and statuses on social media or chat logs on gaming forums. The task has been tackled by either designing a feature set…

Computation and Language · Computer Science 2019-10-16 Duy Tin Vo , Richard Khoury

Multilingual Large Language Models (LLMs) develop cross-lingual abilities despite being trained on limited parallel data. However, they often struggle to generate responses in the intended language, favoring high-resource languages such as…

Computation and Language · Computer Science 2025-06-02 Elnaz Rahmati , Alireza S. Ziabari , Morteza Dehghani

Code-mixing is a phenomenon which arises mainly in multilingual societies. Multilingual people, who are well versed in their native languages and also English speakers, tend to code-mix using English-based phonetic typing and the insertion…

Computation and Language · Computer Science 2020-09-03 Avishek Garain , Sainik Kumar Mahata , Dipankar Das

The term "Code Mixed" refers to the use of more than one language in the same text. This phenomenon is predominantly observed on social media platforms, with an increasing amount of adaptation as time goes on. It is critical to detect…

Computation and Language · Computer Science 2023-05-29 Aryan Patil , Varad Patwardhan , Abhishek Phaltankar , Gauri Takawane , Raviraj Joshi

More than 2 billion mobile users worldwide type in multiple languages in the soft keyboard. On a monolingual keyboard, 38% of falsely auto-corrected words are valid in another language. This can be easily avoided by detecting the language…

Computation and Language · Computer Science 2021-01-12 Sourabh Vasant Gothe , Sourav Ghosh , Sharmila Mani , Guggilla Bhanodai , Ankur Agarwal , Chandramouli Sanchi