English
Related papers

Related papers: Comparative Study of Pre-Trained BERT Models for C…

200 papers

Multilingual transformer language models have recently attracted much attention from researchers and are used in cross-lingual transfer learning for many NLP tasks such as text classification and named entity recognition. However, similar…

Computation and Language · Computer Science 2022-10-27 Sudhanshu Ranjan , Dheeraj Mekala , Jingbo Shang

Multilingual BERT (mBERT) trained on 104 languages has shown surprisingly good cross-lingual performance on several NLP tasks, even without explicit cross-lingual signals. However, these evaluations have focused on cross-lingual transfer…

Computation and Language · Computer Science 2020-10-02 Shijie Wu , Mark Dredze

Automated hate speech detection in social media is a challenging task that has recently gained significant traction in the data mining and Natural Language Processing community. However, most of the existing methods adopt a supervised…

Computation and Language · Computer Science 2021-03-23 Md Rabiul Awal , Rui Cao , Roy Ka-Wei Lee , Sandra Mitrovic

Code-switching (CS), a ubiquitous phenomenon due to the ease of communication it offers in multilingual communities still remains an understudied problem in language processing. The primary reasons behind this are: (1) minimal efforts in…

Computation and Language · Computer Science 2021-11-03 Parul Chopra , Sai Krishna Rallabandi , Alan W Black , Khyathi Raghavi Chandu

In recent studies, it has been shown that Multilingual language models underperform their monolingual counterparts. It is also a well-known fact that training and maintaining monolingual models for each language is a costly and…

Computation and Language · Computer Science 2021-02-24 Usama Khalid , Mirza Omer Beg , Muhammad Umair Arshad

The integration of pretrained language models (PLMs) like BERT and GPT has revolutionized NLP, particularly for English, but it has also created linguistic imbalances. This paper strategically identifies the need for linguistic equity by…

Computation and Language · Computer Science 2025-03-19 Somnath Banerjee , Avik Halder , Rajarshi Mandal , Sayan Layek , Ian Soboroff , Rima Hazra , Animesh Mukherjee

Recent work has shown the surprising ability of multi-lingual BERT to serve as a zero-shot cross-lingual transfer model for a number of language processing tasks. We combine this finding with a similarly-recently proposal on sentence-level…

Information Retrieval · Computer Science 2019-11-11 Peng Shi , Jimmy Lin

BERT (Bidirectional Encoder Representations from Transformers) and ALBERT (A Lite BERT) are methods for pre-training language models which can later be fine-tuned for a variety of Natural Language Understanding tasks. These methods have…

Computation and Language · Computer Science 2020-07-21 Diego de Vargas Feijo , Viviane Pereira Moreira

Sentiment Analysis for Indian Languages (SAIL)-Code Mixed tools contest aimed at identifying the sentence level sentiment polarity of the code-mixed dataset of Indian languages pairs (Hi-En, Ben-Hi-En). Hi-En dataset is henceforth referred…

Computation and Language · Computer Science 2018-08-13 Pruthwik Mishra , Prathyusha Danda , Pranav Dhakras

This paper discusses the results obtained for different techniques applied for performing the sentiment analysis of social media (Twitter) code-mixed text written in Hinglish. The various stages involved in performing the sentiment analysis…

Computation and Language · Computer Science 2021-02-25 Gaurav Singh

Multilingual writers and speakers often alternate between two languages in a single discourse, a practice called "code-switching". Existing sentiment detection methods are usually trained on sentiment-labeled monolingual text. Manually…

Computation and Language · Computer Science 2019-06-14 Bidisha Samanta , Niloy Ganguly , Soumen Chakrabarti

Code-mixing (CM), where speakers blend languages within a single expression, is prevalent in multilingual societies but poses challenges for natural language processing due to its complexity and limited data. We propose using a large…

Computation and Language · Computer Science 2025-10-28 Linda Zeng

Code-switching is a common phenomenon among people with diverse lingual background and is widely used on the internet for communication purposes. In this paper, we present a Recurrent Neural Network combined with the Attention Model for…

Computation and Language · Computer Science 2021-03-04 Aizaz Hussain , Muhammad Umair Arshad

While topic modeling in English has become a prevalent and well-explored area, venturing into topic modeling for Indic languages remains relatively rare. The limited availability of resources, diverse linguistic structures, and unique…

Computation and Language · Computer Science 2025-02-05 Sanket Shinde , Raviraj Joshi

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

Computation and Language · Computer Science 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

Large Language Models (LLMs) have shown remarkable capabilities, but their development has primarily focused on English and other high-resource languages, leaving many languages underserved. We present our latest Hindi-English bi-lingual…

Natural Language Inference (NLI) is the task of inferring the logical relationship, typically entailment or contradiction, between a premise and hypothesis. Code-mixing is the use of more than one language in the same conversation or…

Computation and Language · Computer Science 2020-04-14 Simran Khanuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Wide usage of social media platforms has increased the risk of aggression, which results in mental stress and affects the lives of people negatively like psychological agony, fighting behavior, and disrespect to others. Majority of such…

Computation and Language · Computer Science 2020-01-22 Anant Khandelwal , Niraj Kumar

Contextual pretrained language models, such as BERT (Devlin et al., 2019), have made significant breakthrough in various NLP tasks by training on large scale of unlabeled text re-sources.Financial sector also accumulates large amount of…

Computation and Language · Computer Science 2020-07-10 Yi Yang , Mark Christopher Siy UY , Allen Huang

Pre-trained models of code built on the transformer architecture have performed well on software engineering (SE) tasks such as predictive code generation, code summarization, among others. However, whether the vector representations from…

Software Engineering · Computer Science 2021-08-26 Anjan Karmakar , Romain Robbes