English
Related papers

Related papers: Comparative Study of Pre-Trained BERT Models for C…

200 papers

Manual coding of text data from open-ended questions into different categories is time consuming and expensive. Automated coding uses statistical/machine learning to train on a small subset of manually coded text answers. Recently,…

Applications · Statistics 2023-10-25 Hyukjun Gweon , Matthias Schonlau

Using code-mixed data in natural language processing (NLP) research currently gets a lot of attention. Language identification of social media code-mixed text has been an interesting problem of study in recent years due to the advancement…

Computation and Language · Computer Science 2022-11-29 Atnafu Lambebo Tonja , Mesay Gemeda Yigezu , Olga Kolesnikova , Moein Shahiki Tash , Grigori Sidorov , Alexander Gelbuk

With increasing globalization and immigration, various studies have estimated that about half of the world population is bilingual. Consequently, individuals concurrently use two or more languages or dialects in casual conversational…

Computation and Language · Computer Science 2022-11-01 Saurav K. Aryal , Howard Prioleau , Gloria Washington

The recently proposed BERT has shown great power on a variety of natural language understanding tasks, such as text classification, reading comprehension, etc. However, how to effectively apply BERT to neural machine translation (NMT) lacks…

Computation and Language · Computer Science 2020-02-18 Jinhua Zhu , Yingce Xia , Lijun Wu , Di He , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

For most languages of the world, language model pre-training operates in a data-constrained regime where models must repeat their training data many times, degrading generalization. Two remedies exist: aggressive hyperparameter tuning such…

Machine Learning · Computer Science 2026-05-14 Paul Jeha , Anastasiia Sedova , Louis Béthune , Skyler Seto , Jes Frellsen , Pierre Ablin , Natalie Schluter

In multilingual colloquial settings, it is a habitual occurrence to compose expressions of text or speech containing tokens or phrases of different languages, a phenomenon popularly known as code-switching or code-mixing (CMX). We present…

Computation and Language · Computer Science 2022-11-01 Lekan Raheem , Maab Elrashid

Multilingual language models such as mBERT have seen impressive cross-lingual transfer to a variety of languages, but many languages remain excluded from these models. In this paper, we analyse the effect of pre-training with monolingual…

Computation and Language · Computer Science 2022-08-09 Kurt Micallef , Albert Gatt , Marc Tanti , Lonneke van der Plas , Claudia Borg

Code-mixed texts are widespread nowadays due to the advent of social media. Since these texts combine two languages to formulate a sentence, it gives rise to various research problems related to Natural Language Processing. In this paper,…

Computation and Language · Computer Science 2020-07-30 Tathagata Raha , Sainik Kumar Mahata , Dipankar Das , Sivaji Bandyopadhyay

Plagiarism involves using another person's work or concepts without proper attribution, presenting them as original creations. With the growing amount of data communicated in regional languages such as Marathi -- one of India's regional…

Computation and Language · Computer Science 2025-01-10 Atharva Mutsaddi , Aditya Choudhary

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

This paper describes the system submitted to Dravidian-Codemix-HASOC2021: Hate Speech and Offensive Language Identification in Dravidian Languages (Tamil-English and Malayalam-English). This task aims to identify offensive content in…

Computation and Language · Computer Science 2021-12-08 Sean Benhur , Kanchana Sivanraju

In this study, we introduce a solution to the SemEval 2024 Task 10 on subtask 1, dedicated to Emotion Recognition in Conversation (ERC) in code-mixed Hindi-English conversations. ERC in code-mixed conversations presents unique challenges,…

Sentiment Analysis is the process of deciphering what a sentence emotes and classifying them as either positive, negative, or neutral. In recent times, India has seen a huge influx in the number of active social media users and this has led…

Computation and Language · Computer Science 2020-09-07 Subhra Jyoti Baroi , Nivedita Singh , Ringki Das , Thoudam Doren Singh

Automated offensive language detection is essential in combating the spread of hate speech, particularly in social media. This paper describes our work on Offensive Language Identification in low resource Indic language Marathi. The problem…

Computation and Language · Computer Science 2022-12-21 Tanmay Chavan , Shantanu Patankar , Aditya Kane , Omkar Gokhale , Raviraj Joshi

Offensive content is pervasive in social media and a reason for concern to companies and government organizations. Several studies have been recently published investigating methods to detect the various forms of such content (e.g. hate…

Computation and Language · Computer Science 2020-10-13 Tharindu Ranasinghe , Marcos Zampieri

In this paper, we present our work on the creation of lexical resources for the Machine Translation between English and Hindi. We describes the development of phrase pair mappings for our experiments and the comparative performance…

Computation and Language · Computer Science 2017-11-13 Sreelekha S , Pushpak Bhattacharyya

This paper enhances the study of sentiment analysis for the Central Kurdish language by integrating the Bidirectional Encoder Representations from Transformers (BERT) into Natural Language Processing techniques. Kurdish is a low-resourced…

Computation and Language · Computer Science 2025-09-23 Kozhin muhealddin Awlla , Hadi Veisi , Abdulhady Abas Abdullah

Code-mixing is a phenomenon which arises mainly in multilingual societies. Multilingual people, who are well versed in their native languages and also English speakers, tend to code-mix using English-based phonetic typing and the insertion…

Computation and Language · Computer Science 2020-09-03 Avishek Garain , Sainik Kumar Mahata , Dipankar Das

Code switching is a linguistic phenomenon that may occur within a multilingual setting where speakers share more than one language. With the increasing communication between groups with different languages, this phenomenon is more and more…

Computation and Language · Computer Science 2020-09-10 Jiaxiang Liu , Xuyi Chen , Shikun Feng , Shuohuan Wang , Xuan Ouyang , Yu Sun , Zhengjie Huang , Weiyue Su

Hate speech is considered to be one of the major issues currently plaguing online social media. Repeated and repetitive exposure to hate speech has been shown to create physiological effects on the target users. Thus, hate speech, in all…

Computation and Language · Computer Science 2021-11-30 Somnath Banerjee , Maulindu Sarkar , Nancy Agrawal , Punyajoy Saha , Mithun Das