English
Related papers

Related papers: Mono vs Multilingual BERT for Hate Speech Detectio…

200 papers

The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content…

Computation and Language · Computer Science 2023-02-20 Khouloud Mnassri , Praboda Rajapaksha , Reza Farahbakhsh , Noel Crespi

Pre-training large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. Although this method has proven to be effective for many domains, it might not always provide desirable…

Computation and Language · Computer Science 2022-12-13 Omkar Gokhale , Aditya Kane , Shantanu Patankar , Tanmay Chavan , Raviraj Joshi

In the day and age of social media, users have become prone to online hate speech. Several attempts have been made to classify hate speech using machine learning but the state-of-the-art models are not robust enough for practical…

Computation and Language · Computer Science 2021-08-03 Tashvik Dhamija , Anjum , Rahul Katarya

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of effort in the…

Computation and Language · Computer Science 2021-11-03 Hind Saleh , Areej Alhothali , Kawthar Moria

The monolingual Hindi BERT models currently available on the model hub do not perform better than the multi-lingual models on downstream tasks. We present L3Cube-HindBERT, a Hindi BERT model pre-trained on Hindi monolingual corpus. Further,…

Computation and Language · Computer Science 2023-01-10 Raviraj Joshi

Hate speech recognition in low-resource languages remains a difficult problem due to insufficient datasets, orthographic heterogeneity, and linguistic variety. Bangla is spoken by more than 230 million people of Bangladesh and India (West…

Computation and Language · Computer Science 2025-12-03 Yalda Keivan Jafari , Krishno Dey

Numerous machine learning (ML) and deep learning (DL)-based approaches have been proposed to utilize textual data from social media for anti-social behavior analysis like cyberbullying, fake news detection, and identification of hate speech…

Computation and Language · Computer Science 2022-12-22 Md. Rezaul Karim , Sumon Kanti Dey , Tanhim Islam , Md. Shajalal , Bharathi Raja Chakravarthi

The multilingual BERT model is trained on 104 languages and meant to serve as a universal language model and tool for encoding sentences. We explore how well the model performs on several languages across several tasks: a diagnostic…

Computation and Language · Computer Science 2019-10-10 Samuel Rönnqvist , Jenna Kanerva , Tapio Salakoski , Filip Ginter

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to identify hate speech in a…

Computation and Language · Computer Science 2021-01-12 Sayar Ghosh Roy , Ujwal Narayan , Tathagata Raha , Zubair Abid , Vasudeva Varma

The multilingual Sentence-BERT (SBERT) models map different languages to common representation space and are useful for cross-language similarity and mining tasks. We propose a simple yet effective approach to convert vanilla multilingual…

Computation and Language · Computer Science 2023-04-25 Samruddhi Deode , Janhavi Gadre , Aditi Kajale , Ananya Joshi , Raviraj Joshi

Sentence representation from vanilla BERT models does not work well on sentence similarity tasks. Sentence-BERT models specifically trained on STS or NLI datasets are shown to provide state-of-the-art performance. However, building these…

Computation and Language · Computer Science 2022-11-23 Ananya Joshi , Aditi Kajale , Janhavi Gadre , Samruddhi Deode , Raviraj Joshi

The current dominance of deep neural networks in natural language processing is based on contextual embeddings such as ELMo, BERT, and BERT derivatives. Most existing work focuses on English; in contrast, we present here the first…

Computation and Language · Computer Science 2021-07-23 Matej Ulčar , Aleš Žagar , Carlos S. Armendariz , Andraž Repar , Senja Pollak , Matthew Purver , Marko Robnik-Šikonja

The proliferation of hate speech on social media necessitates automated detection systems that balance accuracy with computational efficiency. This study evaluates 38 model configurations in detecting hate speech across datasets ranging…

Computation and Language · Computer Science 2025-09-19 Mahmoud Abusaqer , Jamil Saquer , Hazim Shatnawi

Due to the sheer volume of online hate, the AI and NLP communities have started building models to detect such hateful content. Recently, multilingual hate is a major emerging challenge for automated detection where code-mixing or more than…

Computation and Language · Computer Science 2022-05-12 Mithun Das , Punyajoy Saha , Binny Mathew , Animesh Mukherjee

The usage of more than one language in the same text is referred to as Code Mixed. It is evident that there is a growing degree of adaption of the use of code-mixed data, especially English with a regional language, on social media…

Computation and Language · Computer Science 2023-06-09 Gauri Takawane , Abhishek Phaltankar , Varad Patwardhan , Aryan Patil , Raviraj Joshi , Mukta S. Takalikar

Recent researches have demonstrated that BERT shows potential in a wide range of natural language processing tasks. It is adopted as an encoder for many state-of-the-art automatic summarizing systems, which achieve excellent performance.…

Computation and Language · Computer Science 2021-10-19 Huy Quoc To , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen , Anh Gia-Tuan Nguyen

The Marathi language is one of the prominent languages used in India. It is predominantly spoken by the people of Maharashtra. Over the past decade, the usage of language on online platforms has tremendously increased. However, research on…

Computation and Language · Computer Science 2022-01-12 Atharva Kulkarni , Meet Mandhane , Manali Likhitkar , Gayatri Kshirsagar , Jayashree Jagdale , Raviraj Joshi

Academic researchers and social media entities grappling with the identification of hate speech face significant challenges, primarily due to the vast scale of data and the dynamic nature of hate speech. Given the ethical and practical…

Computation and Language · Computer Science 2024-05-08 Dengyi Liu , Minghao Wang , Andrew G. Catlin

This paper describes neural models developed for the Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages Shared Task 2021. Our team called neuro-utmn-thales participated in two tasks on binary and…

Computation and Language · Computer Science 2022-10-18 Anna Glazkova , Michael Kadantsev , Maksim Glazkov

The surge of pre-trained language models has begun a new era in the field of Natural Language Processing (NLP) by allowing us to build powerful language models. Among these models, Transformer-based models such as BERT have become…

Computation and Language · Computer Science 2021-10-12 Mehrdad Farahani , Mohammad Gharachorloo , Marzieh Farahani , Mohammad Manthouri