English
Related papers

Related papers: From Universal Language Model to Downstream Task: …

200 papers

There have been remarkable breakthroughs in Machine Learning and Artificial Intelligence, notably in the areas of Natural Language Processing and Deep Learning. Additionally, hate speech detection in dialogues has been gaining popularity…

Computation and Language · Computer Science 2023-06-02 Durgesh Nandini , Ute Schmid

In the text classification problem, the imbalance of labels in datasets affect the performance of the text-classification models. Practically, the data about user comments on social networking sites not altogether appeared - the…

Computation and Language · Computer Science 2020-10-12 Son T. Luu , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

This paper evaluates data augmentation and feature enhancement techniques for hate speech detection, comparing traditional classifiers, e.g., Delta Term Frequency-Inverse Document Frequency (Delta TF-IDF), with transformer-based models…

Computation and Language · Computer Science 2026-03-06 Brian Jing Hong Nge , Stefan Su , Thanh Thi Nguyen , Campbell Wilson , Alexandra Phelan , Naomi Pfitzner

Hate speech is a widespread and harmful form of online discourse, encompassing slurs and defamatory posts that can have serious social, psychological, and sometimes physical impacts on targeted individuals and communities. As social media…

Machine Learning · Computer Science 2025-08-08 Santosh Chapagain , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Social media data is a valuable resource for research, yet it contains a wide range of non-standard words (NSW). These irregularities hinder the effective operation of NLP tools. Current state-of-the-art methods for the Vietnamese language…

Computation and Language · Computer Science 2024-07-26 Anh Thi-Hoang Nguyen , Dung Ha Nguyen , Nguyet Thi Nguyen , Khanh Thanh-Duy Ho , Kiet Van Nguyen

The goal of hate speech detection is to filter negative online content aiming at certain groups of people. Due to the easy accessibility of social media platforms it is crucial to protect everyone which requires building hate speech…

Computation and Language · Computer Science 2022-01-19 Irina Bigoulaeva , Viktor Hangya , Iryna Gurevych , Alexander Fraser

Hate speech is an important problem in the management of user-generated content. To remove offensive content or ban misbehaving users, content moderators need reliable hate speech detectors. Recently, deep neural networks based on the…

Applications · Statistics 2020-12-18 Kristian Miok , Blaz Skrlj , Daniela Zaharie , Marko Robnik-Sikonja

The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content…

Computation and Language · Computer Science 2023-02-20 Khouloud Mnassri , Praboda Rajapaksha , Reza Farahbakhsh , Noel Crespi

Sentiment analysis is an important task in the field ofNature Language Processing (NLP), in which users' feedbackdata on a specific issue are evaluated and analyzed. Manydeep learning models have been proposed to tackle this task, including…

Computation and Language · Computer Science 2020-11-23 Quoc Thai Nguyen , Thoai Linh Nguyen , Ngoc Hoang Luong , Quoc Hung Ngo

Large Language Models (LLMs) are the cornerstone for many Natural Language Processing (NLP) tasks like sentiment analysis, document classification, named entity recognition, question answering, summarization, etc. LLMs are often trained on…

Computation and Language · Computer Science 2024-02-09 Christoph Tillmann , Aashka Trivedi , Bishwaranjan Bhattacharjee

The pre-trained language model is trained on large-scale unlabeled text and can achieve state-of-the-art results in many different downstream tasks. However, the current pre-trained language model is mainly concentrated in the Chinese and…

Computation and Language · Computer Science 2022-05-17 Yuan Sun , Sisi Liu , Junjie Deng , Xiaobing Zhao

Toxic online speech has become a crucial problem nowadays due to an exponential increase in the use of internet by people from different cultures and educational backgrounds. Differentiating if a text message belongs to hate speech and…

Computation and Language · Computer Science 2021-08-24 Bencheng Wei , Jason Li , Ajay Gupta , Hafiza Umair , Atsu Vovor , Natalie Durzynski

Hate speech detection is a challenging problem with most of the datasets available in only one language: English. In this paper, we conduct a large scale analysis of multilingual hate speech in 9 languages from 16 different sources. We…

Social and Information Networks · Computer Science 2020-12-10 Sai Saketh Aluru , Binny Mathew , Punyajoy Saha , Animesh Mukherjee

Fine-tuning of pre-trained transformer networks such as BERT yield state-of-the-art results for text classification tasks. Typically, fine-tuning is performed on task-specific training datasets in a supervised manner. One can also fine-tune…

Computation and Language · Computer Science 2020-06-12 Gregor Wiedemann , Seid Muhie Yimam , Chris Biemann

Hate Speech has become a major content moderation issue for online social media platforms. Given the volume and velocity of online content production, it is impossible to manually moderate hate speech related content on any platform. In…

Computation and Language · Computer Science 2021-01-28 Sudhanshu Mishra , Shivangi Prasad , Shubhanshu Mishra

Large Language Models (LLMs) have shown remarkable proficiency in Machine Reading Comprehension (MRC) tasks; however, their effectiveness for low-resource languages like Vietnamese remains largely unexplored. In this paper, we fine-tune and…

Computation and Language · Computer Science 2025-03-25 Anh Duc Nguyen , Hieu Minh Phi , Anh Viet Ngo , Long Hai Trieu , Thai Phuong Nguyen

Large transformer-based language models, e.g. BERT and GPT-3, outperform previous architectures on most natural language processing tasks. Such language models are first pre-trained on gigantic corpora of text and later used as base-model…

Computation and Language · Computer Science 2022-11-16 Pieter Delobelle , Thomas Winters , Bettina Berendt

Social media are pervasive in our life, making it necessary to ensure safe online experiences by detecting and removing offensive and hate speech. In this work, we report our submission to the Offensive Language and hate-speech Detection…

Computation and Language · Computer Science 2020-06-03 AbdelRahim Elmadany , Chiyu Zhang , Muhammad Abdul-Mageed , Azadeh Hashemi

We present our HABERTOR model for detecting hatespeech in large scale user-generated content. Inspired by the recent success of the BERT model, we propose several modifications to BERT to enhance the performance on the downstream hatespeech…

Computation and Language · Computer Science 2020-10-20 Thanh Tran , Yifan Hu , Changwei Hu , Kevin Yen , Fei Tan , Kyumin Lee , Serim Park

In this paper, we introduce HateBERT, a re-trained BERT model for abusive language detection in English. The model was trained on RAL-E, a large-scale dataset of Reddit comments in English from communities banned for being offensive,…

Computation and Language · Computer Science 2021-02-05 Tommaso Caselli , Valerio Basile , Jelena Mitrović , Michael Granitzer