English
Related papers

Related papers: Investigating Bias In Automatic Toxic Comment Dete…

200 papers

Deep learning methods are often difficult to apply in the legal domain due to the large amount of labeled data required by deep learning methods. A recent new trend in the deep learning community is the application of multi-task models that…

Information Retrieval · Computer Science 2018-10-17 Ahmed Elnaggar , Bernhard Waltl , Ingo Glaser , Jörg Landthaler , Elena Scepankova , Florian Matthes

Hateful memes are an emerging method of spreading hate on the internet, relying on both images and text to convey a hateful message. We take an interpretable approach to hateful meme detection, using machine learning and simple heuristics…

Machine Learning · Computer Science 2021-08-24 Tanvi Deshpande , Nitya Mani

We analyze sentiment analysis and toxicity detection models to detect the presence of explicit bias against people with disability (PWD). We employ the bias identification framework of Perturbation Sensitivity Analysis to examine…

Computation and Language · Computer Science 2023-07-19 Pranav Narayanan Venkit , Mukund Srinath , Shomir Wilson

Recently, there are unprecedented data growth originating from different online platforms which contribute to big data in terms of volume, velocity, variety and veracity (4Vs). Given this nature of big data which is unstructured, performing…

Information Retrieval · Computer Science 2021-04-01 D. C. Asogwa , S. O. Anigbogu , I. E. Onyenwe , F. A. Sani

Algorithmic bias often arises as a result of differential subgroup validity, in which predictive relationships vary across groups. For example, in toxic language detection, comments targeting different demographic groups can vary markedly…

Machine Learning · Computer Science 2023-03-08 Soumyajit Gupta , Sooyong Lee , Maria De-Arteaga , Matthew Lease

Pretrained large language models have become indispensable for solving various natural language processing (NLP) tasks. However, safely deploying them in real world applications is challenging because they generate toxic content. To address…

Computation and Language · Computer Science 2023-02-16 Shrimai Prabhumoye , Mostofa Patwary , Mohammad Shoeybi , Bryan Catanzaro

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of effort in the…

Computation and Language · Computer Science 2021-11-03 Hind Saleh , Areej Alhothali , Kawthar Moria

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Hate speech is a form of online harassment that involves the use of abusive language, and it is commonly seen in social media posts. This sort of harassment mainly focuses on specific group characteristics such as religion, gender,…

Computation and Language · Computer Science 2022-06-10 Georgios K. Pitsilis

The development of Internet technology has led to a rapid increase in news information. Filtering out valuable content from complex information has become an urgentproblem that needs to be solved. In view of the shortcomings of traditional…

Computation and Language · Computer Science 2024-09-25 Bingyao Liu , Jiajing Chen , Rui Wang , Junming Huang , Yuanshuai Luo , Jianjun Wei

Text anomaly detection is a critical task in natural language processing (NLP), with applications spanning fraud detection, misinformation identification, spam detection and content moderation, etc. Despite significant advances in large…

Computation and Language · Computer Science 2025-07-17 Feng Xiao , Jicong Fan

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

Computation and Language · Computer Science 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Many studies have revealed that word embeddings, language models, and models for specific downstream tasks in NLP are prone to social biases, especially gender bias. Recently these techniques have been gradually applied to automatic…

Computation and Language · Computer Science 2022-10-18 Mingqi Gao , Xiaojun Wan

The context-dependent nature of online aggression makes annotating large collections of data extremely difficult. Previously studied datasets in abusive language detection have been insufficient in size to efficiently train deep learning…

Computation and Language · Computer Science 2018-08-31 Younghun Lee , Seunghyun Yoon , Kyomin Jung

Stigma toward people who use substances (PWUS) is a leading barrier to seeking treatment.Further, those in treatment are more likely to drop out if they experience higher levels of stigmatization. While related concepts of hate speech and…

This paper tries to address the problem of abusive comment detection in low-resource indic languages. Abusive comments are statements that are offensive to a person or a group of people. These comments are targeted toward individuals…

Computation and Language · Computer Science 2022-04-22 Shantanu Patankar , Omkar Gokhale , Onkar Litake , Aditya Mandke , Dipali Kadam

Detecting misogynistic hate speech is a difficult algorithmic task. The task is made more difficult when decision criteria for what constitutes misogynistic speech are ungrounded in established literatures in psychology and philosophy, both…

Computers and Society · Computer Science 2026-01-27 Artemis Deligianni , Zachary Horne , Leonidas A. A. Doumas

The remarkable ability of diffusion models to generate high-fidelity images has led to their widespread adoption. However, concerns have also arisen regarding their potential to produce Not Safe for Work (NSFW) content and exhibit social…

Computation and Language · Computer Science 2025-05-22 Zhiwen Li , Die Chen , Mingyuan Fan , Cen Chen , Yaliang Li , Yanhao Wang , Wenmeng Zhou

In the era of digitalization, as individuals increasingly rely on digital platforms for communication and news consumption, various actors employ linguistic strategies to influence public perception. While models have become proficient at…

Computation and Language · Computer Science 2025-06-18 Sina Abdidizaji , Md Kowsher , Niloofar Yousefi , Ivan Garibay