English
Related papers

Related papers: Investigating Bias In Automatic Toxic Comment Dete…

200 papers

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

Artificial Intelligence · Computer Science 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

While in real life everyone behaves themselves at least to some extent, it is much more difficult to expect people to behave themselves on the internet, because there are few checks or consequences for posting something toxic to others.…

Computation and Language · Computer Science 2021-12-14 Kehan Wang , Jiaxi Yang , Hongjun Wu

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies…

Machine Learning · Computer Science 2023-11-09 Md Azim Khan

Now-a-days, derogatory comments are often made by one another, not only in offline environment but also immensely in online environments like social networking websites and online communities. So, an Identification combined with Prevention…

Computation and Language · Computer Science 2019-03-19 Navoneel Chakrabarty

The abstract outlines the problem of toxic comments on social media platforms, where individuals use disrespectful, abusive, and unreasonable language that can drive users away from discussions. This behavior is referred to as anti-social…

Machine Learning · Computer Science 2023-04-17 K. Poojitha , A. Sai Charish , M. Arun Kuamr Reddy , S. Ayyasamy

In this work, we demonstrate how existing classifiers for identifying toxic comments online fail to generalize to the diverse concerns of Internet users. We survey 17,280 participants to understand how user expectations for what constitutes…

Social and Information Networks · Computer Science 2021-06-09 Deepak Kumar , Patrick Gage Kelley , Sunny Consolvo , Joshua Mason , Elie Bursztein , Zakir Durumeric , Kurt Thomas , Michael Bailey

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

Social and Information Networks · Computer Science 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

The censorship of toxic comments is often left to the judgment of imperfect models. Perspective API, a creation of Google technology incubator Jigsaw, is perhaps the most widely used toxicity classifier in industry; the model is employed by…

Computers and Society · Computer Science 2020-07-01 Elizabeth Reichert , Helen Qiu , Jasmine Bayrooti

Toxic comment classification models are often found biased toward identity terms which are terms characterizing a specific group of people such as "Muslim" and "black". Such bias is commonly reflected in false-positive predictions, i.e.…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , Ziqi Zhang , Frank Hopfgartner

Collecting annotations from human raters often results in a trade-off between the quantity of labels one wishes to gather and the quality of these labels. As such, it is often only possible to gather a small amount of high-quality labels.…

Machine Learning · Computer Science 2021-10-05 Neel Nanda , Jonathan Uesato , Sven Gowal

Flood of information is produced in a daily basis through the global Internet usage arising from the on-line interactive communications among users. While this situation contributes significantly to the quality of human life, unfortunately…

Computation and Language · Computer Science 2024-06-04 Spiros V. Georgakopoulos , Sotiris K. Tasoulis , Aristidis G. Vrahatis , Vassilis P. Plagianakos

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

Computation and Language · Computer Science 2026-04-02 Subhojit Ghimire

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur

Text toxicity detection systems exhibit significant biases, producing disproportionate rates of false positives on samples mentioning demographic groups. But what about toxicity detection in speech? To investigate the extent to which…

This study aims to develop an efficient and accurate model for detecting malicious comments, addressing the increasingly severe issue of false and harmful content on social media platforms. We propose a deep learning model that combines…

Computation and Language · Computer Science 2025-03-17 Zhou Fang , Hanlu Zhang , Jacky He , Zhen Qi , Hongye Zheng

The prevalence and impact of toxic discussions online have made content moderation crucial.Automated systems can play a vital role in identifying toxicity, and reducing the reliance on human moderation.Nevertheless, identifying toxic…

Artificial Intelligence · Computer Science 2023-11-02 Senjuti Dutta , Sid Mittal , Sherol Chen , Deepak Ramachandran , Ravi Rajakumar , Ian Kivlichan , Sunny Mak , Alena Butryna , Praveen Paritosh

This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of…

Information Retrieval · Computer Science 2019-04-19 Sandip Modha , Prasenjit Majumder

Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making. We focus on bias as a notion of opinion exclusion, that stems from the direct application of traditional ML…

Machine Learning · Computer Science 2019-11-07 Agathe Balayn , Alessandro Bozzon

This paper presents a deep learning-based pipeline for categorizing Bengali toxic comments, in which at first a binary classification model is used to determine whether a comment is toxic or not, and then a multi-label classifier is…

Computation and Language · Computer Science 2023-04-21 Tanveer Ahmed Belal , G. M. Shahariar , Md. Hasanul Kabir

Platforms that support online commentary, from social networks to news sites, are increasingly leveraging machine learning to assist their moderation efforts. But this process does not typically provide feedback to the author that would…

Computation and Language · Computer Science 2021-02-12 Leo Laugier , John Pavlopoulos , Jeffrey Sorensen , Lucas Dixon
‹ Prev 1 2 3 10 Next ›