English
Related papers

Related papers: A Machine Learning Approach to Comment Toxicity Cl…

200 papers

Social media platforms provide an environment where people can freely engage in discussions. Unfortunately, they also enable several problems, such as online harassment. Recently, Google and Jigsaw started a project called Perspective,…

Machine Learning · Computer Science 2017-02-28 Hossein Hosseini , Sreeram Kannan , Baosen Zhang , Radha Poovendran

The censorship of toxic comments is often left to the judgment of imperfect models. Perspective API, a creation of Google technology incubator Jigsaw, is perhaps the most widely used toxicity classifier in industry; the model is employed by…

Computers and Society · Computer Science 2020-07-01 Elizabeth Reichert , Helen Qiu , Jasmine Bayrooti

Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally detecting and mitigating online toxicity. These efforts…

Computation and Language · Computer Science 2023-11-09 Wenbo Zhang , Hangzhi Guo , Ian D Kivlichan , Vinodkumar Prabhakaran , Davis Yadav , Amulya Yadav

This paper presents a deep learning-based pipeline for categorizing Bengali toxic comments, in which at first a binary classification model is used to determine whether a comment is toxic or not, and then a multi-label classifier is…

Computation and Language · Computer Science 2023-04-21 Tanveer Ahmed Belal , G. M. Shahariar , Md. Hasanul Kabir

Machine learning models are commonly used to detect toxicity in online conversations. These models are trained on datasets annotated by human raters. We explore how raters' self-described identities impact how they annotate toxicity in…

Human-Computer Interaction · Computer Science 2022-05-03 Nitesh Goyal , Ian Kivlichan , Rachel Rosen , Lucy Vasserman

This paper addresses the important problem of discerning hateful content in social media. We propose a detection scheme that is an ensemble of Recurrent Neural Network (RNN) classifiers, and it incorporates various features associated with…

Computation and Language · Computer Science 2019-07-05 Georgios K. Pitsilis , Heri Ramampiaro , Helge Langseth

Online platforms have become an increasingly prominent means of communication. Despite the obvious benefits to the expanded distribution of content, the last decade has resulted in disturbing toxic communication, such as cyberbullying and…

Social and Information Networks · Computer Science 2023-09-04 Amit Sheth , Valerie L. Shalin , Ugur Kursuncu

The challenge of automatic detection of toxic comments online has been the subject of a lot of research recently, but the focus has been mostly on detecting it in individual messages after they have been posted. Some authors have tried to…

Social and Information Networks · Computer Science 2020-06-20 Éloi Brassard-Gourdeau , Richard Khoury

Online social platforms are beset with hateful speech - content that expresses hatred for a person or group of people. Such content can frighten, intimidate, or silence platform users, and some of it can inspire other users to commit…

Computation and Language · Computer Science 2017-10-02 Haji Mohammad Saleem , Kelly P Dillon , Susan Benesch , Derek Ruths

Toxic language detection systems often falsely flag text that contains minority group mentions as toxic, as those groups are often the targets of online hate. Such over-reliance on spurious correlations also causes systems to struggle with…

Computation and Language · Computer Science 2022-07-15 Thomas Hartvigsen , Saadia Gabriel , Hamid Palangi , Maarten Sap , Dipankar Ray , Ece Kamar

Online incivility has emerged as a widespread and persistent problem in digital communities, imposing substantial social and psychological burdens on users. Although many platforms attempt to curb incivility through moderation and automated…

Computation and Language · Computer Science 2026-02-03 Zihan Chen , Lanyu Yu

Commenting platforms, such as Disqus, have emerged as a major online communication platform with millions of users and posts. Their popularity has also attracted parasitic and malicious behav- iors, such as trolling and spamming. There has…

Social and Information Networks · Computer Science 2018-06-07 Tai Ching Li , Joobin Gharibshah , Evangelos E. Papalexakis , Michalis Faloutsos

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

Computation and Language · Computer Science 2024-09-27 Elizaveta Korotkova , Isaac Chung

The ability to accurately detect and filter offensive content automatically is important to ensure a rich and diverse digital discourse. Trolling is a type of hurtful or offensive content that is prevalent in social media, but is…

Computers and Society · Computer Science 2020-08-04 Hitkul , Karmanya Aggarwal , Pakhi Bamdev , Debanjan Mahata , Rajiv Ratn Shah , Ponnurangam Kumaraguru

Research shows that exposure to suicide-related news media content is associated with suicide rates, with some content characteristics likely having harmful and others potentially protective effects. Although good evidence exists for a few…

Computation and Language · Computer Science 2022-06-29 Hannah Metzler , Hubert Baginski , Thomas Niederkrotenthaler , David Garcia

The proliferation of abusive language in online communications has posed significant risks to the health and wellbeing of individuals and communities. The growing concern regarding online abuse and its consequences necessitates methods for…

Computation and Language · Computer Science 2025-04-25 Samaneh Hosseini Moghaddam , Kelly Lyons , Cheryl Regehr , Vivek Goel , Kaitlyn Regehr

On social media platforms, hateful and offensive language negatively impact the mental well-being of users and the participation of people from diverse backgrounds. Automatic methods to detect offensive language have largely relied on…

Computation and Language · Computer Science 2022-01-26 Rishav Hada , Sohi Sudhir , Pushkar Mishra , Helen Yannakoudakis , Saif M. Mohammad , Ekaterina Shutova

While civilized users employ social media to stay informed and discuss daily occurrences, haters perceive these platforms as fertile ground for attacking groups and individuals. The prevailing approach to counter this phenomenon involves…

Computation and Language · Computer Science 2024-05-24 Andrés Carvallo , Tamara Quiroga , Carlos Aspillaga , Marcelo Mendoza

The ability to quantify incivility online, in news and in congressional debates, is of great interest to political scientists. Computational tools for detecting online incivility for English are now fairly accessible and potentially could…

Computation and Language · Computer Science 2021-02-09 Anushree Hede , Oshin Agarwal , Linda Lu , Diana C. Mutz , Ani Nenkova

The digital age has expanded social media and online forums, allowing free expression for nearly 45% of the global population. Yet, it has also fueled online harassment, bullying, and harmful behaviors like hate speech and toxic comments…

Computation and Language · Computer Science 2026-03-12 Vuong M. Ngo , Cach N. Dang , Kien V. Nguyen , Mark Roantree