English
Related papers

Related papers: Designing Toxic Content Classification for a Diver…

200 papers

While extensive popularity of online social media platforms has made information dissemination faster, it has also resulted in widespread online abuse of different types like hate speech, offensive language, sexist and racist opinions, etc.…

Computation and Language · Computer Science 2020-10-09 Mohit Chandra , Ashwin Pathak , Eesha Dutta , Paryul Jain , Manish Gupta , Manish Shrivastava , Ponnurangam Kumaraguru

The proliferation of abusive language in online communications has posed significant risks to the health and wellbeing of individuals and communities. The growing concern regarding online abuse and its consequences necessitates methods for…

Computation and Language · Computer Science 2025-04-25 Samaneh Hosseini Moghaddam , Kelly Lyons , Cheryl Regehr , Vivek Goel , Kaitlyn Regehr

We propose a system to predict harmful discussions on social media platforms. Our solution uses contextual deep language models and proposes the novel idea of integrating state-of-the-art Graph Transformer Networks to analyze all…

Computation and Language · Computer Science 2023-01-12 Liam Hebert , Lukasz Golab , Robin Cohen

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

Computation and Language · Computer Science 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

Detecting harmful content on social media, such as Twitter, is made difficult by the fact that the seemingly simple yes/no classification conceals a significant amount of complexity. Unfortunately, while several datasets have been collected…

Computation and Language · Computer Science 2023-11-14 Saad Almohaimeed , Saleh Almohaimeed , Ashfaq Ali Shafin , Bogdan Carbunar , Ladislau Bölöni

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

Computation and Language · Computer Science 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

Harmful or abusive online content has been increasing over time, raising concerns for social media platforms, government agencies, and policymakers. Such harmful or abusive content can have major negative impact on society, e.g.,…

Computation and Language · Computer Science 2022-05-10 Rabindra Nath Nandi , Firoj Alam , Preslav Nakov

With increasing attention to online anti-social behaviors such as personal attacks and bigotry, it is critical to have an accurate accounting of how widespread anti-social behaviors are. In this paper, we empirically measure the prevalence…

Human-Computer Interaction · Computer Science 2022-08-30 Joon Sung Park , Joseph Seering , Michael S. Bernstein

Existing toxic detection models face significant limitations, such as lack of transparency, customization, and reproducibility. These challenges stem from the closed-source nature of their training data and the paucity of explanations for…

Computation and Language · Computer Science 2025-01-24 Tinh Son Luong , Thanh-Thien Le , Thang Viet Doan , Linh Ngo Van , Thien Huu Nguyen , Diep Thi-Ngoc Nguyen

To address the global challenge of online hate speech, prior research has developed detection models to flag such content on social media. However, due to systematic biases in evaluation datasets, the real-world effectiveness of these…

Computation and Language · Computer Science 2025-06-04 Manuel Tonneau , Diyi Liu , Niyati Malhotra , Scott A. Hale , Samuel P. Fraiberger , Victor Orozco-Olvera , Paul Röttger

In the era of social media and networking platforms, Twitter has been doomed for abuse and harassment toward users specifically women. Monitoring the contents including sexism and sexual harassment in traditional media is easier than…

Computation and Language · Computer Science 2020-04-20 Christos Karatsalos , Yannis Panagiotakis

Social media platforms like Facebook and Reddit host thousands of user-governed online communities. These platforms sanction communities that frequently violate platform policies; however, public perceptions of such sanctions remain…

Human-Computer Interaction · Computer Science 2024-09-10 Shagun Jhaver

Toxic comment detection on social media has proven to be essential for content moderation. This paper compares a wide set of different models on a highly skewed multi-label hate speech dataset. We consider inference time and several metrics…

Computation and Language · Computer Science 2023-01-27 Corentin Duchene , Henri Jamet , Pierre Guillaume , Reda Dehak

Misbehavior in online social networks (OSN) is an ever-growing phenomenon. The research to date tends to focus on the deployment of machine learning to identify and classify types of misbehavior such as bullying, aggression, and racism to…

Social and Information Networks · Computer Science 2022-02-17 Hina Qayyum , Benjamin Zi Hao Zhao , Ian D. Wood , Muhammad Ikram , Mohamed Ali Kaafar , Nicolas Kourtellis

Online social platforms are beset with hateful speech - content that expresses hatred for a person or group of people. Such content can frighten, intimidate, or silence platform users, and some of it can inspire other users to commit…

Computation and Language · Computer Science 2017-10-02 Haji Mohammad Saleem , Kelly P Dillon , Susan Benesch , Derek Ruths

Online harassment is a widespread social and public health concern, yet most computational approaches for detecting and addressing harassment focus on publicly visible social media content rather than private messaging environments. Private…

Social and Information Networks · Computer Science 2026-05-20 Pinxian Lu , Nimra Ishfaq , Emma Win , Morgan Rose , Sierra R Strickland , Candice L Biernesser , Jamie Zelazny , Munmun De Choudhury

When trained on large, unfiltered crawls from the internet, language models pick up and reproduce all kinds of undesirable biases that can be found in the data: they often generate racist, sexist, violent or otherwise toxic language. As…

Computation and Language · Computer Science 2021-09-10 Timo Schick , Sahana Udupa , Hinrich Schütze

Many works related to Twitter aim at characterizing its users in some way: role on the service (spammers, bots, organizations, etc.), nature of the user (socio-professional category, age, etc.), topics of interest , and others. However, for…

Computation and Language · Computer Science 2016-08-01 Jean-Valère Cossu , Vincent Labatut , Nicolas Dugué

This study aims to develop an efficient and accurate model for detecting malicious comments, addressing the increasingly severe issue of false and harmful content on social media platforms. We propose a deep learning model that combines…

Computation and Language · Computer Science 2025-03-17 Zhou Fang , Hanlu Zhang , Jacky He , Zhen Qi , Hongye Zheng

With the rapid growth of social media usage, a common trend has emerged where users often make sarcastic comments on posts. While sarcasm can sometimes be harmless, it can blur the line with cyberbullying, especially when used in negative…

Social and Information Networks · Computer Science 2024-11-01 Pinky Pamecha , Chaitya Shah , Divyam Jain , Kashish Gandhi , Kiran Bhowmick , Meera Narvekar