English
Related papers

Related papers: Towards Detecting Contextual Real-Time Toxicity fo…

200 papers

With the widespread use of toxic language online, platforms are increasingly using automated systems that leverage advances in natural language processing to automatically flag and remove toxic comments. However, most automated systems --…

Human-Computer Interaction · Computer Science 2021-02-11 Austin P Wright , Omar Shaikh , Haekyu Park , Will Epperson , Muhammed Ahmed , Stephane Pinel , Duen Horng Chau , Diyi Yang

In health-related topics, user toxicity in online discussions frequently becomes a source of social conflict or promotion of dangerous, unscientific behaviour; common approaches for battling it include different forms of detection, flagging…

Computation and Language · Computer Science 2025-05-26 Jorge Paz-Ruza , Amparo Alonso-Betanzos , Bertha Guijarro-Berdiñas , Carlos Eiras-Franco

The rise of hate speech on online platforms has led to an urgent need for effective content moderation. However, the subjective and multi-faceted nature of hateful online content, including implicit hate speech, poses significant challenges…

Computation and Language · Computer Science 2023-03-17 Uma Gunturi , Xiaohan Ding , Eugenia H. Rho

This paper presents Tiny-toxic-detector, a compact transformer-based model designed for toxic content detection. Despite having only 2.1 million parameters, Tiny-toxic-detector achieves competitive performance on benchmark datasets, with…

Machine Learning · Computer Science 2024-09-05 Michiel Kamphuis

Toxic behavior is one of the problems most associated with the gaming community. Reports of hate speech and anti-gaming behavior are common in many online multiplayer games. Many studies address this area, focusing on players and,…

Human-Computer Interaction · Computer Science 2021-10-01 Clara Andrade Pimentel , Philipe Melo

Online platforms have become an increasingly prominent means of communication. Despite the obvious benefits to the expanded distribution of content, the last decade has resulted in disturbing toxic communication, such as cyberbullying and…

Social and Information Networks · Computer Science 2023-09-04 Amit Sheth , Valerie L. Shalin , Ugur Kursuncu

As toxic language becomes nearly pervasive online, there has been increasing interest in leveraging the advancements in natural language processing (NLP), from very large transformer models to automatically detecting and removing toxic…

Computation and Language · Computer Science 2020-07-02 Austin P. Wright , Omar Shaikh , Haekyu Park , Will Epperson , Muhammed Ahmed , Stephane Pinel , Diyi Yang , Duen Horng Chau

In this work we explore cyberbullying and other toxic behavior in team competition online games. Using a dataset of over 10 million player reports on 1.46 million toxic players along with corresponding crowdsourced decisions, we test…

Computers and Society · Computer Science 2015-04-10 Haewoon Kwak , Jeremy Blackburn , Seungyeop Han

Traditional toxicity detection models have focused on the single utterance level without deeper understanding of context. We introduce CONDA, a new dataset for in-game toxic language detection enabling joint intent classification and slot…

Computation and Language · Computer Science 2021-07-26 Henry Weld , Guanghao Huang , Jean Lee , Tongshu Zhang , Kunze Wang , Xinghong Guo , Siqu Long , Josiah Poon , Soyeon Caren Han

Toxicity is a widespread phenomenon in competitive online video games. In addition to its direct undesirable effects, there is a concern that toxicity can spread to others, amplifying the harm caused by a single player's misbehavior. In…

Computers and Society · Computer Science 2025-02-04 Jacob Morrier , Amine Mahmassani , R. Michael Alvarez

Online toxic content has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. A significant amount of research has been focused on detecting or analyzing toxic content using machine-learning…

Computation and Language · Computer Science 2025-09-19 Gautam Kishore Shahi , Tim A. Majchrzak

Roblox is among the most popular online gaming platforms, used by hundreds of millions of users every day. A substantial portion of these users are underage, who are at a greater risk, where abusive users may utilize Roblox's real-time chat…

Computers and Society · Computer Science 2026-05-11 Priya Kaushik , Sonja Brown , Rakibul Hasan , Sazzadur Rahaman

Toxic language, such as hate speech, can deter users from participating in online communities and enjoying popular platforms. Previous approaches to detecting toxic language and norm violations have been primarily concerned with…

Computation and Language · Computer Science 2023-10-10 Jihyung Moon , Dong-Ho Lee , Hyundong Cho , Woojeong Jin , Chan Young Park , Minwoo Kim , Jonathan May , Jay Pujara , Sungjoon Park

The evolution of digital communication systems and the designs of online platforms have inadvertently facilitated the subconscious propagation of toxic behavior. Giving rise to reactive responses to toxic behavior. Toxicity in online…

Computers and Society · Computer Science 2025-10-01 Smita Khapre , Melkamu Abay Mersha , Hassan Shakil , Jonali Baruah , Jugal Kalita

The detection and identification of toxic comments are conducive to creating a civilized and harmonious Internet environment. In this experiment, we collected various data sets related to toxic comments. Because of the characteristics of…

Computation and Language · Computer Science 2022-03-08 Zhichang Wang , Qipeng Zhu

Recent advances in natural language processing and machine learning have led to the development of chatbot models, such as ChatGPT, that can engage in conversational dialogue with human users. However, the ability of these models to…

Cryptography and Security · Computer Science 2023-07-20 Bocheng Chen , Guangjing Wang , Hanqing Guo , Yuanda Wang , Qiben Yan

The proliferation of online hate speech has necessitated the creation of algorithms which can detect toxicity. Most of the past research focuses on this detection as a classification task, but assigning an absolute toxicity label is often…

Computation and Language · Computer Science 2022-06-28 Millon Madhur Das , Punyajoy Saha , Mithun Das

In this paper we explore the linguistic components of toxic behavior by using crowdsourced data from over 590 thousand cases of accused toxic players in a popular match-based competition game, League of Legends. We perform a series of…

Social and Information Networks · Computer Science 2014-10-21 Haewoon Kwak , Jeremy Blackburn

Detecting prosociality in text--communication intended to affirm, support, or improve others' behavior--is a novel and increasingly important challenge for trust and safety systems. Unlike toxic content detection, prosociality lacks…

Computation and Language · Computer Science 2025-08-11 Rafal Kocielnik , Min Kim , Penphob , Boonyarungsrit , Fereshteh Soltani , Deshawn Sambrano , Animashree Anandkumar , R. Michael Alvarez

Toxic interactions during code reviews can undermine teamwork and hinder productivity in software engineering (SE) teams. While prior studies explore toxicity detection and empirical investigation, they lack real-time detoxification tools…

Software Engineering · Computer Science 2026-04-17 MD Awsaf Alam Anindya , Showvik Biswas , Anindya Iqbal , Jaydeb Sarker , Amiangshu Bosu