English
Related papers

Related papers: Designing Toxic Content Classification for a Diver…

200 papers

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

Machine Learning · Computer Science 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

Machine Learning · Computer Science 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr

Proprietary public APIs play a crucial and growing role as research tools among social scientists. Among such APIs, Google's machine learning-based Perspective API is extensively utilized for assessing the toxicity of social media messages,…

Social and Information Networks · Computer Science 2024-07-18 Gianluca Nogara , Francesco Pierri , Stefano Cresci , Luca Luceri , Petter Törnberg , Silvia Giordano

Online toxic attacks, such as harassment, trolling, and hate speech have been linked to an increase in offline violence and negative psychological effects on victims. In this paper, we studied the impact of toxicity on users' online…

Social and Information Networks · Computer Science 2022-10-25 Ana Aleksandric , Sayak Saha Roy , Shirin Nilizadeh

Sociodemographic biases are a common problem for natural language processing, affecting the fairness and integrity of its applications. Within sentiment analysis, these biases may undermine sentiment predictions for texts that mention…

Computation and Language · Computer Science 2021-11-29 Pranav Narayanan Venkit , Shomir Wilson

Mental health forums are online communities where people express their issues and seek help from moderators and other users. In such forums, there are often posts with severe content indicating that the user is in acute distress and there…

Computation and Language · Computer Science 2017-02-23 Arman Cohan , Sydney Young , Andrew Yates , Nazli Goharian

A lack of demographic context in existing toxic speech datasets limits our understanding of how different age groups communicate online. In collaboration with funk, a German public service content network, this research introduces the first…

Computation and Language · Computer Science 2025-09-01 Jan Fillies , Michael Peter Hoffmann , Rebecca Reichel , Roman Salzwedel , Sven Bodemer , Adrian Paschke

Toxicity annotators and content moderators often default to mental shortcuts when making decisions. This can lead to subtle toxicity being missed, and seemingly toxic but harmless content being over-detected. We introduce BiasX, a framework…

Computation and Language · Computer Science 2023-05-24 Yiming Zhang , Sravani Nanduri , Liwei Jiang , Tongshuang Wu , Maarten Sap

The detection and identification of toxic comments are conducive to creating a civilized and harmonious Internet environment. In this experiment, we collected various data sets related to toxic comments. Because of the characteristics of…

Computation and Language · Computer Science 2022-03-08 Zhichang Wang , Qipeng Zhu

Background: The existence of toxic conversations in open-source platforms can degrade relationships among software developers and may negatively impact software product quality. To help mitigate this, some initial work has been done to…

Software Engineering · Computer Science 2023-07-10 Jaydeb Saker , Sayma Sultana , Steven R. Wilson , Amiangshu Bosu

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…

Commenting platforms, such as Disqus, have emerged as a major online communication platform with millions of users and posts. Their popularity has also attracted parasitic and malicious behav- iors, such as trolling and spamming. There has…

Social and Information Networks · Computer Science 2018-06-07 Tai Ching Li , Joobin Gharibshah , Evangelos E. Papalexakis , Michalis Faloutsos

The detection of sensitive content in large datasets is crucial for ensuring that shared and analysed data is free from harmful material. However, current moderation tools, such as external APIs, suffer from limitations in customisation,…

Computation and Language · Computer Science 2025-06-25 Dimosthenis Antypas , Indira Sen , Carla Perez-Almendros , Jose Camacho-Collados , Francesco Barbieri

While in real life everyone behaves themselves at least to some extent, it is much more difficult to expect people to behave themselves on the internet, because there are few checks or consequences for posting something toxic to others.…

Computation and Language · Computer Science 2021-12-14 Kehan Wang , Jiaxi Yang , Hongjun Wu

A large proportion of online comments present on public domains are constructive, however a significant proportion are toxic in nature. The comments contain lot of typos which increases the number of features manifold, making the ML model…

Computation and Language · Computer Science 2018-08-31 Fahim Mohammad

Toxic sentiment analysis on Twitter (X) often focuses on specific topics and events such as politics and elections. Datasets of toxic users in such research are typically gathered through lexicon-based techniques, providing only a…

Social and Information Networks · Computer Science 2024-06-06 Hina Qayyum , Muhammad Ikram , Benjamin Zhao , Ian Wood , Mohamad Ali Kaafar , Nicolas Kourtellis

AI models have become extremely popular and accessible to the general public. However, they are continuously under the scanner due to their demonstrable biases toward various sections of the society like people of color and non-binary…

Computers and Society · Computer Science 2023-10-11 Siddharth D Jaiswal , Ankit Kumar Verma , Animesh Mukherjee

Toxicity on the Internet, such as hate speech, offenses towards particular users or groups of people, or the use of obscene words, is an acknowledged problem. However, there also exist other types of inappropriate messages which are usually…

Computation and Language · Computer Science 2022-03-07 Nikolay Babakov , Varvara Logacheva , Alexander Panchenko

Social media platforms have evolved rapidly in modernity without strong regulation. One clear obstacle faced by current users is that of toxicity. Toxicity on social media manifests through a number of forms, including harassment,…

Social and Information Networks · Computer Science 2024-10-30 Rhett Hanscom , Tamara Silbergleit Lehman , Qin Lv , Shivakant Mishra

Online hate speech can harmfully impact individuals and groups, specifically on non-moderated platforms such as 4chan where users can post anonymous content. This work focuses on analysing and measuring the prevalence of online hate on…

Computation and Language · Computer Science 2025-04-02 Adrian Bermudez-Villalva , Maryam Mehrnezhad , Ehsan Toreini