English
Related papers

Related papers: ToxiSpanSE: An Explainable Toxicity Detection in C…

200 papers

The real-world impact of polarization and toxicity in the online sphere marked the end of 2020 and the beginning of this year in a negative way. Semeval-2021, Task 5 - Toxic Spans Detection is based on a novel annotation of a subset of the…

Computation and Language · Computer Science 2021-04-20 Andrei Paraschiv , Dumitru-Clementin Cercel , Mihai Dascalu

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We…

Machine Learning · Computer Science 2018-10-05 David Noever

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Computation and Language · Computer Science 2025-10-20 Zhiqiang Kou , Junyang Chen , Xin-Qiang Cai , Ming-Kun Xie , Biao Liu , Changwei Wang , Lei Feng , Yuheng Jia , Gang Niu , Masashi Sugiyama , Xin Geng

The presence of toxic content has become a major problem for many online communities. Moderators try to limit this problem by implementing more and more refined comment filters, but toxic users are constantly finding new ways to circumvent…

Computation and Language · Computer Science 2018-12-06 Éloi Brassard-Gourdeau , Richard Khoury

This paper describes our participation in the DEtection of TOXicity in comments In Spanish (DETOXIS) shared task 2021 at the 3rd Workshop on Iberian Languages Evaluation Forum. The shared task is divided into two related classification…

Computation and Language · Computer Science 2021-11-09 Angel Felipe Magnossão de Paula , Ipek Baris Schlicht

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

Machine Learning · Computer Science 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

Toxicity text detectors can be vulnerable to adversarial examples - small perturbations to input text that fool the systems into wrong detection. Existing attack algorithms are time-consuming and often produce invalid or ambiguous…

Cryptography and Security · Computer Science 2025-05-02 Xuan Zhu , Dmitriy Bespalov , Liwen You , Ninad Kulkarni , Yanjun Qi

In-game toxic language becomes the hot potato in the gaming industry and community. There have been several online game toxicity analysis frameworks and models proposed. However, it is still challenging to detect toxicity due to the nature…

Computation and Language · Computer Science 2025-04-02 Yuanzhe Jia , Weixuan Wu , Feiqi Cao , Soyeon Caren Han

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

Computation and Language · Computer Science 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very…

Computation and Language · Computer Science 2022-04-05 Sreyan Ghosh , Samden Lepcha , S Sakshi , Rajiv Ratn Shah , S. Umesh

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

Computation and Language · Computer Science 2024-09-27 Elizaveta Korotkova , Isaac Chung

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies…

Machine Learning · Computer Science 2023-11-09 Md Azim Khan

Background: Despite the widespread use of automated security defect detection tools, software projects still contain many security defects that could result in serious damage. Such tools are largely context-insensitive and may not cover all…

Software Engineering · Computer Science 2023-07-06 Jiaxin Yu , Liming Fu , Peng Liang , Amjed Tahir , Mojtaba Shahin

Although automated harmful content detection systems are frequently used to monitor online platforms, moderators and end users frequently cannot understand the logic underlying their predictions. While recent studies have focused on…

Computation and Language · Computer Science 2026-03-20 Trishita Dhara , Siddhesh Sheth

Previous studies have shown that high-quality code comments assist developers in program comprehension and maintenance tasks. However, the semi-structured nature of comments, unclear conventions for writing good comments, and the lack of…

Software Engineering · Computer Science 2021-07-27 Pooja Rani

Machine learning models are commonly used to detect toxicity in online conversations. These models are trained on datasets annotated by human raters. We explore how raters' self-described identities impact how they annotate toxicity in…

Human-Computer Interaction · Computer Science 2022-05-03 Nitesh Goyal , Ian Kivlichan , Rachel Rosen , Lucy Vasserman

Automatic toxic language detection is critical for creating safe, inclusive online spaces. However, it is a highly subjective task, with perceptions of toxic language shaped by community norms and lived experience. Existing toxicity…

Computation and Language · Computer Science 2025-07-10 Ashima Suvarna , Christina Chance , Karolina Naranjo , Hamid Palangi , Sophie Hao , Thomas Hartvigsen , Saadia Gabriel

Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally detecting and mitigating online toxicity. These efforts…

Computation and Language · Computer Science 2023-11-09 Wenbo Zhang , Hangzhi Guo , Ian D Kivlichan , Vinodkumar Prabhakaran , Davis Yadav , Amulya Yadav

Memes, as a widely used mode of online communication, often serve as vehicles for spreading harmful content. However, limitations in data accessibility and the high costs of dataset curation hinder the development of robust meme moderation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Subhankar Swain , Naquee Rizwan , Vishwa Gangadhar S , Nayandeep Deb , Animesh Mukherjee

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…