English
Related papers

Related papers: Critical Perspectives: A Benchmark Revealing Pitfa…

200 papers

The real-world impact of polarization and toxicity in the online sphere marked the end of 2020 and the beginning of this year in a negative way. Semeval-2021, Task 5 - Toxic Spans Detection is based on a novel annotation of a subset of the…

Computation and Language · Computer Science 2021-04-20 Andrei Paraschiv , Dumitru-Clementin Cercel , Mihai Dascalu

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

Computation and Language · Computer Science 2024-03-05 Mohammad Dehghani

Studies have shown that toxic behavior can cause contributors to leave, and hinder newcomers' (especially from underrepresented communities) participation in Open Source Software (OSS) projects. Thus, detection of toxic language plays a…

Software Engineering · Computer Science 2025-01-28 Ramtin Ehsani , Rezvaneh Rezapour , Preetha Chatterjee

Online toxic content has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. A significant amount of research has been focused on detecting or analyzing toxic content using machine-learning…

Computation and Language · Computer Science 2025-09-19 Gautam Kishore Shahi , Tim A. Majchrzak

As toxic language becomes nearly pervasive online, there has been increasing interest in leveraging the advancements in natural language processing (NLP), from very large transformer models to automatically detecting and removing toxic…

Computation and Language · Computer Science 2020-07-02 Austin P. Wright , Omar Shaikh , Haekyu Park , Will Epperson , Muhammed Ahmed , Stephane Pinel , Diyi Yang , Duen Horng Chau

Sentiment Analysis Systems (SASs) are data-driven Artificial Intelligence (AI) systems that, given a piece of text, assign one or more numbers conveying the polarity and emotional intensity expressed in the input. Like other automatic…

Artificial Intelligence · Computer Science 2023-02-07 Kausik Lakkaraju , Biplav Srivastava , Marco Valtorta

User posts whose perceived toxicity depends on the conversational context are rare in current toxicity detection datasets. Hence, toxicity detectors trained on existing datasets will also tend to disregard context, making the detection of…

Computation and Language · Computer Science 2021-11-22 Alexandros Xenos , John Pavlopoulos , Ion Androutsopoulos , Lucas Dixon , Jeffrey Sorensen , Leo Laugier

The presence of toxic content has become a major problem for many online communities. Moderators try to limit this problem by implementing more and more refined comment filters, but toxic users are constantly finding new ways to circumvent…

Computation and Language · Computer Science 2018-12-06 Éloi Brassard-Gourdeau , Richard Khoury

In recent years, toxic content and hate speech have become widespread phenomena on the internet. Moderators of online newspapers and forums are now required, partly due to legal regulations, to carefully review and, if necessary, delete…

Computation and Language · Computer Science 2025-01-03 Manuel Weber , Moritz Huber , Maximilian Auch , Alexander Döschl , Max-Emanuel Keller , Peter Mandl

Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making. We focus on bias as a notion of opinion exclusion, that stems from the direct application of traditional ML…

Machine Learning · Computer Science 2019-11-07 Agathe Balayn , Alessandro Bozzon

With the widespread use of toxic language online, platforms are increasingly using automated systems that leverage advances in natural language processing to automatically flag and remove toxic comments. However, most automated systems --…

Human-Computer Interaction · Computer Science 2021-02-11 Austin P Wright , Omar Shaikh , Haekyu Park , Will Epperson , Muhammed Ahmed , Stephane Pinel , Duen Horng Chau , Diyi Yang

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

Computation and Language · Computer Science 2026-04-02 Subhojit Ghimire

Lack of moderation in online communities enables participants to incur in personal aggression, harassment or cyberbullying, issues that have been accentuated by extremist radicalisation in the contemporary post-truth politics scenario. This…

Computation and Language · Computer Science 2018-01-08 Nestor Rodriguez , Sergio Rojas-Galeano

In this paper, we pay attention to the issue which is usually overlooked, i.e., \textit{similarity should be determined from different perspectives}. To explore this issue, we release a Multi-Perspective Text Similarity (MPTS) dataset, in…

Computation and Language · Computer Science 2022-02-15 Weijie Liu , Tao Zhu , Weiquan Mao , Zhe Zhao , Weigang Guo , Xuefeng Yang , Qi Ju

Automated filtering of toxic conversations may help an Open-source software (OSS) community to maintain healthy interactions among the project participants. Although, several general purpose tools exist to identify toxic contents, those may…

Software Engineering · Computer Science 2020-09-22 Jaydeb Sarker , Asif Kamal Turzo , Amiangshu Bosu

The rapid progress of generative AI has enabled remarkable creative capabilities, yet it also raises urgent concerns regarding the safety of AI-generated visual content in real-world applications such as content moderation, platform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Qiang Fu , Zonglei Jing , Zonghao Ying , Xiaoqian Li

Toxic comment classification has become an active research field with many recently proposed approaches. However, while these approaches address some of the task's challenges others still remain unsolved and directions for further research…

Computation and Language · Computer Science 2018-09-21 Betty van Aken , Julian Risch , Ralf Krestel , Alexander Löser

In the realm of Natural Language Processing (NLP), common approaches for handling human disagreement consist of aggregating annotators' viewpoints to establish a single ground truth. However, prior studies show that disregarding individual…

Computation and Language · Computer Science 2026-01-13 Benedetta Muscato , Lucia Passaro , Gizem Gezici , Fosca Giannotti

Detecting which parts of a sentence contribute to that sentence's toxicity -- rather than providing a sentence-level verdict of hatefulness -- would increase the interpretability of models and allow human moderators to better understand the…

Computation and Language · Computer Science 2021-04-13 Alireza Salemi , Nazanin Sabri , Emad Kebriaei , Behnam Bahrak , Azadeh Shakery

Abusive language is a concerning problem in online social media. Past research on detecting abusive language covers different platforms, languages, demographies, etc. However, models trained using these datasets do not perform well in…

Computation and Language · Computer Science 2023-07-31 Punyajoy Saha , Divyanshu Sheth , Kushal Kedia , Binny Mathew , Animesh Mukherjee