中文
相关论文

相关论文: ToxiSpanSE: An Explainable Toxicity Detection in C…

200 篇论文

The real-world impact of polarization and toxicity in the online sphere marked the end of 2020 and the beginning of this year in a negative way. Semeval-2021, Task 5 - Toxic Spans Detection is based on a novel annotation of a subset of the…

计算与语言 · 计算机科学 2021-04-20 Andrei Paraschiv , Dumitru-Clementin Cercel , Mihai Dascalu

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We…

机器学习 · 计算机科学 2018-10-05 David Noever

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

The presence of toxic content has become a major problem for many online communities. Moderators try to limit this problem by implementing more and more refined comment filters, but toxic users are constantly finding new ways to circumvent…

计算与语言 · 计算机科学 2018-12-06 Éloi Brassard-Gourdeau , Richard Khoury

This paper describes our participation in the DEtection of TOXicity in comments In Spanish (DETOXIS) shared task 2021 at the 3rd Workshop on Iberian Languages Evaluation Forum. The shared task is divided into two related classification…

计算与语言 · 计算机科学 2021-11-09 Angel Felipe Magnossão de Paula , Ipek Baris Schlicht

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

机器学习 · 计算机科学 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

Toxicity text detectors can be vulnerable to adversarial examples - small perturbations to input text that fool the systems into wrong detection. Existing attack algorithms are time-consuming and often produce invalid or ambiguous…

密码学与安全 · 计算机科学 2025-05-02 Xuan Zhu , Dmitriy Bespalov , Liwen You , Ninad Kulkarni , Yanjun Qi

In-game toxic language becomes the hot potato in the gaming industry and community. There have been several online game toxicity analysis frameworks and models proposed. However, it is still challenging to detect toxicity due to the nature…

计算与语言 · 计算机科学 2025-04-02 Yuanzhe Jia , Weixuan Wu , Feiqi Cao , Soyeon Caren Han

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

计算与语言 · 计算机科学 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very…

计算与语言 · 计算机科学 2022-04-05 Sreyan Ghosh , Samden Lepcha , S Sakshi , Rajiv Ratn Shah , S. Umesh

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

计算与语言 · 计算机科学 2024-09-27 Elizaveta Korotkova , Isaac Chung

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies…

机器学习 · 计算机科学 2023-11-09 Md Azim Khan

Background: Despite the widespread use of automated security defect detection tools, software projects still contain many security defects that could result in serious damage. Such tools are largely context-insensitive and may not cover all…

软件工程 · 计算机科学 2023-07-06 Jiaxin Yu , Liming Fu , Peng Liang , Amjed Tahir , Mojtaba Shahin

Although automated harmful content detection systems are frequently used to monitor online platforms, moderators and end users frequently cannot understand the logic underlying their predictions. While recent studies have focused on…

计算与语言 · 计算机科学 2026-03-20 Trishita Dhara , Siddhesh Sheth

Previous studies have shown that high-quality code comments assist developers in program comprehension and maintenance tasks. However, the semi-structured nature of comments, unclear conventions for writing good comments, and the lack of…

软件工程 · 计算机科学 2021-07-27 Pooja Rani

Machine learning models are commonly used to detect toxicity in online conversations. These models are trained on datasets annotated by human raters. We explore how raters' self-described identities impact how they annotate toxicity in…

人机交互 · 计算机科学 2022-05-03 Nitesh Goyal , Ian Kivlichan , Rachel Rosen , Lucy Vasserman

Automatic toxic language detection is critical for creating safe, inclusive online spaces. However, it is a highly subjective task, with perceptions of toxic language shaped by community norms and lived experience. Existing toxicity…

Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally detecting and mitigating online toxicity. These efforts…

计算与语言 · 计算机科学 2023-11-09 Wenbo Zhang , Hangzhi Guo , Ian D Kivlichan , Vinodkumar Prabhakaran , Davis Yadav , Amulya Yadav

Memes, as a widely used mode of online communication, often serve as vehicles for spreading harmful content. However, limitations in data accessibility and the high costs of dataset curation hinder the development of robust meme moderation…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Subhankar Swain , Naquee Rizwan , Vishwa Gangadhar S , Nayandeep Deb , Animesh Mukherjee

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…