中文
相关论文

相关论文: Investigating Bias In Automatic Toxic Comment Dete…

200 篇论文

The widespread adoption of automatic sentiment and emotion classifiers makes it important to ensure that these tools perform reliably across different populations. Yet their reliability is typically assessed using benchmarks that rely on…

计算与语言 · 计算机科学 2026-01-09 Ivan Smirnov , Segun T. Aroyehun , Paul Plener , David Garcia

User posts whose perceived toxicity depends on the conversational context are rare in current toxicity detection datasets. Hence, toxicity detectors trained on existing datasets will also tend to disregard context, making the detection of…

计算与语言 · 计算机科学 2021-11-22 Alexandros Xenos , John Pavlopoulos , Ion Androutsopoulos , Lucas Dixon , Jeffrey Sorensen , Leo Laugier

Toxic comment detection on social media has proven to be essential for content moderation. This paper compares a wide set of different models on a highly skewed multi-label hate speech dataset. We consider inference time and several metrics…

计算与语言 · 计算机科学 2023-01-27 Corentin Duchene , Henri Jamet , Pierre Guillaume , Reda Dehak

Toxicity annotators and content moderators often default to mental shortcuts when making decisions. This can lead to subtle toxicity being missed, and seemingly toxic but harmless content being over-detected. We introduce BiasX, a framework…

计算与语言 · 计算机科学 2023-05-24 Yiming Zhang , Sravani Nanduri , Liwei Jiang , Tongshuang Wu , Maarten Sap

The digital age has expanded social media and online forums, allowing free expression for nearly 45% of the global population. Yet, it has also fueled online harassment, bullying, and harmful behaviors like hate speech and toxic comments…

计算与语言 · 计算机科学 2026-03-12 Vuong M. Ngo , Cach N. Dang , Kien V. Nguyen , Mark Roantree

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We…

机器学习 · 计算机科学 2018-10-05 David Noever

This paper investigates the use of machine learning models for the classification of unhealthy online conversations containing one or more forms of subtler abuse, such as hostility, sarcasm, and generalization. We leveraged a public dataset…

计算与语言 · 计算机科学 2022-01-28 Shlok Gilda , Mirela Silva , Luiz Giovanini , Daniela Oliveira

Toxic comment classification has become an active research field with many recently proposed approaches. However, while these approaches address some of the task's challenges others still remain unsolved and directions for further research…

计算与语言 · 计算机科学 2018-09-21 Betty van Aken , Julian Risch , Ralf Krestel , Alexander Löser

The presence of toxic content has become a major problem for many online communities. Moderators try to limit this problem by implementing more and more refined comment filters, but toxic users are constantly finding new ways to circumvent…

计算与语言 · 计算机科学 2018-12-06 Éloi Brassard-Gourdeau , Richard Khoury

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Cyberbullying is a significant concern intricately linked to technology that can find resolution through technological means. Despite its prevalence, technology also provides solutions to mitigate cyberbullying. To address growing concerns…

机器学习 · 计算机科学 2024-06-27 Sylvia Worlali Azumah , Nelly Elsayed , Zag ElSayed , Murat Ozer , Amanda La Guardia

Classifiers tend to propagate biases present in the data on which they are trained. Hence, it is important to understand how the demographic identities of the annotators of comments affect the fairness of the resulting model. In this paper,…

计算与语言 · 计算机科学 2021-06-07 Elizabeth Excell , Noura Al Moubayed

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

机器学习 · 计算机科学 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr

The rise of social media has significantly increased the prevalence of cyberbullying (CB), posing serious risks to both mental and physical well-being. Effective detection systems are essential for mitigating its impact. While several…

机器学习 · 计算机科学 2025-04-16 Tabia Tanzin Prama , Jannatul Ferdaws Amrin , Md. Mushfique Anwar , Iqbal H. Sarker

Online social media platforms increasingly rely on Natural Language Processing (NLP) techniques to detect abusive content at scale in order to mitigate the harms it causes to their users. However, these techniques suffer from various…

计算与语言 · 计算机科学 2021-10-01 Sayan Ghosh , Dylan Baker , David Jurgens , Vinodkumar Prabhakaran

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

计算与语言 · 计算机科学 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

Content moderation typically combines the efforts of human moderators and machine learning models. However, these systems often rely on data where significant disagreement occurs during moderation, reflecting the subjective nature of…

计算与语言 · 计算机科学 2025-09-01 Guillermo Villate-Castillo , Javier Del Ser , Borja Sanz

Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially…

Biased associations have been a challenge in the development of classifiers for detecting toxic language, hindering both fairness and accuracy. As potential solutions, we investigate recently introduced debiasing methods for text…

计算与语言 · 计算机科学 2021-02-02 Xuhui Zhou , Maarten Sap , Swabha Swayamdipta , Noah A. Smith , Yejin Choi

The rise of cyberbullying in social media platforms involving toxic comments has escalated the need for effective ways to monitor and moderate online interactions. Existing solutions of automated toxicity detection systems, are based on a…

人工智能 · 计算机科学 2026-02-11 Michail S. Alexiou , J. Sukarno Mertoguno