English
Related papers

Related papers: Mitigating Biases in Toxic Language Detection thro…

200 papers

Toxic language is difficult to define, as it is not monolithic and has many variations in perceptions of toxicity. This challenge of detecting toxic language is increased by the highly contextual and subjectivity of its interpretation,…

Computation and Language · Computer Science 2023-05-19 Huriyyah Althunayan , Rahaf Bahlas , Manar Alharbi , Lena Alsuwailem , Abeer Aldayel , Rehab ALahmadi

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

Machine Learning · Computer Science 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr

Contrastive explanations for understanding the behavior of black box models has gained a lot of attention recently as they provide potential for recourse. In this paper, we propose a method Contrastive Attributed explanations for Text (CAT)…

Computation and Language · Computer Science 2022-11-03 Saneem Chemmengath , Amar Prakash Azad , Ronny Luss , Amit Dhurandhar

Numerous debiasing techniques have been proposed to mitigate the gender bias that is prevalent in pretrained language models. These are often evaluated on datasets that check the extent to which the model is gender-neutral in its…

Computation and Language · Computer Science 2023-10-24 Mahdi Zakizadeh , Kaveh Eskandari Miandoab , Mohammad Taher Pilehvar

Toxicity mitigation consists in rephrasing text in order to remove offensive or harmful meaning. Neural natural language processing (NLP) models have been widely used to target and mitigate textual toxicity. However, existing methods fail…

Toxicity annotators and content moderators often default to mental shortcuts when making decisions. This can lead to subtle toxicity being missed, and seemingly toxic but harmless content being over-detected. We introduce BiasX, a framework…

Computation and Language · Computer Science 2023-05-24 Yiming Zhang , Sravani Nanduri , Liwei Jiang , Tongshuang Wu , Maarten Sap

Sociodemographic biases are a common problem for natural language processing, affecting the fairness and integrity of its applications. Within sentiment analysis, these biases may undermine sentiment predictions for texts that mention…

Computation and Language · Computer Science 2021-11-29 Pranav Narayanan Venkit , Shomir Wilson

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

Computation and Language · Computer Science 2024-09-27 Elizaveta Korotkova , Isaac Chung

The training of large language models (LLMs) on extensive, unfiltered corpora sourced from the internet is a common and advantageous practice. Consequently, LLMs have learned and inadvertently reproduced various types of biases, including…

Computation and Language · Computer Science 2023-11-20 Ambri Ma , Arnav Kumar , Brett Zeligson

VQA models may tend to rely on language bias as a shortcut and thus fail to sufficiently learn the multi-modal knowledge from both vision and language. Recent debiasing methods proposed to exclude the language prior during inference.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yulei Niu , Kaihua Tang , Hanwang Zhang , Zhiwu Lu , Xian-Sheng Hua , Ji-Rong Wen

Toxicity detection mitigates the dissemination of toxic content (e.g., hateful comments, posts, and messages within online social actions) to safeguard a healthy online social environment. However, malicious users persistently develop…

Computation and Language · Computer Science 2026-03-17 Hankun Kang , Xin Miao , Jianhao Chen , Jintao Wen , Mayi Xu , Weiyu Zhang , Wenpeng Lu , Tieyun Qian

Large pretrained language models are critical components of modern NLP pipelines. Yet, they suffer from spurious correlations, poor out-of-domain generalization, and biases. Inspired by recent progress in causal machine learning, in…

Computation and Language · Computer Science 2022-11-16 Maxime Peyrard , Sarvjeet Singh Ghotra , Martin Josifoski , Vidhan Agarwal , Barun Patra , Dean Carignan , Emre Kiciman , Robert West

Toxic comment classification models are often found biased toward identity terms which are terms characterizing a specific group of people such as "Muslim" and "black". Such bias is commonly reflected in false-positive predictions, i.e.…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , Ziqi Zhang , Frank Hopfgartner

Pre-trained language models encode undesirable social biases, which are further exacerbated in downstream use. To this end, we propose MABEL (a Method for Attenuating Gender Bias using Entailment Labels), an intermediate pre-training…

Computation and Language · Computer Science 2022-10-28 Jacqueline He , Mengzhou Xia , Christiane Fellbaum , Danqi Chen

Subjective bias detection is critical for applications like propaganda detection, content recommendation, sentiment analysis, and bias neutralization. This bias is introduced in natural language via inflammatory words and phrases, casting…

Computation and Language · Computer Science 2020-06-16 Tanvi Dadu , Kartikey Pant , Radhika Mamidi

We present a data-driven approach using word embeddings to discover and categorise language biases on the discussion platform Reddit. As spaces for isolated user communities, platforms such as Reddit are increasingly connected to issues of…

Computation and Language · Computer Science 2020-08-17 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Natalia Criado

Due to their similarity-based learning objectives, pretrained sentence encoders often internalize stereotypical assumptions that reflect the social biases that exist within their training corpora. In this paper, we describe several kinds of…

Computation and Language · Computer Science 2023-03-13 Hongyin Luo , James Glass

The popularity of pretrained language models in natural language processing systems calls for a careful evaluation of such models in down-stream tasks, which have a higher potential for societal impact. The evaluation of such systems…

Computation and Language · Computer Science 2022-04-15 Ioana Baldini , Dennis Wei , Karthikeyan Natesan Ramamurthy , Mikhail Yurochkin , Moninder Singh

The proliferation of online toxic speech is a pertinent problem posing threats to demographic groups. While explicit toxic speech contains offensive lexical signals, implicit one consists of coded or indirect language. Therefore, it is…

Computation and Language · Computer Science 2024-05-21 Nhat M. Hoang , Xuan Long Do , Duc Anh Do , Duc Anh Vu , Luu Anh Tuan

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil
‹ Prev 1 3 4 5 6 7 10 Next ›