English
Related papers

Related papers: Mitigating Biases in Toxic Language Detection thro…

200 papers

Stance detection models may tend to rely on dataset bias in the text part as a shortcut and thus fail to sufficiently learn the interaction between the targets and texts. Recent debiasing methods usually treated features learned by small…

Computation and Language · Computer Science 2022-12-21 Jianhua Yuan , Yanyan Zhao , Bing Qin

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

Free-text rationales play a pivotal role in explainable NLP, bridging the knowledge and reasoning gaps behind a model's decision-making. However, due to the diversity of potential reasoning paths and a corresponding lack of definitive…

Computation and Language · Computer Science 2024-06-18 Zhengping Jiang , Yining Lu , Hanjie Chen , Daniel Khashabi , Benjamin Van Durme , Anqi Liu

Now-a-days, derogatory comments are often made by one another, not only in offline environment but also immensely in online environments like social networking websites and online communities. So, an Identification combined with Prevention…

Computation and Language · Computer Science 2019-03-19 Navoneel Chakrabarty

Selective rationalization aims to produce decisions along with rationales (e.g., text highlights or word alignments between two sentences). Commonly, rationales are modeled as stochastic binary masks, requiring sampling-based gradient…

Computation and Language · Computer Science 2021-09-13 Nuno Miguel Guerreiro , André F. T. Martins

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

Machine Learning · Computer Science 2019-11-21 Komal K. Teru , Aishik Chakraborty

Language models trained with reinforcement learning (RL) can engage in reward hacking--the exploitation of unintended strategies for high reward--without revealing this behavior in their chain-of-thought reasoning. This makes the detection…

Computation and Language · Computer Science 2025-07-15 Miles Turpin , Andy Arditi , Marvin Li , Joe Benton , Julian Michael

We analyze sentiment analysis and toxicity detection models to detect the presence of explicit bias against people with disability (PWD). We employ the bias identification framework of Perturbation Sensitivity Analysis to examine…

Computation and Language · Computer Science 2023-07-19 Pranav Narayanan Venkit , Mukund Srinath , Shomir Wilson

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Generating textual rationales from large vision-language models (LVLMs) to support trainable multimodal misinformation detectors has emerged as a promising paradigm. However, its effectiveness is fundamentally limited by three core…

Computation and Language · Computer Science 2025-08-15 Herun Wan , Jiaying Wu , Minnan Luo , Xiangzheng Kong , Zihan Ma , Zhi Zeng

Identifying check-worthy claims is often the first step of automated fact-checking systems. Tackling this task in a multilingual setting has been understudied. Encoding inputs with multilingual text representations could be one approach to…

Computation and Language · Computer Science 2021-09-21 Ipek Baris Schlicht , Angel Felipe Magnossão de Paula , Paolo Rosso

The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content…

Computation and Language · Computer Science 2023-02-20 Khouloud Mnassri , Praboda Rajapaksha , Reza Farahbakhsh , Noel Crespi

Large language models (LLMs) often inherit biases from vast amounts of training corpora. Traditional debiasing methods, while effective to some extent, do not completely eliminate memorized biases and toxicity in LLMs. In this paper, we…

Computation and Language · Computer Science 2024-07-25 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Considerable effort has been dedicated to mitigating toxicity, but existing methods often require drastic modifications to model parameters or the use of computationally intensive auxiliary models. Furthermore, previous approaches have…

Artificial Intelligence · Computer Science 2023-10-12 Luiza Pozzobon , Beyza Ermis , Patrick Lewis , Sara Hooker

Large language models (LLMs) acquire general linguistic knowledge from massive-scale pretraining. However, pretraining data mainly comprised of web-crawled texts contain undesirable social biases which can be perpetuated or even amplified…

Computation and Language · Computer Science 2025-09-04 Takuma Udagawa , Yang Zhao , Hiroshi Kanayama , Bishwaranjan Bhattacharjee

Large language models have revolutionized natural language processing with their surprising capability to understand and generate human-like text. However, many of these models inherit and further amplify the biases present in their…

Computation and Language · Computer Science 2025-04-02 Rajeev Kumar , Harishankar Kumar , Kumari Shalini

Hate speech frequently appears on social media platforms and urgently needs to be effectively controlled. Alleviating the bias caused by hate speech can help resolve various ethical issues. Although existing research has constructed several…

Computation and Language · Computer Science 2025-08-27 Hongyan Wu , Zhengming Chen , Zijian Li , Nankai Lin , Lianxi Wang , Shengyi Jiang , Aimin Yang

Language Representation Models (LRMs) trained with real-world data may capture and exacerbate undesired bias and cause unfair treatment of people in various demographic groups. Several techniques have been investigated for applying…

Computation and Language · Computer Science 2023-11-14 Chloe Qinyu Zhu , Rickard Stureborg , Brandon Fain

Mitigating social biases typically requires identifying the social groups associated with each data sample. In this paper, we present DAFair, a novel approach to address social bias in language models. Unlike traditional methods that rely…

Computation and Language · Computer Science 2024-04-09 Shadi Iskander , Kira Radinsky , Yonatan Belinkov

We use structural topic modeling to examine racial bias in data collected to train models to detect hate speech and abusive language in social media posts. We augment the abusive language dataset by adding an additional feature indicating…

Computation and Language · Computer Science 2020-05-28 Thomas Davidson , Debasmita Bhattacharya