English
Related papers

Related papers: Systematic Offensive Stereotyping (SOS) Bias in La…

200 papers

Large language models (LLMs) often inherit biases from vast amounts of training corpora. Traditional debiasing methods, while effective to some extent, do not completely eliminate memorized biases and toxicity in LLMs. In this paper, we…

Computation and Language · Computer Science 2024-07-25 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

Discriminatory language and biases are often present in hate speech during conversations, which usually lead to negative impacts on targeted groups such as those based on race, gender, and religion. To tackle this issue, we propose an…

Computation and Language · Computer Science 2023-07-21 Shaina Raza , Chen Ding , Deval Pandya

Prompting large language models has gained immense popularity in recent years due to the advantage of producing good results even without the need for labelled data. However, this requires prompt tuning to get optimal prompts that lead to…

Computation and Language · Computer Science 2024-03-06 Jacob-Junqi Tian , David Emerson , Sevil Zanjani Miyandoab , Deval Pandya , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Online platforms struggle to curb hate speech without over-censoring legitimate discourse. Early bidirectional transformer encoders made big strides, but the arrival of ultra-large autoregressive LLMs promises deeper context-awareness.…

Computation and Language · Computer Science 2025-07-15 Ariadna Mon , Saúl Fenollosa , Jon Lecumberri

Hate speech is increasingly prevalent online, and its negative outcomes include increased prejudice, extremism, and even offline hate crime. Automatic detection of online hate speech can help us to better understand these impacts. However,…

Computation and Language · Computer Science 2021-02-10 John D Gallacher

This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. We find evidence that gender stereotype…

Computation and Language · Computer Science 2021-02-17 Daniel de Vassimon Manela , David Errington , Thomas Fisher , Boris van Breugel , Pasquale Minervini

Recent studies show that Natural Language Processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. To create interventions and mitigate these biases…

Computation and Language · Computer Science 2022-10-17 Sunipa Dev , Emily Sheng , Jieyu Zhao , Aubrie Amstutz , Jiao Sun , Yu Hou , Mattie Sanseverino , Jiin Kim , Akihiro Nishi , Nanyun Peng , Kai-Wei Chang

Large language models (LLMs) are increasingly used to assess moral or ethical statements, yet their judgments may reflect social and linguistic biases. This work presents a controlled, sentence-level study of how grammatical person, number,…

Computation and Language · Computer Science 2026-03-17 Gustavo Lúcius Fernandes , Jeiverson C. V. M. Santos , Pedro O. S. Vaz-de-Melo

Bias in large language models (LLMs) has many forms, from overt discrimination to implicit stereotypes. Counterfactual bias evaluation is a widely used approach to quantifying bias and often relies on template-based probes that explicitly…

Computation and Language · Computer Science 2026-01-15 Farnaz Kohankhaki , D. B. Emerson , Jacob-Junqi Tian , Laleh Seyyed-Kalantari , Faiza Khan Khattak

As Large Language Models (LLMs) are increasingly used across different applications, concerns about their potential to amplify gender biases in various tasks are rising. Prior research has often probed gender bias using explicit gender cues…

Computation and Language · Computer Science 2025-08-06 Shahed Masoudian , Gustavo Escobedo , Hannah Strauss , Markus Schedl

The Large Language Model Bias Index (LLMBI) is a pioneering approach designed to quantify and address biases inherent in large language models (LLMs), such as GPT-4. We recognise the increasing prevalence and impact of LLMs across diverse…

Computation and Language · Computer Science 2024-01-01 Abiodun Finbarrs Oketunji , Muhammad Anas , Deepthi Saina

Recent advancements in Large Language Models(LLMs) have been notable, yet widespread enterprise adoption remains limited due to various constraints. This paper examines bias in LLMs-a crucial issue affecting their usability, reliability,…

Artificial Intelligence · Computer Science 2026-05-28 Vishal Mirza , Rahul Kulkarni , Aakanksha Jadhav

The fast spread of hate speech on social media impacts the Internet environment and our society by increasing prejudice and hurting people. Detecting hate speech has aroused broad attention in the field of natural language processing.…

Computation and Language · Computer Science 2023-07-13 Junyu Lu , Hongfei Lin , Xiaokun Zhang , Zhaoqing Li , Tongyue Zhang , Linlin Zong , Fenglong Ma , Bo Xu

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Mitigating explicit and implicit biases in Large Language Models (LLMs) has become a critical focus in the field of natural language processing. However, many current methodologies evaluate scenarios in isolation, without considering the…

Computation and Language · Computer Science 2025-02-04 Robert Morabito , Sangmitra Madhusudan , Tyler McDonald , Ali Emami

The prevalence of offensive content on the internet, encompassing hate speech and cyberbullying, is a pervasive issue worldwide. Consequently, it has garnered significant attention from the machine learning (ML) and natural language…

Computation and Language · Computer Science 2024-07-29 Alphaeus Dmonte , Tejas Arya , Tharindu Ranasinghe , Marcos Zampieri

Large language models (LLMs) are becoming pervasive in everyday life, yet their propensity to reproduce biases inherited from training data remains a pressing concern. Prior investigations into bias in LLMs have focused on the association…

Computation and Language · Computer Science 2024-04-29 Messi H. J. Lee , Jacob M. Montgomery , Calvin K. Lai