English
Related papers

Related papers: Can We Locate and Prevent Stereotypes in LLMs?

200 papers

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

Computation and Language · Computer Science 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar

Large language models (LLMs) can pass explicit social bias tests but still harbor implicit biases, similar to humans who endorse egalitarian beliefs yet exhibit subtle biases. Measuring such implicit biases can be a challenge: as LLMs…

Computers and Society · Computer Science 2024-05-24 Xuechunzi Bai , Angelina Wang , Ilia Sucholutsky , Thomas L. Griffiths

Large language models (LLMs) are becoming pervasive in everyday life, yet their propensity to reproduce biases inherited from training data remains a pressing concern. Prior investigations into bias in LLMs have focused on the association…

Computation and Language · Computer Science 2024-04-29 Messi H. J. Lee , Jacob M. Montgomery , Calvin K. Lai

Detecting stereotypes and biases in Large Language Models (LLMs) is crucial for enhancing fairness and reducing adverse impacts on individuals or groups when these models are applied. Traditional methods, which rely on embedding spaces or…

Computation and Language · Computer Science 2024-05-07 Yanhong Bai , Jiabao Zhao , Jinxin Shi , Zhentao Xie , Xingjiao Wu , Liang He

Large Language Models (LLMs) have significantly advanced natural language processing applications, yet their widespread use raises concerns regarding inherent biases that may reduce utility or harm for particular social groups. Despite the…

Computers and Society · Computer Science 2025-02-05 Bo Pang , Tingrui Qiao , Caroline Walker , Chris Cunningham , Yun Sing Koh

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

While large language models (LLMs) are increasingly being explored for mental health applications, recent studies reveal that they can exhibit stigma toward individuals with psychological conditions. Existing evaluations of this stigma…

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

Artificial Intelligence · Computer Science 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

As large Pre-trained Language Models (PLMs) trained on large amounts of data in an unsupervised manner become more ubiquitous, identifying various types of bias in the text has come into sharp focus. Existing "Stereotype Detection" datasets…

Computation and Language · Computer Science 2022-03-29 Rajkumar Pujari , Erik Oveson , Priyanka Kulkarni , Elnaz Nouri

Large Language Models (LLMs) have emerged as dominant foundational models in modern NLP. However, the understanding of their prediction processes and internal mechanisms, such as feed-forward networks (FFN) and multi-head self-attention…

Computation and Language · Computer Science 2024-04-16 Xintong Wang , Xiaoyu Li , Xingshan Li , Chris Biemann

Large Language Models (LLMs) perpetuate social biases, reflecting prejudices in their training data and reinforcing societal stereotypes and inequalities. Our work explores the potential of the Contact Hypothesis, a concept from social…

Computation and Language · Computer Science 2024-07-03 Chahat Raj , Anjishnu Mukherjee , Aylin Caliskan , Antonios Anastasopoulos , Ziwei Zhu

With the widespread availability of LLMs since the release of ChatGPT and increased public scrutiny, commercial model development appears to have focused their efforts on 'safety' training concerning legal liabilities at the expense of…

Computation and Language · Computer Science 2024-08-02 Alina Leidinger , Richard Rogers

Bias and stereotypes in language models can cause harm, especially in sensitive areas like content moderation and decision-making. This paper addresses bias and stereotype detection by exploring how jointly learning these tasks enhances…

Computation and Language · Computer Science 2025-07-03 Aditya Tomar , Rudra Murthy , Pushpak Bhattacharyya

In this paper, we study an emergent self-debiasing mechanisms against stereotypical content in Large Language Models (LLMs). Unlike traditional safety mechanisms that are primarily triggered by explicit input-level stimuli, self-debiasing…

Social and Information Networks · Computer Science 2026-05-12 Jingshen Zhang , Bo Wang , Yanlin Fu , Dongming Zhao , Ruifang He , Yuexian Hou , Zifei Yu

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the…

Computation and Language · Computer Science 2025-11-25 Shireen Chand , Faith Baca , Emilio Ferrara

With the wide and cross-domain adoption of Large Language Models, it becomes crucial to assess to which extent the statistical correlations in training data, which underlie their impressive performance, hide subtle and potentially troubling…

Artificial Intelligence · Computer Science 2025-12-12 Massimiliano Luca , Ciro Beneduce , Bruno Lepri , Jacopo Staiano

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

Large language models (LLMs) are increasingly used for text generation tasks from everyday use to high-stakes enterprise and government applications, including simulated interviews with asylum seekers. While many works highlight the new…

Computation and Language · Computer Science 2026-04-27 Ilana Nguyen , Harini Suresh , Thema Monroe-White , Evan Shieh

Large Language Models (LLMs) are increasingly being used in educational and learning applications. Research has demonstrated that controlling for style, to fit the needs of the learner, fosters increased understanding, promotes inclusion,…

Computation and Language · Computer Science 2024-06-19 Ankit Aich , Tingting Liu , Salvatore Giorgi , Kelsey Isman , Lyle Ungar , Brenda Curtis
‹ Prev 1 3 4 5 6 7 10 Next ›