English
Related papers

Related papers: Do LLMs have a Gender (Entropy) Bias?

200 papers

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

During training, Large Language Models (LLMs) learn social regularities that can lead to gender bias in downstream applications. Most mitigation efforts focus on reducing bias in generated outputs, typically evaluated on structured…

Computation and Language · Computer Science 2026-05-14 Nour Bouchouchi , Thibault Laugel , Xavier Renard , Christophe Marsala , Marie-Jeanne Lesot , Marcin Detyniecki

Large Language Models (LLMs) often exhibit gender bias, resulting in unequal treatment of male and female subjects across different contexts. To address this issue, we propose a novel data generation framework that fosters exploratory…

Computation and Language · Computer Science 2026-01-15 Kangda Wei , Hasnat Md Abdullah , Ruihong Huang

Contextual language models (CLMs) have pushed the NLP benchmarks to a new height. It has become a new norm to utilize CLM provided word embeddings in downstream tasks such as text classification. However, unless addressed, CLMs are prone to…

Computation and Language · Computer Science 2020-09-11 Rishabh Bhardwaj , Navonil Majumder , Soujanya Poria

Large language models (LLMs) are increasingly being used in user-facing applications, from providing medical consultations to job interview advice. Recent research suggests that these models are becoming increasingly proficient at inferring…

Computation and Language · Computer Science 2025-07-22 Matthew Kearney , Reuben Binns , Yarin Gal

Large language models (LLMs) have demonstrated remarkable capabilities in simulating human behaviour and social intelligence. However, they risk perpetuating societal biases, especially when demographic information is involved. We introduce…

Computers and Society · Computer Science 2025-06-11 Bryan Chen Zhengyu Tan , Roy Ka-Wei Lee

Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several…

Computation and Language · Computer Science 2025-02-25 Kunsheng Tang , Wenbo Zhou , Jie Zhang , Aishan Liu , Gelei Deng , Shuai Li , Peigui Qi , Weiming Zhang , Tianwei Zhang , Nenghai Yu

Large language models (LLMs) are widely applied across diverse domains, raising concerns about their limitations and potential risks. In this study, we investigate two types of bias that LLMs may display: stereotype bias and deviation bias.…

Computation and Language · Computer Science 2026-05-20 Daniel Wang , Eli Brignac , Minjia Mao , Xiao Fang

The widespread application of Large Language Models (LLMs) involves ethical risks for users and societies. A prominent ethical risk of LLMs is the generation of unfair language output that reinforces or exacerbates harm for members of…

Computation and Language · Computer Science 2025-03-03 Luise Mehner , Lena Alicija Philine Fiedler , Sabine Ammon , Dorothea Kolossa

Large Language Models (LLMs) are increasingly utilized in educational tasks such as providing writing suggestions to students. Despite their potential, LLMs are known to harbor inherent biases which may negatively impact learners. Previous…

Computation and Language · Computer Science 2023-11-07 Thiemo Wambsganss , Xiaotian Su , Vinitra Swamy , Seyed Parsa Neshaei , Roman Rietsche , Tanja Käser

The Large Language Model Bias Index (LLMBI) is a pioneering approach designed to quantify and address biases inherent in large language models (LLMs), such as GPT-4. We recognise the increasing prevalence and impact of LLMs across diverse…

Computation and Language · Computer Science 2024-01-01 Abiodun Finbarrs Oketunji , Muhammad Anas , Deepthi Saina

This paper presents a systematic analysis of biases in open-source Large Language Models (LLMs), across gender, religion, and race. Our study evaluates bias in smaller-scale Llama and Gemma models using the SALT ($\textbf{S}$ocial…

Computation and Language · Computer Science 2025-02-19 Samee Arif , Zohaib Khan , Maaidah Kaleem , Suhaib Rashid , Agha Ali Raza , Awais Athar

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra

We present a novel, domain-agnostic counterfactual approach that uses Large Language Models (LLMs) to quantify gender disparities in human clinical decision-making. The method trains an LLM to emulate observed decisions, then evaluates…

The increasing trust in large language models (LLMs), especially in the form of chatbots, is often undermined by the lack of their extrinsic evaluation. This holds particularly true in nutrition, where randomised controlled trials (RCTs)…

Human-Computer Interaction · Computer Science 2025-11-27 Karen Jia-Hui Li , Simone Balloccu , Ondrej Dusek , Ehud Reiter

The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing robust approaches to identifying and evaluating such biases. In…

Information Retrieval · Computer Science 2025-06-30 Maryam Mousavian , Zahra Abbasiantaeb , Mohammad Aliannejadi , Fabio Crestani

We explore the alignment of values in Large Language Models (LLMs) with specific age groups, leveraging data from the World Value Survey across thirteen categories. Through a diverse set of prompts tailored to ensure response robustness, we…

Computation and Language · Computer Science 2024-10-16 Siyang Liu , Trish Maturi , Bowen Yi , Siqi Shen , Rada Mihalcea

The influence of Large Language Models (LLMs) is rapidly growing, automating more jobs over time. Assessing the fairness of LLMs is crucial due to their expanding impact. Studies reveal the reflection of societal norms and biases in LLMs,…

Computation and Language · Computer Science 2024-07-10 Jayanta Sadhu , Maneesha Rani Saha , Rifat Shahriyar

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

Computation and Language · Computer Science 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou

We present the first systematic evaluation examining format bias in performance of large language models (LLMs). Our approach distinguishes between two categories of an evaluation metric under format constraints to reliably and accurately…

Computation and Language · Computer Science 2025-02-25 Do Xuan Long , Hai Nguyen Ngoc , Tiviatis Sim , Hieu Dao , Shafiq Joty , Kenji Kawaguchi , Nancy F. Chen , Min-Yen Kan