English
Related papers

Related papers: Evaluating Large Language Models through Gender an…

200 papers

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

Large language models (LLMs) reflect societal norms and biases, especially about gender. While societal biases and stereotypes have been extensively researched in various NLP applications, there is a surprising gap for emotion analysis.…

Computation and Language · Computer Science 2024-05-29 Flor Miriam Plaza-del-Arco , Amanda Cercas Curry , Alba Curry , Gavin Abercrombie , Dirk Hovy

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

Large language models (LLMs) are becoming pervasive in everyday life, yet their propensity to reproduce biases inherited from training data remains a pressing concern. Prior investigations into bias in LLMs have focused on the association…

Computation and Language · Computer Science 2024-04-29 Messi H. J. Lee , Jacob M. Montgomery , Calvin K. Lai

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

Computers and Society · Computer Science 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

Computation and Language · Computer Science 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

The size of pretrained models is increasing, and so is their performance on a variety of NLP tasks. However, as their memorization capacity grows, they might pick up more social biases. In this work, we examine the connection between model…

Computation and Language · Computer Science 2022-06-22 Yarden Tal , Inbal Magar , Roy Schwartz

Generative artificial intelligence (AI), particularly large language models (LLMs), is being rapidly deployed in recruitment and for candidate shortlisting. We audit several mid-sized open-source LLMs for gender bias using a dataset of…

General Economics · Economics 2025-05-01 Sugat Chaturvedi , Rochana Chaturvedi

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

Human-Computer Interaction · Computer Science 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

Modern models for common NLP tasks often employ machine learning techniques and train on journalistic, social media, or other culturally-derived text. These have recently been scrutinized for racial and gender biases, rooting from inherent…

Computation and Language · Computer Science 2026-01-27 Scott Friedman , Sonja Schmer-Galunder , Anthony Chen , Jeffrey Rye

Large Language Models (LLMs) are increasingly utilized in educational tasks such as providing writing suggestions to students. Despite their potential, LLMs are known to harbor inherent biases which may negatively impact learners. Previous…

Computation and Language · Computer Science 2023-11-07 Thiemo Wambsganss , Xiaotian Su , Vinitra Swamy , Seyed Parsa Neshaei , Roman Rietsche , Tanja Käser

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Large language models (LLMs) often inherit and amplify social biases embedded in their training data. A prominent social bias is gender bias. In this regard, prior work has mainly focused on gender stereotyping bias - the association of…

Computation and Language · Computer Science 2025-06-18 Erik Derner , Sara Sansalvador de la Fuente , Yoan Gutiérrez , Paloma Moreda , Nuria Oliver

The growing prominence of large language models (LLMs) in daily life has heightened concerns that LLMs exhibit many of the same gender-related biases as their creators. In the context of hiring decisions, we quantify the degree to which…

Computers and Society · Computer Science 2026-04-02 Nina Gerszberg , Janka Hamori , Andrew Lo

Large language models (LLMs) increasingly operate in high-stakes settings including healthcare and medicine, where demographic attributes such as race and ethnicity may be explicitly stated or implicitly inferred from text. However,…

Computation and Language · Computer Science 2026-01-21 Shiyue Hu , Ruizhe Li , Yanjun Gao

AI-based systems such as language models have been shown to replicate and even amplify social biases reflected in their training data. Among other questionable behaviors, this can lead to AI-generated text--and text suggestions--that…

Computation and Language · Computer Science 2026-02-19 Connor Baumler , Hal Daumé

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko