English
Related papers

Related papers: Understanding and Mitigating Gender Bias in LLMs v…

200 papers

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

During training, Large Language Models (LLMs) learn social regularities that can lead to gender bias in downstream applications. Most mitigation efforts focus on reducing bias in generated outputs, typically evaluated on structured…

Computation and Language · Computer Science 2026-05-14 Nour Bouchouchi , Thibault Laugel , Xavier Renard , Christophe Marsala , Marie-Jeanne Lesot , Marcin Detyniecki

The advancement of Large Language Models (LLMs) has transformed Natural Language Processing (NLP), enabling performance across diverse tasks with little task-specific training. However, LLMs remain susceptible to social biases, particularly…

Computation and Language · Computer Science 2025-07-08 Melanie Galea , Claudia Borg

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Large Language Models (LLMs) are finding applications in all aspects of life, but their susceptibility to biases, particularly gender stereotyping, raises ethical concerns. This study introduces a novel methodology, a persona-based…

Computers and Society · Computer Science 2025-02-18 Rajesh Ranjan , Shailja Gupta , Surya Naranyan Singh

A large body of research has found substantial gender bias in NLP systems. Most of this research takes a binary, essentialist view of gender: limiting its variation to the categories _men_ and _women_, conflating gender with sex, and…

Computation and Language · Computer Science 2025-09-25 Ruby Ostrow , Adam Lopez

Large Language Models (LLMs) have become foundational tools in natural language processing, powering a wide range of applications and research. Many studies have shown that LLMs share significant similarities with the human brain. Recent…

Artificial Intelligence · Computer Science 2026-02-10 Zixuan Qin , Qingchen Yu , Kunlin Lyu , Zhaoxin Fan , Yifan Sun

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

Human-Computer Interaction · Computer Science 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

Generated texts from large language models (LLMs) have been shown to exhibit a variety of harmful, human-like biases against various demographics. These findings motivate research efforts aiming to understand and measure such effects. This…

Computation and Language · Computer Science 2025-07-25 Yuen Chen , Vethavikashini Chithrra Raghuram , Justus Mattern , Rada Mihalcea , Zhijing Jin

With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce…

Computation and Language · Computer Science 2025-08-15 Gustavo Bonil , Simone Hashiguti , Jhessica Silva , João Gondim , Helena Maia , Nádia Silva , Helio Pedrini , Sandra Avila

Projecting visual features into word embedding space has become a significant fusion strategy adopted by Multimodal Large Language Models (MLLMs). However, its internal mechanisms have yet to be explored. Inspired by multilingual research,…

Computation and Language · Computer Science 2025-05-21 Jiahao Huo , Yibo Yan , Boren Hu , Yutao Yue , Xuming Hu

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

Artificial Intelligence · Computer Science 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Large language models (LLMs) are increasingly embedded in healthcare workflows for documentation, education, and clinical decision support. However, these systems are trained on large text corpora that encode existing biases, including sex…

Computation and Language · Computer Science 2026-02-05 Isabel Tsintsiper , Sheng Wong , Beth Albert , Shaun P Brennecke , Gabriel Davis Jones

The adoption of large language models (LLMs) is transforming the peer review process, from assisting reviewers in writing detailed evaluations to generating entire reviews automatically. While these capabilities offer new opportunities,…

Computers and Society · Computer Science 2026-04-29 Sai Suresh Macharla Vasu , Ivaxi Sheth , Hui-Po Wang , Ruta Binkyte , Mario Fritz

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Word embeddings have been shown to produce remarkable results in tackling a vast majority of NLP related tasks. Unfortunately, word embeddings also capture the stereotypical biases that are prevalent in society, affecting the predictive…

Computation and Language · Computer Science 2024-11-20 Navya Yarrabelly , Vinay Damodaran , Feng-Guang Su

As large language models (LLMs) advance in their linguistic capacity, understanding how they capture aspects of language competence remains a significant challenge. This study therefore employs psycholinguistic paradigms in English, which…

Computation and Language · Computer Science 2024-12-12 Xufeng Duan , Xinyu Zhou , Bei Xiao , Zhenguang G. Cai

Transformer-based pretrained large language models (PLM) such as BERT and GPT have achieved remarkable success in NLP tasks. However, PLMs are prone to encoding stereotypical biases. Although a burgeoning literature has emerged on…

Computation and Language · Computer Science 2024-06-18 Yi Yang , Hanyu Duan , Ahmed Abbasi , John P. Lalor , Kar Yan Tam