English
Related papers

Related papers: Surprising gender biases in GPT

200 papers

Critical scholarship has elevated the problem of gender bias in data sets used to train virtual assistants (VAs). Most work has focused on explicit biases in language, especially against women, girls, femme-identifying people, and…

Computation and Language · Computer Science 2023-04-26 Katie Seaborn , Shruti Chandra , Thibault Fabre

This study quantifies gender and skin-tone bias in two widely deployed commercial image generators - Gemini Flash 2.5 Image (NanoBanana) and GPT Image 1.5 - to test the assumption that neutral prompts yield demographically neutral outputs.…

Artificial Intelligence · Computer Science 2026-02-13 Roberto Balestri

Neural Machine Translation (NMT) models, though state-of-the-art for translation, often reflect social biases, particularly gender bias. Existing evaluation benchmarks primarily focus on English as the source language of translation. For…

Computation and Language · Computer Science 2023-12-08 Pushpdeep Singh

Foundation models such as GPT-4 are fine-tuned to avoid unsafe or otherwise problematic behavior, such as helping to commit crimes or producing racist text. One approach to fine-tuning, called reinforcement learning from human feedback,…

In this paper, we define the task of gender rewriting in contexts involving two users (I and/or You) - first and second grammatical persons with independent grammatical gender preferences. We focus on Arabic, a gender-marking…

Computation and Language · Computer Science 2022-05-05 Bashar Alhafni , Nizar Habash , Houda Bouamor

Generative artificial intelligence (AI) holds enormous potential to revolutionize decision-making processes, from everyday to high-stake scenarios. By leveraging generative AI, humans can benefit from data-driven insights and predictions,…

General Economics · Economics 2024-02-19 Valerio Capraro , Roberto Di Paolo , Veronica Pizziol

As LLMs are increasingly applied in socially impactful settings, concerns about gender bias have prompted growing efforts both to measure and mitigate such bias. These efforts often rely on evaluation tasks that differ from natural language…

Computation and Language · Computer Science 2025-09-11 Bufan Gao , Elisa Kreiss

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

Neural network language models can serve as computational hypotheses about how humans process language. We compared the model-human consistency of diverse language models using a novel experimental approach: controversial sentence pairs.…

Computation and Language · Computer Science 2023-09-15 Tal Golan , Matthew Siegelman , Nikolaus Kriegeskorte , Christopher Baldassano

Neural Machine Translation (NMT) continues to improve in quality and adoption, yet the inadvertent perpetuation of gender bias remains a significant concern. Despite numerous studies on gender bias in translations into English from weakly…

Computation and Language · Computer Science 2024-02-23 Spencer Rarrick , Ranjita Naik , Sundar Poudel , Vishal Chowdhary

Gender disparities in health outcomes have garnered significant attention, prompting investigations into their underlying causes. Glioblastoma (GBM), a devastating and highly aggressive form of brain tumor, serves as a case for such…

Applications · Statistics 2023-08-09 Solomon Eshun

Neural language models, which reach state-of-the-art results on most natural language processing tasks, are trained on large text corpora that inevitably contain value-burdened content and often capture undesirable biases, which the models…

Computation and Language · Computer Science 2024-03-21 Adnan Al Ali , Jindřich Libovický

This paper studies gender bias in machine translation through the lens of Large Language Models (LLMs). Four widely-used test sets are employed to benchmark various base LLMs, comparing their translation quality and gender bias against…

Computation and Language · Computer Science 2024-07-29 Aleix Sant , Carlos Escolano , Audrey Mash , Francesca De Luca Fornaciari , Maite Melero

Research shows that women volunteer significantly more for tasks that people prefer others to complete. Such tasks carry little monetary incentives because of their very nature. We use a modified version of the volunteer's dilemma game to…

General Economics · Economics 2020-12-29 Ritwik Banerjee , Priyoma Mustafi

Large Language Models (LLMs) are trained on massive, unstructured corpora, making it unclear which social patterns and biases they absorb and later reproduce. Existing evaluations typically examine outputs or activations, but rarely connect…

Computation and Language · Computer Science 2025-11-14 Mariam Mahran , Katharina Simbeck

In emergency medicine, timely intervention for patients at risk of suicide is often hindered by delayed access to specialised psychiatric care. To bridge this gap, we introduce a speech-based approach for automatic suicide risk assessment.…

Computation and Language · Computer Science 2024-07-17 Maurice Gerczuk , Shahin Amiriparian , Justina Lutz , Wolfgang Strube , Irina Papazova , Alkomiet Hasan , Björn W. Schuller

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Large language models (LLMs) are increasingly embedded in healthcare workflows for documentation, education, and clinical decision support. However, these systems are trained on large text corpora that encode existing biases, including sex…

Computation and Language · Computer Science 2026-02-05 Isabel Tsintsiper , Sheng Wong , Beth Albert , Shaun P Brennecke , Gabriel Davis Jones

Many studies have revealed that word embeddings, language models, and models for specific downstream tasks in NLP are prone to social biases, especially gender bias. Recently these techniques have been gradually applied to automatic…

Computation and Language · Computer Science 2022-10-18 Mingqi Gao , Xiaojun Wan

As large language models (LLMs) are increasingly applied in areas influencing societal outcomes, it is critical to understand their tendency to perpetuate and amplify biases. This study investigates whether LLMs exhibit biases in predicting…

Computation and Language · Computer Science 2024-11-25 Xinhua Wu , Qi R. Wang