English
Related papers

Related papers: Surprising gender biases in GPT

200 papers

With the rise of human-machine communication, machines are increasingly designed with humanlike characteristics, such as gender, which can inadvertently trigger cognitive biases. Many conversational agents (CAs), such as voice assistants…

Human-Computer Interaction · Computer Science 2024-01-09 Weizi Liu

A large body of research on gender-linked language has established foundations regarding cross-gender differences in lexical, emotional, and topical preferences, along with their sociological underpinnings. We compile a novel, large and…

Computation and Language · Computer Science 2020-11-03 Ella Rabinovich , Hila Gonen , Suzanne Stevenson

Social media and digital platforms allow us to express our opinions freely and easily to a vast number of people. In this study, we examine whether there are gender-based differences in how communication happens via Twitter in regard to…

Social and Information Networks · Computer Science 2024-03-19 Mariana Macedo , Akrati Saxena

Classifiers tend to propagate biases present in the data on which they are trained. Hence, it is important to understand how the demographic identities of the annotators of comments affect the fairness of the resulting model. In this paper,…

Computation and Language · Computer Science 2021-06-07 Elizabeth Excell , Noura Al Moubayed

Research on bias in Text-to-Image (T2I) models has primarily focused on demographic representation and stereotypical attributes, overlooking a fundamental question: how does grammatical gender influence visual representation across…

Computation and Language · Computer Science 2026-02-03 Muhammed Saeed , Shaina Raza , Ashmal Vayani , Muhammad Abdul-Mageed , Ali Emami , Shady Shehata

When translating "The secretary asked for details." to a language with grammatical gender, it might be necessary to determine the gender of the subject "secretary". If the sentence does not contain the necessary information, it is not…

Computation and Language · Computer Science 2020-10-20 Artūrs Stafanovičs , Toms Bergmanis , Mārcis Pinnis

Implicit gender bias in Large Language Models (LLMs) is a well-documented problem, and implications of gender introduced into automatic translations can perpetuate real-world biases. However, some LLMs use heuristics or post-processing to…

Computation and Language · Computer Science 2024-04-03 Peter J Barclay , Ashkan Sami

The paper explores the study of gender-based narrative biases in stories generated by ChatGPT, Gemini, and Claude. The prompt design draws on Propp's character classifications and Freytag's narrative structure. The stories are analyzed…

Human-Computer Interaction · Computer Science 2025-08-14 Daniel Raffini , Agnese Macori , Marco Angelini , Tiziana Catarci

The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ…

Computation and Language · Computer Science 2024-11-26 Xi Yu Huang , Krishnapriya Vishnubhotla , Frank Rudzicz

This study evaluates the biases in Gemini 2.0 Flash Experimental, a state-of-the-art large language model (LLM) developed by Google, focusing on content moderation and gender disparities. By comparing its performance to ChatGPT-4o, examined…

Computation and Language · Computer Science 2025-03-24 Roberto Balestri

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

We conducted controlled experimental bias audits for four versions of ChatGPT, which we asked to recommend an opening offer in salary negotiations for a new hire. We submitted 98,800 prompts to each version, systematically varying the…

Computers and Society · Computer Science 2024-10-10 R. Stuart Geiger , Flynn O'Sullivan , Elsie Wang , Jonathan Lo

In efforts to keep up with the rapid progress and use of large language models, gender bias research is becoming more prevalent in NLP. Non-English bias research, however, is still in its infancy with most work focusing on English. In our…

Computation and Language · Computer Science 2023-06-19 Victor Steinborn , Antonis Maronikolakis , Hinrich Schütze

The media attention to the personal sphere of famous and important individuals has become a key element of the gender narrative. Here we combine lexical, syntactic and sentiment analysis to investigate the role of gender in the…

Computation and Language · Computer Science 2022-04-14 Emanuele Brugnoli , Rosaria Simone , Marco Delmastro

Studying the ways in which language is gendered has long been an area of interest in sociolinguistics. Studies have explored, for example, the speech of male and female characters in film and the language used to describe male and female…

Computation and Language · Computer Science 2019-06-13 Alexander Hoyle , Wolf-Sonkin , Hanna Wallach , Isabelle Augenstein , Ryan Cotterell

Current bias evaluations in Instruction Text-to-Speech (ITTS) often rely on univariate testing, overlooking the compositional structure of social cues. In this work, we investigate gender bias by modeling prompts as combinations of Social…

Signal Processing · Electrical Eng. & Systems 2026-03-24 Kuan-Yu Chen , Yi-Cheng Lin , Po-Chung Hsieh , Huang-Cheng Chou , Chih-Fan Hsu , Jeng-Lin Li , Hung-yi Lee , Jian-Jiun Ding

LLMs have been demonstrated to align with the values of Western or North American cultures. Prior work predominantly showed this effect through leveraging surveys that directly ask (originally people and now also LLMs) about their values.…

Computation and Language · Computer Science 2025-05-27 Zhuozhuo Joy Liu , Farhan Samir , Mehar Bhatia , Laura K. Nelson , Vered Shwartz

Gender stereotypes are manifest in most of the world's languages and are consequently propagated or amplified by NLP systems. Although research has focused on mitigating gender stereotypes in English, the approaches that are commonly…

Computation and Language · Computer Science 2020-05-28 Ran Zmigrod , Sabrina J. Mielke , Hanna Wallach , Ryan Cotterell

Ethics regarding social bias has recently thrown striking issues in natural language processing. Especially for gender-related topics, the need for a system that reduces the model bias has grown in areas such as image captioning, content…

Computation and Language · Computer Science 2019-05-29 Won Ik Cho , Ji Won Kim , Seok Min Kim , Nam Soo Kim

Gender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt a…

Computation and Language · Computer Science 2022-03-21 Beatrice Savoldi , Marco Gaido , Luisa Bentivogli , Matteo Negri , Marco Turchi