English
Related papers

Related papers: Surprising gender biases in GPT

200 papers

In this multicultural age, language translation is one of the most performed tasks, and it is becoming increasingly AI-moderated and automated. As a novel AI system, ChatGPT claims to be proficient in such translation tasks and in this…

Computers and Society · Computer Science 2024-08-06 Sourojit Ghosh , Aylin Caliskan

To examine whether intersectional bias can be observed in language generation, we examine \emph{GPT-2} and \emph{GPT-NEO} models, ranging in size from 124 million to ~2.7 billion parameters. We conduct an experiment combining up to three…

Computation and Language · Computer Science 2021-07-19 Liam Magee , Lida Ghahremanlou , Karen Soldatic , Shanthi Robertson

With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural…

Computation and Language · Computer Science 2025-01-22 Damin Zhang , Yi Zhang , Geetanjali Bihani , Julia Rayz

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Recent instruction fine-tuned models can solve multiple NLP tasks when prompted to do so, with machine translation (MT) being a prominent use case. However, current research often focuses on standard performance benchmarks, leaving…

Computation and Language · Computer Science 2023-10-26 Giuseppe Attanasio , Flor Miriam Plaza-del-Arco , Debora Nozza , Anne Lauscher

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

Computation and Language · Computer Science 2021-07-27 Jonas-Dario Troles , Ute Schmid

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

Computation and Language · Computer Science 2023-06-28 Sophie Jentzsch , Cigdem Turan

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Gender bias in Language and Vision datasets and models has the potential to perpetuate harmful stereotypes and discrimination. We analyze gender bias in two Language and Vision datasets. Consistent with prior work, we find that both…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Sophia Harrison , Eleonora Gualdoni , Gemma Boleda

Machine translation often suffers from biased data and algorithms that can lead to unacceptable errors in system output. While bias in gender norms has been investigated, less is known about whether MT systems encode bias about social…

Computation and Language · Computer Science 2024-07-15 Ian Stewart , Rada Mihalcea

As Generative AI rises in adoption, its use has expanded to include domains such as hiring and recruiting. However, without examining the potential of bias, this may negatively impact marginalized populations, including people with…

Computers and Society · Computer Science 2024-05-24 Kate Glazko , Yusuf Mohammed , Ben Kosa , Venkatesh Potluri , Jennifer Mankoff

LLMs have emerged as a promising tool for assisting individuals in diverse text-generation tasks, including job-related texts. However, LLM-generated answers have been increasingly found to exhibit gender bias. This study evaluates three…

Computation and Language · Computer Science 2024-12-02 Haein Kong , Yongsu Ahn , Sangyub Lee , Yunho Maeng

Despite widespread use in natural language processing (NLP) tasks, word embeddings have been criticized for inheriting unintended gender bias from training corpora. programmer is more closely associated with man and homemaker is more…

Computation and Language · Computer Science 2021-04-15 Haswanth Aekula , Sugam Garg , Animesh Gupta

Commercial voice assistants are largely feminized and associated with stereotypically feminine traits such as warmth and submissiveness. As these assistants continue to be adopted for everyday uses, it is imperative to understand how the…

Human-Computer Interaction · Computer Science 2024-09-25 Amama Mahmood , Chien-Ming Huang

Different ways of linguistically expressing the same real-world event can lead to different perceptions of what happened. Previous work has shown that different descriptions of gender-based violence (GBV) influence the reader's perception…

Computation and Language · Computer Science 2023-06-02 Gosse Minnema , Huiyuan Lai , Benedetta Muscato , Malvina Nissim

Gender-fair language aims at promoting gender equality by using terms and expressions that include all identities and avoid reinforcing gender stereotypes. Implementing gender-fair strategies is particularly challenging in heavily…

It has been observed that large-scale language models capture undesirable societal biases, e.g. relating to race and gender; yet religious bias has been relatively unexplored. We demonstrate that GPT-3, a state-of-the-art contextual…

Computation and Language · Computer Science 2021-01-19 Abubakar Abid , Maheen Farooqi , James Zou

Large language models (LLMs) are becoming increasingly ubiquitous in our daily lives, but numerous concerns about bias in LLMs exist. This study examines how gender-diverse populations perceive bias, accuracy, and trustworthiness in LLMs,…

Human-Computer Interaction · Computer Science 2025-07-09 Aimen Gaba , Emily Wall , Tejas Ramkumar Babu , Yuriy Brun , Kyle Hall , Cindy Xiong Bearfield

In this paper, as a case study, we present a systematic study of gender bias in machine translation with Google Translate. We translated sentences containing names of occupations from Hungarian, a language with gender-neutral pronouns, into…

Machine Learning · Statistics 2021-12-21 Anna Farkas , Renáta Németh

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian