中文
相关论文

相关论文: Surprising gender biases in GPT

200 篇论文

In this multicultural age, language translation is one of the most performed tasks, and it is becoming increasingly AI-moderated and automated. As a novel AI system, ChatGPT claims to be proficient in such translation tasks and in this…

计算机与社会 · 计算机科学 2024-08-06 Sourojit Ghosh , Aylin Caliskan

To examine whether intersectional bias can be observed in language generation, we examine \emph{GPT-2} and \emph{GPT-NEO} models, ranging in size from 124 million to ~2.7 billion parameters. We conduct an experiment combining up to three…

计算与语言 · 计算机科学 2021-07-19 Liam Magee , Lida Ghahremanlou , Karen Soldatic , Shanthi Robertson

With the impressive performance in various downstream tasks, large language models (LLMs) have been widely integrated into production pipelines, like recruitment and recommendation systems. A known issue of models trained on natural…

计算与语言 · 计算机科学 2025-01-22 Damin Zhang , Yi Zhang , Geetanjali Bihani , Julia Rayz

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

计算与语言 · 计算机科学 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Recent instruction fine-tuned models can solve multiple NLP tasks when prompted to do so, with machine translation (MT) being a prominent use case. However, current research often focuses on standard performance benchmarks, leaving…

计算与语言 · 计算机科学 2023-10-26 Giuseppe Attanasio , Flor Miriam Plaza-del-Arco , Debora Nozza , Anne Lauscher

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

计算与语言 · 计算机科学 2021-07-27 Jonas-Dario Troles , Ute Schmid

Pretrained language models are publicly available and constantly finetuned for various real-life applications. As they become capable of grasping complex contextual information, harmful biases are likely increasingly intertwined with those…

计算与语言 · 计算机科学 2023-06-28 Sophie Jentzsch , Cigdem Turan

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

计算与语言 · 计算机科学 2023-09-04 Vishesh Thakur

Gender bias in Language and Vision datasets and models has the potential to perpetuate harmful stereotypes and discrimination. We analyze gender bias in two Language and Vision datasets. Consistent with prior work, we find that both…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Sophia Harrison , Eleonora Gualdoni , Gemma Boleda

Machine translation often suffers from biased data and algorithms that can lead to unacceptable errors in system output. While bias in gender norms has been investigated, less is known about whether MT systems encode bias about social…

计算与语言 · 计算机科学 2024-07-15 Ian Stewart , Rada Mihalcea

As Generative AI rises in adoption, its use has expanded to include domains such as hiring and recruiting. However, without examining the potential of bias, this may negatively impact marginalized populations, including people with…

计算机与社会 · 计算机科学 2024-05-24 Kate Glazko , Yusuf Mohammed , Ben Kosa , Venkatesh Potluri , Jennifer Mankoff

LLMs have emerged as a promising tool for assisting individuals in diverse text-generation tasks, including job-related texts. However, LLM-generated answers have been increasingly found to exhibit gender bias. This study evaluates three…

计算与语言 · 计算机科学 2024-12-02 Haein Kong , Yongsu Ahn , Sangyub Lee , Yunho Maeng

Despite widespread use in natural language processing (NLP) tasks, word embeddings have been criticized for inheriting unintended gender bias from training corpora. programmer is more closely associated with man and homemaker is more…

计算与语言 · 计算机科学 2021-04-15 Haswanth Aekula , Sugam Garg , Animesh Gupta

Commercial voice assistants are largely feminized and associated with stereotypically feminine traits such as warmth and submissiveness. As these assistants continue to be adopted for everyday uses, it is imperative to understand how the…

人机交互 · 计算机科学 2024-09-25 Amama Mahmood , Chien-Ming Huang

Different ways of linguistically expressing the same real-world event can lead to different perceptions of what happened. Previous work has shown that different descriptions of gender-based violence (GBV) influence the reader's perception…

计算与语言 · 计算机科学 2023-06-02 Gosse Minnema , Huiyuan Lai , Benedetta Muscato , Malvina Nissim

Gender-fair language aims at promoting gender equality by using terms and expressions that include all identities and avoid reinforcing gender stereotypes. Implementing gender-fair strategies is particularly challenging in heavily…

It has been observed that large-scale language models capture undesirable societal biases, e.g. relating to race and gender; yet religious bias has been relatively unexplored. We demonstrate that GPT-3, a state-of-the-art contextual…

计算与语言 · 计算机科学 2021-01-19 Abubakar Abid , Maheen Farooqi , James Zou

Large language models (LLMs) are becoming increasingly ubiquitous in our daily lives, but numerous concerns about bias in LLMs exist. This study examines how gender-diverse populations perceive bias, accuracy, and trustworthiness in LLMs,…

人机交互 · 计算机科学 2025-07-09 Aimen Gaba , Emily Wall , Tejas Ramkumar Babu , Yuriy Brun , Kyle Hall , Cindy Xiong Bearfield

In this paper, as a case study, we present a systematic study of gender bias in machine translation with Google Translate. We translated sentences containing names of occupations from Hungarian, a language with gender-neutral pronouns, into…

机器学习 · 统计学 2021-12-21 Anna Farkas , Renáta Németh

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

计算与语言 · 计算机科学 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian