中文
相关论文

相关论文: Evaluating Large Language Models through Gender an…

200 篇论文

Large language models (LLMs) have been shown to propagate and amplify harmful stereotypes, particularly those that disproportionately affect marginalised communities. To understand the effect of these stereotypes more comprehensively, we…

计算与语言 · 计算机科学 2024-10-10 Zara Siddique , Liam D. Turner , Luis Espinosa-Anke

As Large Language Models (LLMs) are increasingly used across different applications, concerns about their potential to amplify gender biases in various tasks are rising. Prior research has often probed gender bias using explicit gender cues…

计算与语言 · 计算机科学 2025-08-06 Shahed Masoudian , Gustavo Escobedo , Hannah Strauss , Markus Schedl

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

计算与语言 · 计算机科学 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

In recent years, significant advancements in the field of Natural Language Processing (NLP) have positioned commercialized language models as wide-reaching, highly useful tools. In tandem, there has been an explosion of multidisciplinary…

计算机与社会 · 计算机科学 2025-11-19 Jacob Hobbs

Are large language models (LLMs) biased in favor of communications produced by LLMs, leading to possible antihuman discrimination? Using a classical experimental design inspired by employment discrimination studies, we tested widely used…

计算与语言 · 计算机科学 2025-08-12 Walter Laurito , Benjamin Davis , Peli Grietzer , Tomáš Gavenčiak , Ada Böhm , Jan Kulveit

The emergence of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) has marked a new era of Natural Language Processing (NLP), introducing unprecedented capabilities that are revolutionizing various domains. This paper…

计算与语言 · 计算机科学 2024-08-26 Desta Haileselassie Hagos , Rick Battle , Danda B. Rawat

Large language models (LLMs) acquire beliefs about gender from training data and can therefore generate text with stereotypical gender attitudes. Prior studies have demonstrated model generations favor one gender or exhibit stereotypes…

计算与语言 · 计算机科学 2024-10-16 Sharon Levy , William D. Adler , Tahilin Sanchez Karver , Mark Dredze , Michelle R. Kaufman

The remarkable progress in Natural Language Processing (NLP) brought about by deep learning, particularly with the recent advent of large pre-trained neural language models, is brought into scrutiny as several studies began to discuss and…

计算与语言 · 计算机科学 2023-01-25 Anoop K. , Manjary P. Gangan , Deepak P. , Lajish V. L

This paper investigates biases of Large Language Models (LLMs) through the lens of grammatical gender. Drawing inspiration from seminal works in psycholinguistics, particularly the study of gender's influence on language perception, we…

计算与语言 · 计算机科学 2024-07-16 Viktor Mihaylov , Aleksandar Shtedritski

Large Language Models (LLMs), such as GPT-4 and BERT, have rapidly gained traction in natural language processing (NLP) and are now integral to financial decision-making. However, their deployment introduces critical challenges,…

计算机与社会 · 计算机科学 2024-10-29 Hui Zhong , Songsheng Chen , Mian Liang

This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. We find evidence that gender stereotype…

计算与语言 · 计算机科学 2021-02-17 Daniel de Vassimon Manela , David Errington , Thomas Fisher , Boris van Breugel , Pasquale Minervini

Large Language Models (LLMs) are trained primarily on minimally processed web text, which exhibits the same wide range of social biases held by the humans who created that content. Consequently, text generated by LLMs can inadvertently…

计算与语言 · 计算机科学 2023-07-04 Harnoor Dhingra , Preetiha Jayashanker , Sayali Moghe , Emma Strubell

Large language models (LLMs) have shown significant potential to change how we write, communicate, and create, leading to rapid adoption across society. This dissertation examines how individuals and institutions are adapting to and…

计算与语言 · 计算机科学 2025-06-24 Weixin Liang

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

机器学习 · 计算机科学 2024-04-04 Anna Kruspe

Hundreds of millions of people now interact with language models, with uses ranging from serving as a writing aid to informing hiring decisions. Yet these language models are known to perpetuate systematic racial prejudices, making their…

计算与语言 · 计算机科学 2024-03-04 Valentin Hofmann , Pratyusha Ria Kalluri , Dan Jurafsky , Sharese King

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

人工智能 · 计算机科学 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

Chat-based large language models have the opportunity to empower individuals lacking high-quality healthcare access to receive personalized information across a variety of topics. However, users may ask underspecified questions that require…

计算与语言 · 计算机科学 2024-03-11 Sharon Levy , Tahilin Sanchez Karver , William D. Adler , Michelle R. Kaufman , Mark Dredze

Warning: This research studies AI persuasion and bias amplification that could be misused; all experiments are for safety evaluation. Large Language Models (LLMs) now generate convincing, human-like text and are widely used in content…

计算与语言 · 计算机科学 2025-08-25 Saumya Roy

Recently there are increasing concerns about the fairness of Artificial Intelligence (AI) in real-world applications such as computer vision and recommendations. For example, recognition algorithms in computer vision are unfair to black…

计算与语言 · 计算机科学 2020-11-03 Haochen Liu , Jamell Dacon , Wenqi Fan , Hui Liu , Zitao Liu , Jiliang Tang

The use of Large Language Models (LLMs) has proven to be a tool that could help in the automatic detection of sexism. Previous studies have shown that these models contain biases that do not accurately reflect reality, especially for…

计算与语言 · 计算机科学 2025-08-26 Judith Tavarez-Rodríguez , Fernando Sánchez-Vega , A. Pastor López-Monroy