中文
相关论文

相关论文: Causally Testing Gender Bias in LLMs: A Case Study…

200 篇论文

Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such…

计算与语言 · 计算机科学 2025-06-09 Bhavik Chandna , Zubair Bashir , Procheta Sen

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

人工智能 · 计算机科学 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

Background: Large language models (LLMs) are rapidly being integrated into healthcare, promising to enhance various clinical tasks. However, concerns exist regarding their potential for bias, which could compromise patient care and…

The use of Large Language Models (LLMs) in hiring has led to legislative actions to protect vulnerable demographic groups. This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models…

计算与语言 · 计算机科学 2025-01-20 Ze Wang , Zekun Wu , Xin Guan , Michael Thaler , Adriano Koshiyama , Skylar Lu , Sachin Beepath , Ediz Ertekin , Maria Perez-Ortiz

Large Language Models (LLMs) have been shown to be biased in prior work, as they generate text that is in line with stereotypical views of the world or that is not representative of the viewpoints and values of historically marginalized…

计算与语言 · 计算机科学 2025-02-07 Laura Biester

Large Language Models (LLMs) have recently emerged as an effective tool to assist individuals in writing various types of content, including professional documents such as recommendation letters. Though bringing convenience, this…

计算与语言 · 计算机科学 2023-12-05 Yixin Wan , George Pu , Jiao Sun , Aparna Garimella , Kai-Wei Chang , Nanyun Peng

Large language models (LLMs) are increasingly used for everyday communication tasks, including drafting interpersonal messages intended to influence and persuade. Prior work has shown that LLMs can successfully persuade humans and amplify…

计算与语言 · 计算机科学 2026-01-12 Amalie Brogaard Pauli , Maria Barrett , Max Müller-Eberstein , Isabelle Augenstein , Ira Assent

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

应用统计 · 统计学 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

This paper presents a systematic analysis of biases in open-source Large Language Models (LLMs), across gender, religion, and race. Our study evaluates bias in smaller-scale Llama and Gemma models using the SALT ($\textbf{S}$ocial…

计算与语言 · 计算机科学 2025-02-19 Samee Arif , Zohaib Khan , Maaidah Kaleem , Suhaib Rashid , Agha Ali Raza , Awais Athar

We present GenderBench -- a comprehensive evaluation suite designed to measure gender biases in LLMs. GenderBench includes 14 probes that quantify 19 gender-related harmful behaviors exhibited by LLMs. We release GenderBench as an…

计算与语言 · 计算机科学 2025-05-20 Matúš Pikuliak

The rapid growth of Large Language Models (LLMs) has put forward the study of biases as a crucial field. It is important to assess the influence of different types of biases embedded in LLMs to ensure fair use in sensitive fields. Although…

计算与语言 · 计算机科学 2024-12-16 Jayanta Sadhu , Maneesha Rani Saha , Rifat Shahriyar

LLMs have emerged as a promising tool for assisting individuals in diverse text-generation tasks, including job-related texts. However, LLM-generated answers have been increasingly found to exhibit gender bias. This study evaluates three…

计算与语言 · 计算机科学 2024-12-02 Haein Kong , Yongsu Ahn , Sangyub Lee , Yunho Maeng

As large language models (LLMs) become an important way of information access, there have been increasing concerns that LLMs may intensify the spread of unethical content, including implicit bias that hurts certain populations without…

计算与语言 · 计算机科学 2025-07-14 Yuchen Wen , Keping Bi , Wei Chen , Jiafeng Guo , Xueqi Cheng

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

计算与语言 · 计算机科学 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

计算与语言 · 计算机科学 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Large language models (LLMs) have exhibited remarkable capabilities in natural language generation, but they have also been observed to magnify societal biases, particularly those related to gender. In response to this issue, several…

计算与语言 · 计算机科学 2025-02-25 Kunsheng Tang , Wenbo Zhou , Jie Zhang , Aishan Liu , Gelei Deng , Shuai Li , Peigui Qi , Weiming Zhang , Tianwei Zhang , Nenghai Yu

This paper investigates biases of Large Language Models (LLMs) through the lens of grammatical gender. Drawing inspiration from seminal works in psycholinguistics, particularly the study of gender's influence on language perception, we…

计算与语言 · 计算机科学 2024-07-16 Viktor Mihaylov , Aleksandar Shtedritski

A large body of research has found substantial gender bias in NLP systems. Most of this research takes a binary, essentialist view of gender: limiting its variation to the categories _men_ and _women_, conflating gender with sex, and…

计算与语言 · 计算机科学 2025-09-25 Ruby Ostrow , Adam Lopez

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

计算与语言 · 计算机科学 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin