中文
相关论文

相关论文: Gender Encoding Patterns in Pretrained Language Mo…

200 篇论文

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

机器学习 · 计算机科学 2019-11-21 Komal K. Teru , Aishik Chakraborty

Recent studies have shown that generative language models often reflect and amplify societal biases in their outputs. However, these studies frequently conflate observed biases with other task-specific shortcomings, such as comprehension…

计算与语言 · 计算机科学 2024-12-17 Akshita Jha , Sanchit Kabra , Chandan K. Reddy

Vision-language models (VLMs) have gained widespread adoption in both industry and academia. In this study, we propose a unified framework for systematically evaluating gender, race, and age biases in VLMs with respect to professions. Our…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Ashutosh Sathe , Prachi Jain , Sunayana Sitaram

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

机器学习 · 计算机科学 2021-06-22 Tal Feldman , Ashley Peake

Pre-trained language models encode undesirable social biases, which are further exacerbated in downstream use. To this end, we propose MABEL (a Method for Attenuating Gender Bias using Entailment Labels), an intermediate pre-training…

计算与语言 · 计算机科学 2022-10-28 Jacqueline He , Mengzhou Xia , Christiane Fellbaum , Danqi Chen

The pervasive spread of misinformation and disinformation in social media underscores the critical importance of detecting media bias. While robust Large Language Models (LLMs) have emerged as foundational tools for bias prediction,…

计算机与社会 · 计算机科学 2024-12-11 Luyang Lin , Lingzhi Wang , Jinsong Guo , Kam-Fai Wong

The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such…

机器学习 · 计算机科学 2024-04-16 Biswajit Rout , Ananya B. Sai , Arun Rajkumar

Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in…

计算与语言 · 计算机科学 2023-04-13 Inna Wanyin Lin , Lucille Njoo , Anjalie Field , Ashish Sharma , Katharina Reinecke , Tim Althoff , Yulia Tsvetkov

Large language models (LLMs) reflect societal norms and biases, especially about gender. While societal biases and stereotypes have been extensively researched in various NLP applications, there is a surprising gap for emotion analysis.…

计算与语言 · 计算机科学 2024-05-29 Flor Miriam Plaza-del-Arco , Amanda Cercas Curry , Alba Curry , Gavin Abercrombie , Dirk Hovy

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

计算与语言 · 计算机科学 2022-05-13 Neeraja Kirtane , Tanvi Anand

Although value-aligned language models (LMs) appear unbiased in explicit bias evaluations, they often exhibit stereotypes in implicit word association tasks, raising concerns about their fair usage. We investigate the mechanisms behind this…

计算与语言 · 计算机科学 2025-06-10 Lihao Sun , Chengzhi Mao , Valentin Hofmann , Xuechunzi Bai

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

计算与语言 · 计算机科学 2022-11-29 Kenan Tang , Hanchun Jiang

Large Language Models (LLMs) are powerful tools with the potential to benefit society immensely, yet, they have demonstrated biases that perpetuate societal inequalities. Despite significant advancements in bias mitigation techniques using…

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

计算与语言 · 计算机科学 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

Word embeddings are widely used in NLP for a vast range of tasks. It was shown that word embeddings derived from text corpora reflect gender biases in society. This phenomenon is pervasive and consistent across different word embedding…

计算与语言 · 计算机科学 2019-09-25 Hila Gonen , Yoav Goldberg

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

计算机与社会 · 计算机科学 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

计算与语言 · 计算机科学 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

计算与语言 · 计算机科学 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Language models (LMs) exhibit and amplify many types of undesirable biases learned from the training data, including gender bias. However, we lack tools for effectively and efficiently changing this behavior without hurting general language…

计算与语言 · 计算机科学 2023-10-20 Abhijith Chintam , Rahel Beloch , Willem Zuidema , Michael Hanna , Oskar van der Wal

As teachers increasingly turn to GenAI in their educational practice, we need robust methods to benchmark large language models (LLMs) for pedagogical purposes. This article presents an embedding-based benchmarking framework to detect bias…

计算与语言 · 计算机科学 2026-04-02 Yishan Du , Conrad Borchers , Mutlu Cukurova