English
Related papers

Related papers: Gender Encoding Patterns in Pretrained Language Mo…

200 papers

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

Machine Learning · Computer Science 2019-11-21 Komal K. Teru , Aishik Chakraborty

Recent studies have shown that generative language models often reflect and amplify societal biases in their outputs. However, these studies frequently conflate observed biases with other task-specific shortcomings, such as comprehension…

Computation and Language · Computer Science 2024-12-17 Akshita Jha , Sanchit Kabra , Chandan K. Reddy

Vision-language models (VLMs) have gained widespread adoption in both industry and academia. In this study, we propose a unified framework for systematically evaluating gender, race, and age biases in VLMs with respect to professions. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Ashutosh Sathe , Prachi Jain , Sunayana Sitaram

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Pre-trained language models encode undesirable social biases, which are further exacerbated in downstream use. To this end, we propose MABEL (a Method for Attenuating Gender Bias using Entailment Labels), an intermediate pre-training…

Computation and Language · Computer Science 2022-10-28 Jacqueline He , Mengzhou Xia , Christiane Fellbaum , Danqi Chen

The pervasive spread of misinformation and disinformation in social media underscores the critical importance of detecting media bias. While robust Large Language Models (LLMs) have emerged as foundational tools for bias prediction,…

Computers and Society · Computer Science 2024-12-11 Luyang Lin , Lingzhi Wang , Jinsong Guo , Kam-Fai Wong

The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such…

Machine Learning · Computer Science 2024-04-16 Biswajit Rout , Ananya B. Sai , Arun Rajkumar

Mental health stigma prevents many individuals from receiving the appropriate care, and social psychology studies have shown that mental health tends to be overlooked in men. In this work, we investigate gendered mental health stigma in…

Computation and Language · Computer Science 2023-04-13 Inna Wanyin Lin , Lucille Njoo , Anjalie Field , Ashish Sharma , Katharina Reinecke , Tim Althoff , Yulia Tsvetkov

Large language models (LLMs) reflect societal norms and biases, especially about gender. While societal biases and stereotypes have been extensively researched in various NLP applications, there is a surprising gap for emotion analysis.…

Computation and Language · Computer Science 2024-05-29 Flor Miriam Plaza-del-Arco , Amanda Cercas Curry , Alba Curry , Gavin Abercrombie , Dirk Hovy

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

Computation and Language · Computer Science 2022-05-13 Neeraja Kirtane , Tanvi Anand

Although value-aligned language models (LMs) appear unbiased in explicit bias evaluations, they often exhibit stereotypes in implicit word association tasks, raising concerns about their fair usage. We investigate the mechanisms behind this…

Computation and Language · Computer Science 2025-06-10 Lihao Sun , Chengzhi Mao , Valentin Hofmann , Xuechunzi Bai

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Large Language Models (LLMs) are powerful tools with the potential to benefit society immensely, yet, they have demonstrated biases that perpetuate societal inequalities. Despite significant advancements in bias mitigation techniques using…

Computation and Language · Computer Science 2024-09-24 Deonna M. Owens , Ryan A. Rossi , Sungchul Kim , Tong Yu , Franck Dernoncourt , Xiang Chen , Ruiyi Zhang , Jiuxiang Gu , Hanieh Deilamsalehy , Nedim Lipka

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

Computation and Language · Computer Science 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

Word embeddings are widely used in NLP for a vast range of tasks. It was shown that word embeddings derived from text corpora reflect gender biases in society. This phenomenon is pervasive and consistent across different word embedding…

Computation and Language · Computer Science 2019-09-25 Hila Gonen , Yoav Goldberg

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

Computers and Society · Computer Science 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Language models (LMs) exhibit and amplify many types of undesirable biases learned from the training data, including gender bias. However, we lack tools for effectively and efficiently changing this behavior without hurting general language…

Computation and Language · Computer Science 2023-10-20 Abhijith Chintam , Rahel Beloch , Willem Zuidema , Michael Hanna , Oskar van der Wal

As teachers increasingly turn to GenAI in their educational practice, we need robust methods to benchmark large language models (LLMs) for pedagogical purposes. This article presents an embedding-based benchmarking framework to detect bias…

Computation and Language · Computer Science 2026-04-02 Yishan Du , Conrad Borchers , Mutlu Cukurova