English
Related papers

Related papers: Language Models Get a Gender Makeover: Mitigating …

200 papers

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

Machine Learning · Computer Science 2020-09-25 Chen Zhao , Feng Chen

Published studies have suggested the bias of automated face-based gender classification algorithms across gender-race groups. Specifically, unequal accuracy rates were obtained for women and dark-skinned people. To mitigate the bias of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Sreeraj Ramachandran , Ajita Rattani

Content Warning: This paper contains examples of misgendering and erasure that could be offensive and potentially triggering. Gender bias in language technologies has been widely studied, but research has mostly been restricted to a binary…

Computation and Language · Computer Science 2023-07-10 Tamanna Hossain , Sunipa Dev , Sameer Singh

Gender bias represents a form of systematic negative treatment that targets individuals based on their gender. This discrimination can range from subtle sexist remarks and gendered stereotypes to outright hate speech. Prior research has…

Computation and Language · Computer Science 2024-03-19 Karolina Stańczak

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Vision-language models are growing in popularity and public visibility to generate, edit, and caption images at scale; but their outputs can perpetuate and amplify societal biases learned during pre-training on uncurated image-text pairs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Brandon Smith , Miguel Farinha , Siobhan Mackenzie Hall , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Sociodemographic bias in language models (LMs) has the potential for harm when deployed in real-world settings. This paper presents a comprehensive survey of the past decade of research on sociodemographic bias in LMs, organized into a…

Computation and Language · Computer Science 2024-08-15 Vipul Gupta , Pranav Narayanan Venkit , Shomir Wilson , Rebecca J. Passonneau

Large Language Models (LLMs) have shown significant promise in various applications, including zero-shot and few-shot learning. However, their performance can be hampered by inherent biases. Instead of traditionally sought methods that aim…

Computation and Language · Computer Science 2024-01-19 Yong Zhang , Hanzhang Li , Zhitao Li , Ning Cheng , Ming Li , Jing Xiao , Jianzong Wang

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and…

Computation and Language · Computer Science 2021-05-13 Shanya Sharma , Manan Dey , Koustuv Sinha

Transfer learning is beneficial by allowing the expressive features of models pretrained on large-scale datasets to be finetuned for the target task of smaller, more domain-specific datasets. However, there is a concern that these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Angelina Wang , Olga Russakovsky

Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed…

Computation and Language · Computer Science 2024-04-11 Jeongrok Yu , Seong Ug Kim , Jacob Choi , Jinho D. Choi

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

The use of language technologies in high-stake settings is increasing in recent years, mostly motivated by the success of Large Language Models (LLMs). However, despite the great performance of LLMs, they are are susceptible to ethical…

Artificial Intelligence · Computer Science 2025-06-16 Alejandro Peña , Julian Fierrez , Aythami Morales , Gonzalo Mancera , Miguel Lopez , Ruben Tolosana

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

Due to the broad range of social media platforms, the requirements of abusive language detection systems are varied and ever-changing. Already a large set of annotated corpora with different properties and label sets were created, such as…

Computation and Language · Computer Science 2024-05-07 Viktor Hangya , Alexander Fraser

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Deep learning (DL) models are widely used to provide a more convenient and smarter life. However, biased algorithms will negatively influence us. For instance, groups targeted by biased algorithms will feel unfairly treated and even fearful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Xuyang Shen , Jo Plested , Sabrina Caldwell , Tom Gedeon

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model's parameters,…

Computation and Language · Computer Science 2023-06-21 Deepak Kumar , Oleg Lesota , George Zerveas , Daniel Cohen , Carsten Eickhoff , Markus Schedl , Navid Rekabsaz