English
Related papers

Related papers: Fairness in AI Systems: Mitigating gender bias fro…

200 papers

The rapid advancement of Large Language Models (LLMs) has sparked intense debate regarding the prevalence of bias in these models and its mitigation. Yet, as exemplified by both results on debiasing methods in the literature and reports of…

Computation and Language · Computer Science 2024-05-14 David F. Jenny , Yann Billeter , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

AI agents are increasingly deployed and used to make automated decisions that affect our lives on a daily basis. It is imperative to ensure that these systems embed ethical principles and respect human values. We focus on how we can attest…

Artificial Intelligence · Computer Science 2019-09-11 Xavier Ferrer Aran , Jose M. Such , Natalia Criado

Natural Language Processing (NLP) models have been found discriminative against groups of different social identities such as gender and race. With the negative consequences of these undesired biases, researchers have responded with…

Computation and Language · Computer Science 2022-05-26 Lu Cheng , Suyu Ge , Huan Liu

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

There has been concern within the artificial intelligence (AI) community and the broader society regarding the potential lack of fairness of AI-based decision-making systems. Surprisingly, there is little work quantifying and guaranteeing…

Machine Learning · Computer Science 2023-01-31 Wenbin Zhang , Jeremy C. Weiss

Massive efforts are made to reduce biases in both data and algorithms in order to render AI applications fair. These efforts are propelled by various high-profile cases where biased algorithmic decision-making caused harm to women, people…

Machine Learning · Computer Science 2022-09-01 Thilo Hagendorff , Leonie Bossert , Tse Yip Fai , Peter Singer

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

Computation and Language · Computer Science 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

The gender bias present in the data on which language models are pre-trained gets reflected in the systems that use these models. The model's intrinsic gender bias shows an outdated and unequal view of women in our culture and encourages…

Computation and Language · Computer Science 2022-09-09 Neeraja Kirtane , V Manushree , Aditya Kane

The increasing tendency to collect large and uncurated datasets to train vision-and-language models has raised concerns about fair representations. It is known that even small but manually annotated datasets, such as MSCOCO, are affected by…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Noa Garcia , Yusuke Hirota , Yankun Wu , Yuta Nakashima

Recent progress in Text-to-Image (T2I) generative models has enabled high-quality image generation. As performance and accessibility increase, these models are gaining significant attraction and popularity: ensuring their fairness and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Moreno D'Incà , Elia Peruzzo , Massimiliano Mancini , Xingqian Xu , Humphrey Shi , Nicu Sebe

Vision-language models are growing in popularity and public visibility to generate, edit, and caption images at scale; but their outputs can perpetuate and amplify societal biases learned during pre-training on uncurated image-text pairs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Brandon Smith , Miguel Farinha , Siobhan Mackenzie Hall , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

Defining fairness in AI remains a persistent challenge, largely due to its deeply context-dependent nature and the lack of a universal definition. While numerous mathematical formulations of fairness exist, they sometimes conflict with one…

Computers and Society · Computer Science 2025-05-05 Kessia Nepomuceno , Fabio Petrillo

Speech remains one of the most visible yet overlooked vectors of inclusion and exclusion in contemporary society. While fluency is often equated with credibility and competence, individuals with atypical speech patterns are routinely…

Human-Computer Interaction · Computer Science 2026-01-30 Onyedikachi Hope Amaechi-Okorie , Branislav Radeljic

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Algorithms learned from data are increasingly used for deciding many aspects in our life: from movies we see, to prices we pay, or medicine we get. Yet there is growing evidence that decision making by inappropriately trained algorithms may…

Artificial Intelligence · Computer Science 2017-08-03 Indre Zliobaite

As the role of algorithmic systems and processes increases in society, so does the risk of bias, which can result in discrimination against individuals and social groups. Research on algorithmic bias has exploded in recent years,…

We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Biased NLP models can perpetuate stereotypes and lead to algorithmic discrimination, posing a significant…

Computation and Language · Computer Science 2023-08-09 Pranav Narayanan Venkit , Sanjana Gautam , Ruchi Panchanadikar , Ting-Hao `Kenneth' Huang , Shomir Wilson