English
Related papers

Related papers: Fairness in AI Systems: Mitigating gender bias fro…

200 papers

Multi-modal search engines have experienced significant growth and widespread use in recent years, making them the second most common internet use. While search engine systems offer a range of services, the image search field has recently…

Information Retrieval · Computer Science 2023-08-23 Swagatika Dash

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This…

Computers and Society · Computer Science 2025-02-18 Xiahua Wei , Naveen Kumar , Han Zhang

Assessments of algorithmic bias in large language models (LLMs) are generally catered to uncovering systemic discrimination based on protected characteristics such as sex and ethnicity. However, there are over 180 documented cognitive…

Human-Computer Interaction · Computer Science 2023-08-30 Alaina N. Talboy , Elizabeth Fuller

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Automated systems built on artificial intelligence (AI) are increasingly deployed across high-stakes domains, raising critical concerns about fairness and the perpetuation of demographic disparities that exist in the world. In this context,…

Artificial Intelligence · Computer Science 2026-05-19 Drago Plecko

Xenophobia is one of the key drivers of marginalisation, discrimination, and conflict, yet many prominent machine learning (ML) fairness frameworks fail to comprehensively measure or mitigate the resulting xenophobic harms. Here we aim to…

Computers and Society · Computer Science 2023-10-09 Nenad Tomasev , Jonathan Leader Maynard , Iason Gabriel

Large Language Models (LLMs) are increasingly utilized in educational tasks such as providing writing suggestions to students. Despite their potential, LLMs are known to harbor inherent biases which may negatively impact learners. Previous…

Computation and Language · Computer Science 2023-11-07 Thiemo Wambsganss , Xiaotian Su , Vinitra Swamy , Seyed Parsa Neshaei , Roman Rietsche , Tanja Käser

Numerous debiasing techniques have been proposed to mitigate the gender bias that is prevalent in pretrained language models. These are often evaluated on datasets that check the extent to which the model is gender-neutral in its…

Computation and Language · Computer Science 2023-10-24 Mahdi Zakizadeh , Kaveh Eskandari Miandoab , Mohammad Taher Pilehvar

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Recent breakthroughs in self supervised training have led to a new class of pretrained vision language models. While there have been investigations of bias in multimodal models, they have mostly focused on gender and racial bias, giving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Sepehr Janghorbani , Gerard de Melo

Large language models (LLMs) are known to perpetuate stereotypes and exhibit biases. Various strategies have been proposed to mitigate these biases, but most work studies biases as a black-box problem without considering how concepts are…

Computation and Language · Computer Science 2025-09-19 Hannah Cyberey , Yangfeng Ji , David Evans

In response to calls for greater interdisciplinary involvement from the social sciences and humanities in the development, governance, and study of artificial intelligence systems, this paper presents one sociologist's view on the problem…

Computers and Society · Computer Science 2021-02-10 Mike Zajko

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a…

Machine Learning · Computer Science 2022-04-12 Mingyang Wan , Daochen Zha , Ninghao Liu , Na Zou

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

AI systems have been known to amplify biases in real-world data. Explanations may help human-AI teams address these biases for fairer decision-making. Typically, explanations focus on salient input features. If a model is biased against…

Artificial Intelligence · Computer Science 2024-04-10 Navita Goyal , Connor Baumler , Tin Nguyen , Hal Daumé

As the capabilities of generative language models continue to advance, the implications of biases ingrained within these models have garnered increasing attention from researchers, practitioners, and the broader public. This article…

Computers and Society · Computer Science 2023-11-14 Emilio Ferrara

Bias issues of neural networks garner significant attention along with its promising advancement. Among various bias issues, mitigating two predominant biases is crucial in advancing fair and trustworthy AI: (1) ensuring neural networks…

Machine Learning · Computer Science 2025-02-18 Jiazhi Li , Mahyar Khayatkhoei , Jiageng Zhu , Hanchen Xie , Mohamed E. Hussein , Wael AbdAlmageed

Recent advances and applications of language technology and artificial intelligence have enabled much success across multiple domains like law, medical and mental health. AI-based Language Models, like Judgement Prediction, have recently…

Computation and Language · Computer Science 2024-05-15 Sahil Girhepuje , Anmol Goel , Gokul S Krishnan , Shreya Goyal , Satyendra Pandey , Ponnurangam Kumaraguru , Balaraman Ravindran