English
Related papers

Related papers: Assessing Gender Bias in Predictive Algorithms usi…

200 papers

Deep learning (DL) models are widely used to provide a more convenient and smarter life. However, biased algorithms will negatively influence us. For instance, groups targeted by biased algorithms will feel unfairly treated and even fearful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Xuyang Shen , Jo Plested , Sabrina Caldwell , Tom Gedeon

Artificial Intelligence has the potential to exacerbate societal bias and set back decades of advances in equal rights and civil liberty. Data used to train machine learning algorithms may capture social injustices, inequality or…

Computers and Society · Computer Science 2020-08-18 Susan Leavy , Barry O'Sullivan , Eugenia Siapera

Artificial intelligence (AI) is gaining momentum, and its importance for the future of work in many areas, such as medicine and banking, is continuously rising. However, insights on the effective collaboration of humans and AI are still…

Human-Computer Interaction · Computer Science 2022-04-20 Max Schemmer , Niklas Kühl , Carina Benz , Gerhard Satzger

Why do biased predictions arise? What interventions can prevent them? We evaluate 8.2 million algorithmic predictions of math performance from $\approx$400 AI engineers, each of whom developed an algorithm under a randomly assigned…

General Economics · Economics 2020-12-07 Bo Cowgill , Fabrizio Dell'Acqua , Samuel Deng , Daniel Hsu , Nakul Verma , Augustin Chaintreau

Does machine learning and AI ensure that social biases thrive ? This paper aims to analyse this issue. Indeed, as algorithms are informed by data, if these are corrupted, from a social bias perspective, good machine learning algorithms…

Machine Learning · Statistics 2020-11-03 Bertrand K. Hassani

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Automated computer vision systems have been applied in many domains including security, law enforcement, and personal devices, but recent reports suggest that these systems may produce biased results, discriminating against people in…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Jungseock Joo , Kimmo Kärkkäinen

Applications based on Machine Learning models have now become an indispensable part of the everyday life and the professional world. A critical question then recently arised among the population: Do algorithmic decisions convey any type of…

Machine Learning · Statistics 2020-04-07 Philippe Besse , Eustasio del Barrio , Paula Gordaliza , Jean-Michel Loubes , Laurent Risser

Automated gender classification has important applications in many domains, such as demographic research, law enforcement, online advertising, as well as human-computer interaction. Recent research has questioned the fairness of this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Anoop Krishnan , Ali Almadan , Ajita Rattani

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Language data and models demonstrate various types of bias, be it ethnic, religious, gender, or socioeconomic. AI/NLP models, when trained on the racially biased dataset, AI/NLP models instigate poor model explainability, influence user…

Computation and Language · Computer Science 2022-11-28 Kinshuk Sengupta , Praveen Ranjan Srivastava

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Neural networks achieve the state-of-the-art in image classification tasks. However, they can encode spurious variations or biases that may be present in the training data. For example, training an age predictor on a dataset that is not…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Mohsan Alvi , Andrew Zisserman , Christoffer Nellaker

Time series prediction algorithms are increasingly central to decision-making in high-stakes domains such as healthcare, energy management, and economic planning. Yet, these systems often inherit and amplify biases embedded in historical…

Econometrics · Economics 2025-12-19 Bagattini Alexander , Chen Shao

Face recognition algorithms, when used in the real world, can be very useful, but they can also be dangerous when biased toward certain demographics. So, it is essential to understand how these algorithms are trained and what factors affect…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Manideep Kolla , Aravinth Savadamuthu

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Biases inherent in both data and algorithms make the fairness of widespread machine learning (ML)-based decision-making systems less than optimal. To improve the trustfulness of such ML decision systems, it is crucial to be aware of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Biying Fu , Naser Damer

Published studies have suggested the bias of automated face-based gender classification algorithms across gender-race groups. Specifically, unequal accuracy rates were obtained for women and dark-skinned people. To mitigate the bias of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Sreeraj Ramachandran , Ajita Rattani

Algorithmic bias has been the subject of much recent controversy. To clarify what is at stake and to make progress resolving the controversy, a better understanding of the concepts involved would be helpful. The discussion here focuses on…

Computers and Society · Computer Science 2025-05-21 Catherine Stinson

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen