English
Related papers

Related papers: Debiasing Credit Scoring using Evolutionary Algori…

200 papers

From massive face-recognition-based surveillance and machine-learning-based decision systems predicting crime recidivism rates, to the move towards automated health diagnostic systems, artificial intelligence (AI) is being used in scenarios…

Computers and Society · Computer Science 2019-08-20 Timnit Gebru

Credit is an essential component of financial wellbeing in America, and unequal access to it is a large factor in the economic disparities between demographic groups that exist today. Today, machine learning algorithms, sometimes trained on…

Machine Learning · Computer Science 2022-10-07 I. Elizabeth Kumar , Keegan E. Hines , John P. Dickerson

Recommender systems rely on user behavior data like ratings and clicks to build personalization model. However, the collected data is observational rather than experimental, causing various biases in the data which significantly affect the…

Machine Learning · Computer Science 2021-10-29 Jiawei Chen , Hande Dong , Yang Qiu , Xiangnan He , Xin Xin , Liang Chen , Guli Lin , Keping Yang

Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can…

Machine Learning · Computer Science 2025-07-22 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

In recent years, machine learning techniques have been increasingly applied in sensitive decision making processes, raising fairness concerns. Past research has shown that machine learning may reproduce and even exacerbate human bias due to…

Machine Learning · Computer Science 2019-05-16 Benjamin Paaßen , Astrid Bunge , Carolin Hainke , Leon Sindelar , Matthias Vogelsang

This paper describes a generalizable model evaluation method that can be adapted to evaluate AI/ML models across multiple criteria including core scientific principles and more practical outcomes. Emerging from prediction competitions in…

Machine Learning · Computer Science 2024-03-19 Jason L. Harman , Jaelle Scheuerman

The increasing application of machine learning techniques in everyday decision-making processes has brought concerns about the fairness of algorithmic decision-making. This paper concerns the problem of collider bias which produces spurious…

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

Scalable oversight protocols aim to empower evaluators to accurately verify AI models more capable than themselves. However, human evaluators are subject to biases that can lead to systematic errors. We conduct two studies examining the…

Human-Computer Interaction · Computer Science 2025-07-29 Gabriel Recchia , Chatrik Singh Mangat , Jinu Nyachhyon , Mridul Sharma , Callum Canavan , Dylan Epstein-Gross , Muhammed Abdulbari

Software built on top of machine learning algorithms is becoming increasingly prevalent in a variety of fields, including college admissions, healthcare, insurance, and justice. The effectiveness and efficiency of these systems heavily…

Machine Learning · Computer Science 2023-05-25 Ying Xiao , Shangwen Wang , Sicen Liu , Dingyuan Xue , Xian Zhan , Yepang Liu

If a prediction model identifies vulnerable individuals or groups, the use of that model may become an ethical issue. But can we know that this is what a model does? Machine learning fairness as a field is focused on the just treatment of…

Machine Learning · Computer Science 2022-09-07 Inga Strümke , Marija Slavkovik

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

We investigate the fairness concerns of training a machine learning model using data with missing values. Even though there are a number of fairness intervention methods in the literature, most of them require a complete training set as…

Machine Learning · Computer Science 2022-04-15 Haewon Jeong , Hao Wang , Flavio P. Calmon

The use of artificial intelligence (AI) in healthcare has become a very active research area in the last few years. While significant progress has been made in image classification tasks, only a few AI methods are actually being deployed in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Ramon Correa , Jiwoong Jason Jeong , Bhavik Patel , Hari Trivedi , Judy W. Gichoya , Imon Banerjee

Credit assessments activities are essential for financial institutions and allow the global economy to grow. Building robust, solid and accurate models that estimate the probability of a default of a company is mandatory for credit…

Machine Learning · Computer Science 2021-03-16 Ayoub El Qadi , Natalia Diaz-Rodriguez , Maria Trocan , Thomas Frossard

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

Machine Learning · Computer Science 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

In this work we build a stack of machine learning models aimed at composing a state-of-the-art credit rating and default prediction system, obtaining excellent out-of-sample performances. Our approach is an excursion through the most recent…

Statistical Finance · Quantitative Finance 2020-08-05 A. R. Provenzano , D. Trifirò , A. Datteo , L. Giada , N. Jean , A. Riciputi , G. Le Pera , M. Spadaccino , L. Massaron , C. Nordio

Biased datasets are ubiquitous and present a challenge for machine learning. For a number of categories on a dataset that are equally important but some are sparse and others are common, the learning algorithms will favor the ones with more…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Glauco Amigo , Pablo Rivas Perea , Robert J. Marks