English
Related papers

Related papers: Racial categories in machine learning

200 papers

Research in machine learning fairness has historically considered a single binary demographic attribute; however, the reality is of course far more complicated. In this work, we grapple with questions that arise along three stages of the…

Machine Learning · Computer Science 2022-05-11 Angelina Wang , Vikram V. Ramaswamy , Olga Russakovsky

There is substantial evidence that Artificial Intelligence (AI) and Machine Learning (ML) algorithms can generate bias against minorities, women, and other protected classes. Federal and state laws have been enacted to protect consumers…

Computers and Society · Computer Science 2021-08-23 Nicholas Schmidt , Bryce Stephens

Fairness in machine learning is of considerable interest in recent years owing to the propensity of algorithms trained on historical data to amplify and perpetuate historical biases. In this paper, we argue for a formal reconstruction of…

Artificial Intelligence · Computer Science 2023-06-27 Vaishak Belle

As more industries integrate machine learning into socially sensitive decision processes like hiring, loan-approval, and parole-granting, we are at risk of perpetuating historical and contemporary socioeconomic disparities. This is a…

Computers and Society · Computer Science 2017-10-20 Niels Bantilan

Disaggregated performance metrics across demographic groups are a hallmark of fairness assessments in computer vision. These metrics successfully incentivized performance improvements on person-centric tasks such as face analysis and are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Melissa Hall , Bobbie Chern , Laura Gustafson , Denisse Ventura , Harshad Kulkarni , Candace Ross , Nicolas Usunier

In the rapidly advancing field of artificial intelligence, machine perception is becoming paramount to achieving increased performance. Image classification systems are becoming increasingly integral to various applications, ranging from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Javon Hickmon

In recent years, machine learning techniques have been increasingly applied in sensitive decision making processes, raising fairness concerns. Past research has shown that machine learning may reproduce and even exacerbate human bias due to…

Machine Learning · Computer Science 2019-05-16 Benjamin Paaßen , Astrid Bunge , Carolin Hainke , Leon Sindelar , Matthias Vogelsang

Context. Algorithmic racism is the term used to describe the behavior of technological solutions that constrains users based on their ethnicity. Lately, various data-driven software systems have been reported to discriminate against Black…

Software Engineering · Computer Science 2023-06-28 Ronnie de Souza Santos , Luiz Fernando de Lima , Cleyton Magalhaes

When using machine learning for automated prediction, it is important to account for fairness in the prediction. Fairness in machine learning aims to ensure that biases in the data and model inaccuracies do not lead to discriminatory…

Machine Learning · Computer Science 2024-12-10 Jan Pablo Burgard , João Vitor Pamplona

Various forms of implications of artificial intelligence that either exacerbate or decrease racial systemic injustice have been explored in this applied research endeavor. Taking each thematic area of identifying, analyzing, and debating an…

Computers and Society · Computer Science 2022-01-05 Alia Abbas

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

In the current landscape of ever-increasing levels of digitalization, we are facing major challenges pertaining to scalability. Recommender systems have become irreplaceable both for helping users navigate the increasing amounts of data…

Information Retrieval · Computer Science 2024-04-03 Bjørnar Vassøy , Helge Langseth

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

As they have a vital effect on social decision-making, AI algorithms not only should be accurate and but also should not pose unfairness against certain sensitive groups (e.g., non-white, women). Various specially designed AI algorithms to…

Machine Learning · Statistics 2023-01-23 Sara Kim , Kyusang Yu , Yongdai Kim

Recent advancements in machine learning and deep learning have brought algorithmic fairness into sharp focus, illuminating concerns over discriminatory decision making that negatively impacts certain individuals or groups. These concerns…

Computers and Society · Computer Science 2024-05-16 Renqiang Luo , Tao Tang , Feng Xia , Jiaying Liu , Chengpei Xu , Leo Yu Zhang , Wei Xiang , Chengqi Zhang

Racial disparities in recidivism remain a persistent challenge within the criminal justice system, increasingly exacerbated by the adoption of algorithmic risk assessment tools. Past works have primarily focused on bias induced by these…

Computers and Society · Computer Science 2025-04-29 Jessy Xinyi Han , Kristjan Greenewald , Devavrat Shah

In consequential real-world applications, machine learning (ML) based systems are expected to provide fair and non-discriminatory decisions on candidates from groups defined by protected attributes such as gender and race. These…

Computers and Society · Computer Science 2017-10-20 Samiulla Shaikh , Harit Vishwakarma , Sameep Mehta , Kush R. Varshney , Karthikeyan Natesan Ramamurthy , Dennis Wei

Machine learning algorithms for prediction are increasingly being used in critical decisions affecting human lives. Various fairness formalizations, with no firm consensus yet, are employed to prevent such algorithms from systematically…

Machine Learning · Computer Science 2018-05-29 Pratik Gajane , Mykola Pechenizkiy

The digitalization of credit scoring has become essential for financial institutions and commercial banks, especially in the era of digital transformation. Machine learning techniques are commonly used to evaluate customers'…

Machine Learning · Computer Science 2026-03-06 Huyen Giang Thi Thu , Thang Viet Doan , Ha-Bang Ban , Tai Le Quy

This research seeks to benefit the software engineering society by proposing comparative separation, a novel group fairness notion to evaluate the fairness of machine learning software on comparative judgment test data. Fairness issues have…

Software Engineering · Computer Science 2026-01-13 Xiaoyin Xi , Neeku Capak , Kate Stockwell , Zhe Yu