English
Related papers

Related papers: Identities are not Interchangeable: The Problem of…

200 papers

Modern machine learning (ML) models are becoming increasingly popular and are widely used in decision-making systems. However, studies have shown critical issues of ML discrimination and unfairness, which hinder their adoption on high-stake…

Machine Learning · Computer Science 2023-06-01 Yueqing Liang , Canyu Chen , Tian Tian , Kai Shu

Consider a binary decision making process where a single machine learning classifier replaces a multitude of humans. We raise questions about the resulting loss of diversity in the decision making process. We study the potential benefits of…

Machine Learning · Statistics 2017-07-03 Nina Grgić-Hlača , Muhammad Bilal Zafar , Krishna P. Gummadi , Adrian Weller

Despite location being increasingly used in decision-making systems deployed in sensitive domains such as mortgages and insurance, little attention has been paid to the unfairness that may seep in due to the correlation of location with…

Computers and Society · Computer Science 2026-03-02 Nripsuta Ani Saxena , Abigail L. Horn , Wenbin Zhang , Cyrus Shahabi

We argue that insurance can act as an analogon for the social situatedness of machine learning systems, hence allowing machine learning scholars to take insights from the rich and interdisciplinary insurance literature. Tracing the…

Machine Learning · Computer Science 2024-01-24 Christian Fröhlich , Robert C. Williamson

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these…

Machine Learning · Statistics 2026-03-10 Yi Yang , Xiangyu Chang , Pei-yu Chen

If a prediction model identifies vulnerable individuals or groups, the use of that model may become an ethical issue. But can we know that this is what a model does? Machine learning fairness as a field is focused on the just treatment of…

Machine Learning · Computer Science 2022-09-07 Inga Strümke , Marija Slavkovik

Research in machine learning fairness has historically considered a single binary demographic attribute; however, the reality is of course far more complicated. In this work, we grapple with questions that arise along three stages of the…

Machine Learning · Computer Science 2022-05-11 Angelina Wang , Vikram V. Ramaswamy , Olga Russakovsky

Fairness is one of the most desirable societal principles in collective decision-making. It has been extensively studied in the past decades for its axiomatic properties and has received substantial attention from the multiagent systems…

Artificial Intelligence · Computer Science 2023-12-25 Hadi Hosseini

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic groups in data, thus…

Machine Learning · Computer Science 2023-07-04 Bishwamittra Ghosh , Debabrota Basu , Kuldeep S. Meel

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Systems based on machine learning may exhibit discriminatory behavior based on sensitive characteristics such as gender, sex, religion, or race. In light of this, various notions of fairness and methods to quantify discrimination were…

Machine Learning · Computer Science 2024-12-23 Drago Plecko , Elias Bareinboim

Individual fairness is an intuitive definition of algorithmic fairness that addresses some of the drawbacks of group fairness. Despite its benefits, it depends on a task specific fair metric that encodes our intuition of what is fair and…

Machine Learning · Statistics 2020-06-23 Debarghya Mukherjee , Mikhail Yurochkin , Moulinath Banerjee , Yuekai Sun

There has been concern within the artificial intelligence (AI) community and the broader society regarding the potential lack of fairness of AI-based decision-making systems. Surprisingly, there is little work quantifying and guaranteeing…

Machine Learning · Computer Science 2023-01-31 Wenbin Zhang , Jeremy C. Weiss

Personalization is pervasive in the online space as, when combined with learning, it leads to higher efficiency and revenue by allowing the most relevant content to be served to each user. However, recent studies suggest that such…

Computers and Society · Computer Science 2017-07-10 L. Elisa Celis , Nisheeth K. Vishnoi

Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat…

Machine Learning · Computer Science 2021-06-22 Tal Feldman , Ashley Peake

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

Defining fairness in AI remains a persistent challenge, largely due to its deeply context-dependent nature and the lack of a universal definition. While numerous mathematical formulations of fairness exist, they sometimes conflict with one…

Computers and Society · Computer Science 2025-05-05 Kessia Nepomuceno , Fabio Petrillo

Fairness through Unawareness (FtU) describes the idea that discrimination against demographic groups can be avoided by not considering group membership in the decisions or predictions. This idea has long been criticized in the machine…

Machine Learning · Computer Science 2025-08-26 Benedikt Höltgen , Nuria Oliver