English
Related papers

Related papers: Towards Standardizing AI Bias Exploration

200 papers

Many internet applications are powered by machine learned models, which are usually trained on labeled datasets obtained through either implicit / explicit user feedback signals or human judgments. Since societal biases may be present in…

Machine Learning · Computer Science 2020-08-18 Sriram Vasudevan , Krishnaram Kenthapadi

Fairness is a growing area of machine learning (ML) that focuses on ensuring models do not produce systematically biased outcomes for specific groups, particularly those defined by protected attributes such as race, gender, or age.…

Computation · Statistics 2025-10-14 Benjamin Smith , Jianhui Gao , Jessica Gronsbell

As the real-world impact of Artificial Intelligence (AI) systems has been steadily growing, so too have these systems come under increasing scrutiny. In response, the study of AI fairness has rapidly developed into a rich field of research…

Computers and Society · Computer Science 2023-09-19 Maarten Buyl , Tijl De Bie

An increasing awareness of biased patterns in natural language processing resources, like BERT, has motivated many metrics to quantify `bias' and `fairness'. But comparing the results of different metrics and the works that evaluate with…

Computation and Language · Computer Science 2021-12-15 Pieter Delobelle , Ewoenam Kwaku Tokpo , Toon Calders , Bettina Berendt

Scientific research communities are embracing AI-based solutions to target tractable scientific tasks and improve research workflows. However, the development and evaluation of such solutions are scattered across multiple disciplines. We…

Artificial Intelligence · Computer Science 2022-06-14 Yatao Li , Jianfeng Zhan

Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to…

Artificial Intelligence · Computer Science 2025-01-03 Brian Hsu , Cyrus DiCiccio , Natesh Sivasubramoniapillai , Hongseok Namkoong

As machine learning (ML) systems are increasingly adopted in high-stakes decision-making domains, ensuring fairness in their outputs has become a central challenge. At the core of fair ML research are the datasets used to investigate bias…

Machine Learning · Computer Science 2025-10-28 Jan Simson , Alessandro Fabris , Cosima Fröhner , Frauke Kreuter , Christoph Kern

Benchmarking has long served as a foundational practice in machine learning and, increasingly, in modern AI systems such as large language models, where shared tasks, metrics, and leaderboards offer a common basis for measuring progress and…

Artificial Intelligence · Computer Science 2026-02-16 Philip Waggoner

Early studies of risk assessment algorithms used in criminal justice revealed widespread racial biases. In response, machine learning researchers have developed methods for fairness, many of which rely on equalizing empirical metrics across…

Computers and Society · Computer Science 2022-09-15 Rajiv Movva

This paper presents a philosophical and experimental study of fairness interventions in AI classification, centered on the explainability of corrective methods. We argue that ensuring fairness requires not only satisfying a target…

Machine Learning · Computer Science 2025-12-04 Thomas Souverain , Johnathan Nguyen , Nicolas Meric , Paul Égré

Machine learning decision systems are getting omnipresent in our lives. From dating apps to rating loan seekers, algorithms affect both our well-being and future. Typically, however, these systems are not infallible. Moreover, complex…

Machine Learning · Statistics 2022-02-15 Jakub Wiśniewski , Przemysław Biecek

Testing machine learning software for ethical bias has become a pressing current concern. In response, recent research has proposed a plethora of new fairness metrics, for example, the dozens of fairness metrics in the IBM AIF360 toolkit.…

Machine Learning · Computer Science 2022-03-22 Suvodeep Majumder , Joymallya Chakraborty , Gina R. Bai , Kathryn T. Stolee , Tim Menzies

Fairness is a growing concern for high-risk decision-making using Artificial Intelligence (AI) but ensuring it through purely technical means is challenging: there is no universally accepted fairness measure, fairness is context-dependent,…

Artificial Intelligence · Computer Science 2024-10-07 Evdoxia Taka , Yuri Nakao , Ryosuke Sonoda , Takuya Yokota , Lin Luo , Simone Stumpf

Today, with the growing obsession with applying Artificial Intelligence (AI), particularly Machine Learning (ML), to software across various contexts, much of the focus has been on the effectiveness of AI models, often measured through…

Software Engineering · Computer Science 2025-12-10 Thanh Nguyen , Chaima Boufaied , Ronnie de Souza Santos

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

Artificial Intelligence · Computer Science 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

AI systems are increasingly used in high-stakes domains such as credit rating, where fairness concerns are critical. Existing fairness assessments are typically conducted by AI experts or regulators using predefined protected attributes and…

Computers and Society · Computer Science 2026-02-10 Lin Luo , Satwik Ghanta , Yuri Nakao , Mathieu Chollet , Simone Stumpf

Predictive artificial intelligence (AI) offers an opportunity to improve clinical practice and patient outcomes, but risks perpetuating biases if fairness is inadequately addressed. However, the definition of "fairness" remains unclear. We…

Machine learning (ML) algorithms are increasingly deployed to make critical decisions in socioeconomic applications such as finance, criminal justice, and autonomous driving. However, due to their data-driven and pattern-seeking nature, ML…

Software Engineering · Computer Science 2026-01-08 Verya Monjezi , Ashish Kumar , Ashutosh Trivedi , Gang Tan , Saeid Tizpaz-Niari