English
Related papers

Related papers: Measuring Unfairness through Game-Theoretic Interp…

200 papers

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

Machine Learning · Computer Science 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

Quantitative definitions of what is unfair and what is fair have been introduced in multiple disciplines for well over 50 years, including in education, hiring, and machine learning. We trace how the notion of fairness has been defined…

Artificial Intelligence · Computer Science 2018-12-05 Ben Hutchinson , Margaret Mitchell

Fairness metrics are used to assess discrimination and bias in decision-making processes across various domains, including machine learning models and human decision-makers in real-world applications. This involves calculating the…

Machine Learning · Computer Science 2024-11-05 Manh Khoi Duong , Stefan Conrad

Algorithms are now routinely used to make consequential decisions that affect human lives. Examples include college admissions, medical interventions or law enforcement. While algorithms empower us to harness all information hidden in vast…

Machine Learning · Computer Science 2020-12-10 Bahar Taskesen , Jose Blanchet , Daniel Kuhn , Viet Anh Nguyen

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

Machine Learning · Computer Science 2021-04-26 Ian Covert , Su-In Lee

In addition to reproducing discriminatory relationships in the training data, machine learning systems can also introduce or amplify discriminatory effects. We refer to this as introduced unfairness, and investigate the conditions under…

Machine Learning · Computer Science 2022-02-24 Carolyn Ashurst , Ryan Carey , Silvia Chiappa , Tom Everitt

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

Artificial Intelligence · Computer Science 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

The presence of artificial intelligence (AI) in our society is increasing, which brings with it the need to understand the behavior of AI mechanisms, including machine learning predictive algorithms fed with tabular data, text or images,…

Machine Learning · Statistics 2025-06-06 Pedro Delicado , Cristian Pachón-García

Explaining why aggregated measures change is a critical challenge in data analytics that existing systems struggle to address. While current attribution methods exist, they lack a unified solution that is simultaneously general for…

Information Retrieval · Computer Science 2026-04-30 Changsheng Zhou , Dajun Chen , Zhitao Shen , wei jiang , Yong Li , Peng Di

As algorithms are increasingly used to make important decisions that affect human lives, ranging from social benefit assignment to predicting risk of criminal recidivism, concerns have been raised about the fairness of algorithmic decision…

Machine Learning · Statistics 2018-02-28 Nina Grgić-Hlača , Elissa M. Redmiles , Krishna P. Gummadi , Adrian Weller

Measuring bias is key for better understanding and addressing unfairness in NLP/ML models. This is often done via fairness metrics which quantify the differences in a model's behaviour across a range of demographic groups. In this work, we…

Computation and Language · Computer Science 2021-06-29 Paula Czarnowska , Yogarshi Vyas , Kashif Shah

High performance machine learning models have become highly dependent on the availability of large quantity and quality of training data. To achieve this, various central agencies such as the government have suggested for different data…

Machine Learning · Computer Science 2019-11-27 Zhiliang Chen

Software fairness testing is a central method for evaluating AI systems, yet the meaning of fairness is often treated as fixed and universally applicable. This vision paper positions fairness testing as culturally situated and examines the…

Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning systems, for example…

Machine Learning · Computer Science 2019-03-25 Elena Beretta , Antonio Santangelo , Bruno Lepri , Antonio Vetrò , Juan Carlos De Martin

Interpretability is becoming increasingly important for predictive model analysis. Unfortunately, as remarked by many authors, there is still no consensus regarding this notion. The goal of this paper is to propose the definition of a score…

Machine Learning · Statistics 2021-11-24 Vincent Margot , George Luta

Score-based explainable machine-learning techniques are often used to understand the logic behind black-box models. However, such explanation techniques are often computationally expensive, which limits their application in time-critical…

Machine Learning · Computer Science 2023-08-24 Amr Alkhatib , Henrik Boström , Sofiane Ennadir , Ulf Johansson

We introduce a novel and interpretable path-based music similarity measure. Our similarity measure assumes that items, such as songs and artists, and information about those items are represented in a knowledge graph. We find paths in the…

Information Retrieval · Computer Science 2021-08-05 Giovanni Gabbolini , Derek Bridge

Fairness is an emerging and challenging topic in recommender systems. In recent years, various ways of evaluating and therefore improving fairness have emerged. In this study, we examine existing evaluation measures of fairness in…

Information Retrieval · Computer Science 2024-05-21 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

While preference modelling is becoming one of the pillars of machine learning, the problem of preference explanation remains challenging and underexplored. In this paper, we propose \textsc{Pref-SHAP}, a Shapley value-based model…

Machine Learning · Statistics 2022-11-09 Robert Hu , Siu Lun Chau , Jaime Ferrando Huertas , Dino Sejdinovic

Fairness emerged as an important requirement to guarantee that Machine Learning (ML) predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity…

Machine Learning · Computer Science 2022-06-08 Karima Makhlouf , Sami Zhioua , Catuscia Palamidessi