English
Related papers

Related papers: Fair Performance Metric Elicitation

200 papers

The evaluation of recommender system fairness has become increasingly important, especially with recent legislation that emphasises the development of fair and responsible artificial intelligence. This has led to the emergence of various…

Information Retrieval · Computer Science 2026-04-29 Theresia Veronika Rampisela

Numerous fairness metrics have been proposed and employed by artificial intelligence (AI) experts to quantitatively measure bias and define fairness in AI models. Recognizing the need to accommodate stakeholders' diverse fairness…

Artificial Intelligence · Computer Science 2025-02-11 Lin Luo , Yuri Nakao , Mathieu Chollet , Hiroya Inakoshi , Simone Stumpf

In many prediction problems, the predictive model affects the distribution of the prediction target. This phenomenon is known as performativity and is often caused by the behavior of individuals with vested interests in the outcome of the…

Machine Learning · Statistics 2024-06-03 Seamus Somerstep , Ya'acov Ritov , Yuekai Sun

The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives. When considering the relevance of ethical concepts to subset selection problems, the…

Artificial Intelligence · Computer Science 2020-02-11 Margaret Mitchell , Dylan Baker , Nyalleng Moorosi , Emily Denton , Ben Hutchinson , Alex Hanna , Timnit Gebru , Jamie Morgenstern

Group fairness metrics are an established way of assessing the fairness of prediction-based decision-making systems. However, these metrics are still insufficiently linked to philosophical theories, and their moral meaning is often unclear.…

Computers and Society · Computer Science 2023-05-03 Joachim Baumann , Corinna Hertweck , Michele Loi , Christoph Heitz

Classification, a heavily-studied data-driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often…

Machine Learning · Computer Science 2022-04-12 Maliha Tashfia Islam , Anna Fariha , Alexandra Meliou , Babak Salimi

While the field of algorithmic fairness has brought forth many ways to measure and improve the fairness of machine learning models, these findings are still not widely used in practice. We suspect that one reason for this is that the field…

Computers and Society · Computer Science 2022-03-16 Corinna Hertweck , Christoph Heitz

Today, AI is increasingly being used in many high-stakes decision-making applications in which fairness is an important concern. Already, there are many examples of AI being biased and making questionable and unfair decisions. The AI…

Artificial Intelligence · Computer Science 2020-02-06 Yunfeng Zhang , Rachel K. E. Bellamy , Kush R. Varshney

The potential for learned models to amplify existing societal biases has been broadly recognized. Fairness-aware classifier constraints, which apply equality metrics of performance across subgroups defined on sensitive attributes such as…

Machine Learning · Computer Science 2019-11-01 Ananth Balashankar , Alyssa Lees , Chris Welty , Lakshminarayanan Subramanian

The fairness of machine learning-based decisions has become an increasingly important focus in the design of supervised machine learning methods. Most fairness approaches optimize a specified trade-off between performance measure(s) (e.g.,…

Machine Learning · Computer Science 2023-02-01 Omid Memarrast , Linh Vu , Brian Ziebart

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

The adoption of automated, data-driven decision making in an ever expanding range of applications has raised concerns about its potential unfairness towards certain social groups. In this context, a number of recent studies have focused on…

In recent years, recommendation and ranking systems have become increasingly popular on digital platforms. However, previous work has highlighted how personalized systems might lead to unintentional harms for users. Practitioners require…

Human-Computer Interaction · Computer Science 2022-09-12 Jessie J. Smith , Lex Beattie

We investigate the application of classification techniques to utility elicitation. In a decision problem, two sets of parameters must generally be elicited: the probabilities and the utilities. While the prior and conditional probabilities…

Artificial Intelligence · Computer Science 2013-02-01 Urszula Chajewska , Lise Getoor , Joseph Norman , Yuval Shahar

Package-to-group recommender systems recommend a set of unified items to a group of people. Different from conventional settings, it is not easy to measure the utility of group recommendations because it involves more than one user. In…

Information Retrieval · Computer Science 2021-12-30 Ryoma Sato

As recommender systems are being designed and deployed for an increasing number of socially-consequential applications, it has become important to consider what properties of fairness these systems exhibit. There has been considerable…

Information Retrieval · Computer Science 2020-09-08 Nasim Sonboli , Robin Burke , Nicholas Mattei , Farzad Eskandanian , Tian Gao

Ensuring fairness of prediction-based decision making is based on statistical group fairness criteria. Which one of these criteria is the morally most appropriate one depends on the context, and its choice requires an ethical analysis. In…

Machine Learning · Computer Science 2022-10-20 Joachim Baumann , Christoph Heitz

The pipeline of a fair ML practitioner is generally divided into three phases: 1) Selecting a fairness measure. 2) Choosing a model that minimizes this measure. 3) Maximizing the model's performance on the data. In the context of group…

Machine Learning · Computer Science 2024-08-02 Marco Favier , Toon Calders

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang

Algorithmic fairness involves expressing notions such as equity, or reasonable treatment, as quantifiable measures that a machine learning algorithm can optimise. Most work in the literature to date has focused on classification problems…

Machine Learning · Computer Science 2020-03-06 Daniel Steinberg , Alistair Reid , Simon O'Callaghan