English
Related papers

Related papers: Learning Fair Scoring Functions: Bipartite Ranking…

200 papers

Nowadays fairness issues have raised great concerns in decision-making systems. Various fairness notions have been proposed to measure the degree to which an algorithm is unfair. In practice, there frequently exist a certain set of…

Machine Learning · Computer Science 2021-07-20 Renzhe Xu , Peng Cui , Kun Kuang , Bo Li , Linjun Zhou , Zheyan Shen , Wei Cui

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an…

Machine Learning · Computer Science 2022-05-25 Arya Tafvizi , Besim Avci , Mukund Sundararajan

Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks,…

Computers and Society · Computer Science 2019-03-12 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Li Wei , Yi Wu , Lukasz Heldt , Zhe Zhao , Lichan Hong , Ed H. Chi , Cristos Goodrow

Probabilistic predictions can be evaluated through comparisons with observed label frequencies, that is, through the lens of calibration. Recent scholarship on algorithmic fairness has started to look at a growing variety of…

Machine Learning · Computer Science 2023-05-16 Benedikt Höltgen , Robert C Williamson

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

The ongoing pandemic has highlighted the importance of reliable and efficient clinical trials in healthcare. Trial sites, where the trials are conducted, are chosen mainly based on feasibility in terms of medical expertise and access to a…

Machine Learning · Computer Science 2022-04-14 Rakshith S Srinivasa , Cheng Qian , Brandon Theodorou , Jeffrey Spaeder , Cao Xiao , Lucas Glass , Jimeng Sun

We address the problem of algorithmic fairness: ensuring that sensitive variables do not unfairly influence the outcome of a classifier. We present an approach based on empirical risk minimization, which incorporates a fairness constraint…

Machine Learning · Statistics 2020-02-03 Michele Donini , Luca Oneto , Shai Ben-David , John Shawe-Taylor , Massimiliano Pontil

Fairness-aware learning studies the development of algorithms that avoid discriminatory decision outcomes despite biased training data. While most studies have concentrated on immediate bias in static contexts, this paper highlights the…

Machine Learning · Computer Science 2025-06-16 Jacob Lear , Lu Zhang

Decision support systems (e.g., for ecological conservation) and autonomous systems (e.g., adaptive controllers in smart cities) start to be deployed in real applications. Although their operations often impact many users or stakeholders,…

Machine Learning · Computer Science 2019-07-25 Paul Weng

We propose a test of fairness in score-based ranking systems called matched pair calibration. Our approach constructs a set of matched item pairs with minimal confounding differences between subgroups before computing an appropriate measure…

Recent work in algorithmic fairness has highlighted the challenge of defining racial categories for the purposes of anti-discrimination. These challenges are not new but have previously fallen to the state, which enacts race through…

Computers and Society · Computer Science 2023-09-14 Amina A. Abdu , Irene V. Pasquetto , Abigail Z. Jacobs

Any decision, such as one about who to hire, involves two components. First, a rational component, i.e., they have a good education, they speak clearly. Second, an affective component, based on observables such as visual features of race…

Computers and Society · Computer Science 2022-05-03 Jesse Hoey , Gabrielle Chan

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

Machine Learning · Computer Science 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha

Data and algorithms have the potential to produce and perpetuate discrimination and disparate treatment. As such, significant effort has been invested in developing approaches to defining, detecting, and eliminating unfair outcomes in…

Machine Learning · Computer Science 2025-02-07 Alexander Asemota , Giles Hooker

Fairness in algorithmic decision-making processes is attracting increasing concern. When an algorithm is applied to human-related decision-making an estimator solely optimizing its predictive power can learn biases on the existing data,…

Artificial Intelligence · Computer Science 2018-06-14 Junpei Komiyama , Hajime Shimao

Recent work in fairness in machine learning has proposed adjusting for fairness by equalizing accuracy metrics across groups and has also studied how datasets affected by historical prejudices may lead to unfair decision policies. We…

Machine Learning · Statistics 2018-06-11 Nathan Kallus , Angela Zhou

As machine learning has become more prevalent, researchers have begun to recognize the necessity of ensuring machine learning systems are fair. Recently, there has been an interest in defining a notion of fairness that mitigates…

Data Structures and Algorithms · Computer Science 2020-06-22 Sara Ahmadian , Alessandro Epasto , Marina Knittel , Ravi Kumar , Mohammad Mahdian , Benjamin Moseley , Philip Pham , Sergei Vassilvitskii , Yuyan Wang

The rapid trend of deploying artificial intelligence (AI) and machine learning (ML) systems in socially consequential domains has raised growing concerns about their trustworthiness, including potential discriminatory behaviours. Research…

Machine Learning · Computer Science 2025-09-22 Yijun Bian , Lei You , Yuya Sasaki , Haruka Maeda , Akira Igarashi

Bipartite ranking is a fundamental machine learning and data mining problem. It commonly concerns the maximization of the AUC metric. Recently, a number of studies have proposed online bipartite ranking algorithms to learn from massive…

Machine Learning · Computer Science 2019-03-12 Majdi Khalid , Indrakshi Ray , Hamidreza Chitsaz

Fairness in ranking models is crucial, as disparities in exposure can disproportionately affect protected groups. Most fairness-aware ranking systems focus on ensuring comparable average exposure for groups across the entire ranked list,…

Machine Learning · Computer Science 2025-09-23 Boyang Zhang , Quanqi Hu , Mingxuan Sun , Qihang Lin , Tianbao Yang