English
Related papers

Related papers: FairTree: Subgroup Fairness Auditing of Machine Le…

200 papers

Continual semantic segmentation aims to learn new classes while maintaining the information from the previous classes. Although prior studies have shown impressive progress in recent years, the fairness concern in the continual semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Thanh-Dat Truong , Hoang-Quan Nguyen , Bhiksha Raj , Khoa Luu

In recent years, machine learning (ML) algorithms have been deployed in safety-critical and high-stake decision-making, where the fairness of algorithms is of paramount importance. Fairness in ML centers on detecting bias towards certain…

Machine Learning · Computer Science 2022-06-02 Bishwamittra Ghosh , Debabrota Basu , Kuldeep S. Meel

We present FlipTest, a black-box technique for uncovering discrimination in classifiers. FlipTest is motivated by the intuitive question: had an individual been of a different protected status, would the model have treated them differently?…

Machine Learning · Computer Science 2019-12-10 Emily Black , Samuel Yeom , Matt Fredrikson

Within a legal framework, fairness in datasets and models is typically assessed by dividing observations into predefined groups and then computing fairness measures (e.g., Disparate Impact or Equality of Odds with respect to gender).…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Veronika Shilova , Emmanuel Malherbe , Giovanni Palma , Laurent Risser , Jean-Michel Loubes

As the use of deep learning in high impact domains becomes ubiquitous, it is increasingly important to assess the resilience of models. One such high impact domain is that of face recognition, with real world applications involving images…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Aparna R. Joshi , Xavier Suau , Nivedha Sivakumar , Luca Zappella , Nicholas Apostoloff

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

Performance unfairness among variables widely exists in multivariate time series (MTS) forecasting models since such models may attend/bias to certain (advantaged) variables. Addressing this unfairness problem is important for equally…

Machine Learning · Computer Science 2023-10-24 Hui He , Qi Zhang , Shoujin Wang , Kun Yi , Zhendong Niu , Longbing Cao

Classification algorithms face difficulties when one or more classes have limited training data. We are particularly interested in classification trees, due to their interpretability and flexibility. When data are limited in one or more of…

Methodology · Statistics 2021-06-15 Yichen Zhu , Cheng Li , David B. Dunson

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

As learning-to-rank models are increasingly deployed for decision-making in areas with profound life implications, the FairML community has been developing fair learning-to-rank (LTR) models. These models rely on the availability of…

Machine Learning · Computer Science 2024-07-25 Oluseun Olulana , Kathleen Cachel , Fabricio Murai , Elke Rundensteiner

Ensuring fairness in Graph Neural Networks is fundamental to promoting trustworthy and socially responsible machine learning systems. In response, numerous fair graph learning methods have been proposed in recent years. However, most of…

Machine Learning · Computer Science 2025-12-29 Zichong Wang , Zhipeng Yin , Liping Yang , Jun Zhuang , Rui Yu , Qingzhao Kong , Wenbin Zhang

Cyber-physical systems come with increasingly complex architectures and failure modes, which complicates the task of obtaining accurate system reliability models. At the same time, with the emergence of the (industrial) Internet-of-Things,…

Formal Languages and Automata Theory · Computer Science 2019-09-16 Alexis Linard , Doina Bucur , Marielle Stoelinga

Fairness constitutes a concern within machine learning (ML) applications. Currently, there is no study on how disparities in classification complexity between privileged and unprivileged groups could influence the fairness of solutions,…

Machine Learning · Computer Science 2025-04-09 Juliett Suárez Ferreira , Marija Slavkovik , Jorge Casillas

We study the problem of auditing the fairness of a given classifier under partial feedback, where true labels are available only for positively classified individuals, (e.g., loan repayment outcomes are observed only for approved…

Machine Learning · Computer Science 2026-02-24 Nirjhar Das , Mohit Sharma , Praharsh Nanavati , Kirankumar Shiragur , Amit Deshpande

In consequential decision-making applications, mitigating unwanted biases in machine learning models that yield systematic disadvantage to members of groups delineated by sensitive attributes such as race and gender is one key intervention…

Machine Learning · Computer Science 2022-12-15 Prasanna Sattigeri , Soumya Ghosh , Inkit Padhi , Pierre Dognin , Kush R. Varshney

Most real-world classification problems deal with imbalanced datasets, posing a challenge for Artificial Intelligence (AI), i.e., machine learning algorithms, because the minority class, which is of extreme interest, often proves difficult…

Machine Learning · Computer Science 2025-04-28 Gissel Velarde , Michael Weichert , Anuj Deshmunkh , Sanjay Deshmane , Anindya Sudhir , Khushboo Sharma , Vaibhav Joshi

Ensuring long-term fairness is crucial when developing automated decision making systems, specifically in dynamic and sequential environments. By maximizing their reward without consideration of fairness, AI agents can introduce disparities…

Machine Learning · Computer Science 2025-01-03 Sahand Rezaei-Shoshtari , Hanna Yurchyk , Scott Fujimoto , Doina Precup , David Meger

The development of face recognition algorithms by academic and commercial organizations is growing rapidly due to the onset of deep learning and the widespread availability of training data. Though tests of face recognition algorithm…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 John J. Howard , Eli J. Laird , Yevgeniy B. Sirotin , Rebecca E. Rubin , Jerry L. Tipton , Arun R. Vemury

We develop a novel bias mitigation framework with distribution-based fairness constraints suitable for producing demographically blind and explainable machine-learning models across a wide range of fairness levels. This is accomplished…

Machine Learning · Computer Science 2025-10-31 Ryan Franks , Alexey Miroshnikov , Konstandinos Kotsiopoulos

Fairness in artificial intelligence (AI) prediction models is increasingly emphasized to support responsible adoption in high-stakes domains such as health care and criminal justice. Guidelines and implementation frameworks highlight the…

Machine Learning · Computer Science 2025-04-14 Yilin Ning , Yian Ma , Mingxuan Liu , Xin Li , Nan Liu