English
Related papers

Related papers: Fairpriori: Improving Biased Subgroup Discovery fo…

200 papers

Current AI regulations require discarding sensitive features (e.g., gender, race, religion) in the algorithm's decision-making process to prevent unfair outcomes. However, even without sensitive features in the training set, algorithms can…

Machine Learning · Computer Science 2023-08-29 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

Fairness is steadily becoming a crucial requirement of Machine Learning (ML) systems. A particularly important notion is subgroup fairness, i.e., fairness in subgroups of individuals that are defined by more than one attributes. Identifying…

Machine Learning · Computer Science 2024-04-30 Giorgos Giannopoulos , Dimitris Sacharidis , Nikolas Theologitis , Loukas Kavouras , Ioannis Emiris

We present a theoretical framework analyzing the relationship between data distributions and fairness guarantees in equitable deep learning. We establish novel bounds that account for distribution heterogeneity across demographic groups,…

Machine Learning · Computer Science 2026-03-03 Yan Luo , Congcong Wen , Min Shi , Hao Huang , Yi Fang , Mengyu Wang

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

Machine learning (ML) systems are utilized in critical sectors, such as healthcare, law enforcement, and finance. However, these systems are often trained on historical data that contains demographic biases, leading to ML decisions that…

Machine Learning · Computer Science 2025-06-10 Jake Robertson , Noah Hollmann , Samuel Müller , Noor Awad , Frank Hutter

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

Fairness in machine learning is crucial when individuals are subject to automated decisions made by models in high-stake domains. Organizations that employ these models may also need to satisfy regulations that promote responsible and…

Machine Learning · Computer Science 2020-10-14 Shubham Sharma , Alan H. Gee , David Paydarfar , Joydeep Ghosh

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

Fairness is an increasingly important concern as machine learning models are used to support decision making in high-stakes applications such as mortgage lending, hiring, and prison sentencing. This paper introduces a new open source Python…

Performance unfairness among variables widely exists in multivariate time series (MTS) forecasting models since such models may attend/bias to certain (advantaged) variables. Addressing this unfairness problem is important for equally…

Machine Learning · Computer Science 2023-10-24 Hui He , Qi Zhang , Shoujin Wang , Kun Yi , Zhendong Niu , Longbing Cao

In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Ching-Hao Chiu , Yu-Jen Chen , Yawen Wu , Yiyu Shi , Tsung-Yi Ho

Facial forgery by deepfakes has raised severe societal concerns. Several solutions have been proposed by the vision community to effectively combat the misinformation on the internet via automated deepfake detection systems. Recent studies…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Aakash Varma Nadimpalli , Ajita Rattani

In this paper, we propose an innovative approach to thoroughly explore dataset features that introduce bias in downstream machine-learning tasks. Depending on the data format, we use different techniques to map instances into a similarity…

Machine Learning · Computer Science 2024-11-11 Samira Maghool , Paolo Ceravolo

Deep learning models often learn to make predictions that rely on sensitive social attributes like gender and race, which poses significant fairness risks, especially in societal applications, e.g., hiring, banking, and criminal justice.…

Machine Learning · Computer Science 2022-11-03 Yi Zhang , Jitao Sang , Junyang Wang

Link prediction is a crucial task in network analysis, but it has been shown to be prone to biased predictions, particularly when links are unfairly predicted between nodes from different sensitive groups. In this paper, we study the fair…

Machine Learning · Computer Science 2024-09-16 Yezi Liu , Hanning Chen , Mohsen Imani

This paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs. Data-driven software is increasingly applied in social-critical applications where ensuring fairness is of paramount…

Software Engineering · Computer Science 2022-02-15 Saeid Tizpaz-Niari , Ashish Kumar , Gang Tan , Ashutosh Trivedi

The evaluation of machine learning models typically relies mainly on performance metrics based on loss functions, which risk to overlook changes in performance in relevant subgroups. Auditing tools such as SliceFinder and SliceLine were…

Machine Learning · Computer Science 2026-04-22 Rudolf Debelak

Search and recommendation systems, such as search engines, recruiting tools, online marketplaces, news, and social media, output ranked lists of content, products, and sometimes, people. Credit ratings, standardized tests, risk assessments…

Information Retrieval · Computer Science 2021-02-19 Sruthi Gorantla , Amit Deshpande , Anand Louis

We propose an analysis in fair learning that preserves the utility of the data while reducing prediction disparities under the criteria of group sufficiency. We focus on the scenario where the data contains multiple or even many subgroups,…

Machine Learning · Statistics 2022-11-30 Changjian Shui , Gezheng Xu , Qi Chen , Jiaqi Li , Charles Ling , Tal Arbel , Boyu Wang , Christian Gagné

Deep neural networks often inherit social and demographic biases from annotated data during model training, leading to unfair predictions, especially in the presence of sensitive attributes like race, age, gender etc. Existing methods fall…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Anay Majee , Rishabh Iyer