English
Related papers

Related papers: Muffin: A Framework Toward Multi-Dimension AI Fair…

200 papers

Fairness in artificial intelligence and machine learning (AI/ML) models is becoming critically important, especially as decisions made by these systems impact diverse groups. In education, a vital sector for all countries, the widespread…

Machine Learning · Computer Science 2024-10-10 Nga Pham , Minh Kha Do , Tran Vu Dai , Pham Ngoc Hung , Anh Nguyen-Duc

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Deep neural networks have achieved exceptional results across a range of applications. As the demand for efficient and sparse deep learning models escalates, the significance of model compression, particularly pruning, is increasingly…

Machine Learning · Computer Science 2025-04-01 Yucong Dai , Gen Li , Feng Luo , Xiaolong Ma , Yongkai Wu

Machine Learning (ML) models are widely employed to drive many modern data systems. While they are undeniably powerful tools, ML models often demonstrate imbalanced performance and unfair behaviors. The root of this problem often lies in…

Machine Learning · Computer Science 2023-08-10 Ke Yang , Alexandra Meliou

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein

When selecting a model from a set of equally performant models, how much unfairness can you really reduce? Is it important to be intentional about fairness when choosing among this set, or is arbitrarily choosing among the set of ''good''…

Computers and Society · Computer Science 2025-01-28 Gordon Dai , Pavan Ravishankar , Rachel Yuan , Daniel B. Neill , Emily Black

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

The reason behind the unfair outcomes of AI is often rooted in biased datasets. Therefore, this work presents a framework for addressing fairness by debiasing datasets containing a (non-)binary protected attribute. The framework proposes a…

Machine Learning · Computer Science 2024-11-19 Manh Khoi Duong , Stefan Conrad

In recent years the development of artificial intelligence (AI) systems for automated medical image analysis has gained enormous momentum. At the same time, a large body of work has shown that AI systems can systematically and unfairly…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 María Agustina Ricci Lara , Candelaria Mosquera , Enzo Ferrante , Rodrigo Echeveste

Fairness of machine learning models in healthcare has drawn increasing attention from clinicians, researchers, and even at the highest level of government. On the other hand, the importance of developing and deploying interpretable or…

Machine Learning · Computer Science 2024-09-04 Mary M. Lucas , Xiaoyang Wang , Chia-Hsuan Chang , Christopher C. Yang , Jacqueline E. Braughton , Quyen M. Ngo

In the past few years, Artificial Intelligence (AI) has garnered attention from various industries including financial services (FS). AI has made a positive impact in financial services by enhancing productivity and improving risk…

The deployment of Large Language Models (LLMs) in high-stakes medical settings poses a critical AI alignment challenge, as models can inherit and amplify societal biases, leading to significant disparities. Existing fairness evaluation…

Artificial Intelligence · Computer Science 2025-09-03 Shreyash Adappanavar , Krithi Shailya , Gokul S Krishnan , Sriraam Natarajan , Balaraman Ravindran

The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely…

Machine Learning · Computer Science 2026-05-21 Khalid Adnan Alsayed

The evaluation of fairness models in Machine Learning involves complex challenges, such as defining appropriate metrics, balancing trade-offs between utility and fairness, and there are still gaps in this stage. This work presents a novel…

Machine Learning · Computer Science 2026-03-03 Gökhan Özbulak , Oscar Jimenez-del-Toro , Maíra Fatoretto , Lilian Berton , André Anjos

We propose new tools for policy-makers to use when assessing and correcting fairness and bias in AI algorithms. The three tools are: - A new definition of fairness called "controlled fairness" with respect to choices of protected features…

Machine Learning · Computer Science 2020-07-10 Mingliang Chen , Aria Shahverdi , Sarah Anderson , Se Yong Park , Justin Zhang , Dana Dachman-Soled , Kristin Lauter , Min Wu

Ensuring trust and accountability in Artificial Intelligence systems demands explainability of its outcomes. Despite significant progress in Explainable AI, human biases still taint a substantial portion of its training data, raising…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Philipp Ratz , François Hu , Arthur Charpentier