English
Related papers

Related papers: FairX: A comprehensive benchmarking tool for model…

200 papers

Reliable explainability is not only a technical goal but also a cornerstone of private AI governance. As AI models enter high-stakes sectors, private actors such as auditors, insurers, certification bodies, and procurement agencies require…

Artificial Intelligence · Computer Science 2025-11-21 Pratinav Seth , Vinay Kumar Sankarapu

Explainable AI (XAI) tools represent a turn to more human-centered and human-in-the-loop AI approaches that emphasize user needs and perspectives in machine learning model development workflows. However, while the majority of ML resources…

Human-Computer Interaction · Computer Science 2024-04-03 Grace Guo , Dustin Arendt , Alex Endert

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

Sensitive attributes like gender or age can lead to unfair predictions in machine learning tasks such as predictive business process monitoring, particularly when used without considering context. We present FairLoop1, a tool for…

The opacity of AI models necessitates both validation and evaluation before their integration into services. To investigate these models, explainable AI (XAI) employs methods that elucidate the relationship between input features and output…

Cryptography and Security · Computer Science 2024-10-02 Zerui Wang , Yan Liu

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

In this work we study the problem of measuring the fairness of a machine learning model under noisy information. Focusing on group fairness metrics, we investigate the particular but common situation when the evaluation requires controlling…

Machine Learning · Computer Science 2021-05-24 Flavien Prost , Pranjal Awasthi , Nick Blumm , Aditee Kumthekar , Trevor Potter , Li Wei , Xuezhi Wang , Ed H. Chi , Jilin Chen , Alex Beutel

Training fair and unbiased machine learning models is crucial for high-stakes applications, yet it presents significant challenges. Effective bias mitigation requires deep expertise in fairness definitions, metrics, data preprocessing, and…

Machine Learning · Computer Science 2025-10-07 Yucong Dai , Lu Zhang , Feng Luo , Mashrur Chowdhury , Yongkai Wu

Recent progress in generative AI, especially diffusion models, has demonstrated significant utility in text-to-image synthesis. Particularly in healthcare, these models offer immense potential in generating synthetic datasets and training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yan Luo , Muhammad Osama Khan , Congcong Wen , Muhammad Muneeb Afzal , Titus Fidelis Wuermeling , Min Shi , Yu Tian , Yi Fang , Mengyu Wang

Archetypal Analysis (AA) is an unsupervised learning method that represents data as convex combinations of extreme patterns called archetypes. While AA provides interpretable and low-dimensional representations, it can inadvertently encode…

Machine Learning · Statistics 2025-07-17 Aleix Alcacer , Irene Epifanio

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Recent years have seen the development of many open-source ML fairness toolkits aimed at helping ML practitioners assess and address unfairness in their systems. However, there has been little research investigating how ML practitioners…

Human-Computer Interaction · Computer Science 2023-01-11 Wesley Hanwen Deng , Manish Nagireddy , Michelle Seng Ah Lee , Jatinder Singh , Zhiwei Steven Wu , Kenneth Holstein , Haiyi Zhu

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

Applications · Statistics 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

Software fairness testing is a central method for evaluating AI systems, yet the meaning of fairness is often treated as fixed and universally applicable. This vision paper positions fairness testing as culturally situated and examines the…

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

Because of the increasing use of data-centric systems and algorithms in machine learning, the topic of fairness is receiving a lot of attention in the academic and broader literature. This paper introduces Dbias…

Information Retrieval · Computer Science 2022-08-12 Shaina Raza , Deepak John Reji , Chen Ding

Over the past several years, a slew of different methods to measure the fairness of a machine learning model have been proposed. However, despite the growing number of publications and implementations, there is still a critical lack of…

Artificial Intelligence · Computer Science 2022-03-10 Alycia N. Carey , Xintao Wu

Diffusion models have emerged as a robust framework for various generative tasks, including tabular data synthesis. However, current tabular diffusion models tend to inherit bias in the training dataset and generate biased synthetic data,…

Machine Learning · Computer Science 2025-03-05 Zeyu Yang , Han Yu , Peikun Guo , Khadija Zanna , Xiaoxue Yang , Akane Sano

If a prediction model identifies vulnerable individuals or groups, the use of that model may become an ethical issue. But can we know that this is what a model does? Machine learning fairness as a field is focused on the just treatment of…

Machine Learning · Computer Science 2022-09-07 Inga Strümke , Marija Slavkovik

The ability to understand and trust the fairness of model predictions, particularly when considering the outcomes of unprivileged groups, is critical to the deployment and adoption of machine learning systems. SHAP values provide a unified…

Machine Learning · Computer Science 2020-06-29 James M. Hickey , Pietro G. Di Stefano , Vlasios Vasileiou