English
Related papers

Related papers: FairLay-ML: Intuitive Debugging of Fairness in Dat…

200 papers

Bias in machine learning has rightly received significant attention over the last decade. However, most fair machine learning (fair-ML) work to address bias in decision-making systems has focused solely on the offline setting. Despite the…

As machine learning (ML) systems are increasingly adopted in high-stakes decision-making domains, ensuring fairness in their outputs has become a central challenge. At the core of fair ML research are the datasets used to investigate bias…

Machine Learning · Computer Science 2025-10-28 Jan Simson , Alessandro Fabris , Cosima Fröhner , Frauke Kreuter , Christoph Kern

Machine learning (ML) systems are utilized in critical sectors, such as healthcare, law enforcement, and finance. However, these systems are often trained on historical data that contains demographic biases, leading to ML decisions that…

Machine Learning · Computer Science 2025-06-10 Jake Robertson , Noah Hollmann , Samuel Müller , Noor Awad , Frank Hutter

Debugging ML software (i.e., the detection, localization and fixing of faults) poses unique challenges compared to traditional software largely due to the probabilistic nature and heterogeneity of its development process. Various methods…

Software Engineering · Computer Science 2025-03-06 Thanh-Dat Nguyen , Haoye Tian , Bach Le , Patanamon Thongtanunam , Shane McIntosh

The pervasive application of algorithmic decision-making is raising concerns on the risk of unintended bias in AI systems deployed in critical settings such as healthcare. The detection and mitigation of biased models is a very delicate…

Machine Learning · Computer Science 2020-11-10 Cecilia Panigutti , Alan Perotti , Andrè Panisson , Paolo Bajardi , Dino Pedreschi

Automated decision systems are increasingly used to take consequential decisions in problems such as job hiring and loan granting with the hope of replacing subjective human decisions with objective machine learning (ML) algorithms.…

Computers and Society · Computer Science 2023-06-21 Guilherme Alves , Fabien Bernier , Miguel Couceiro , Karima Makhlouf , Catuscia Palamidessi , Sami Zhioua

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Unfair predictions of machine learning (ML) models impede their broad acceptance in real-world settings. Tackling this arduous challenge first necessitates defining what it means for an ML model to be fair. This has been addressed by the ML…

Machine Learning · Computer Science 2024-08-30 Selim Kuzucu , Jiaee Cheong , Hatice Gunes , Sinan Kalkan

Increasing use of large language models (LLMs) demand performant guardrails to ensure the safety of inputs and outputs of LLMs. When these safeguards are trained on imbalanced data, they can learn the societal biases. We present a…

Computation and Language · Computer Science 2024-10-23 Olivia Sturman , Aparna Joshi , Bhaktipriya Radharapu , Piyush Kumar , Renee Shelby

Machine learning (ML) algorithms play a critical role in decision-making across various domains, such as healthcare, finance, education, and law enforcement. However, concerns about fairness and bias in these systems have raised significant…

Machine Learning · Computer Science 2025-07-25 Ahmed Rashed , Abdelkrim Kallich , Mohamed Eltayeb

Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to mitigate bias in…

Software Engineering · Computer Science 2023-08-30 Giang Nguyen , Sumon Biswas , Hridesh Rajan

With the increasing application of machine learning in high-stake decision-making problems, potential algorithmic bias towards people from certain social groups poses negative impacts on individuals and our society at large. In the…

Machine Learning · Computer Science 2022-06-22 Ziwei Wu , Jingrui He

Fairness is a critical requirement for Machine Learning (ML) software, driving the development of numerous bias mitigation methods. Previous research has identified a leveling-down effect in bias mitigation for computer vision and natural…

Machine Learning · Computer Science 2025-08-06 Zhenpeng Chen , Xinyue Li , Jie M. Zhang , Weisong Sun , Ying Xiao , Tianlin Li , Yiling Lou , Yang Liu

Machine learning (ML) based approaches are increasingly being used in a number of applications with societal impact. Training ML models often require vast amounts of labeled data, and crowdsourcing is a dominant paradigm for obtaining…

Machine Learning · Computer Science 2023-04-26 Simone Lazier , Saravanan Thirumuruganathan , Hadis Anahideh

In consequential real-world applications, machine learning (ML) based systems are expected to provide fair and non-discriminatory decisions on candidates from groups defined by protected attributes such as gender and race. These…

Computers and Society · Computer Science 2017-10-20 Samiulla Shaikh , Harit Vishwakarma , Sameep Mehta , Kush R. Varshney , Karthikeyan Natesan Ramamurthy , Dennis Wei

Objective: Algorithmic fairness is essential for equitable and trustworthy machine learning in healthcare. Most fairness tools emphasize single-axis demographic comparisons and may miss compounded disparities affecting intersectional…

Machine Learning · Computer Science 2026-04-07 Nick Souligne , Vignesh Subbian

Today, with the growing obsession with applying Artificial Intelligence (AI), particularly Machine Learning (ML), to software across various contexts, much of the focus has been on the effectiveness of AI models, often measured through…

Software Engineering · Computer Science 2025-12-10 Thanh Nguyen , Chaima Boufaied , Ronnie de Souza Santos

The widespread adoption of ML systems across critical domains like hiring, finance, and healthcare raises growing concerns about their potential for discriminatory decision-making based on protected attributes. While efforts to ensure…

Artificial Intelligence · Computer Science 2024-06-27 Hussaini Mamman , Shuib Basri , Abdullateef Balogun , Abubakar Abdullahi Imam , Ganesh Kumar , Luiz Fernando Capretz

Sensitive attributes like gender or age can lead to unfair predictions in machine learning tasks such as predictive business process monitoring, particularly when used without considering context. We present FairLoop1, a tool for…