English
Related papers

Related papers: FairLens: Auditing Black-box Clinical Decision Sup…

200 papers

The adoption of intelligent systems creates opportunities as well as challenges for medical work. On the positive side, intelligent systems have the potential to compute complex data from patients and generate automated diagnosis…

Human-Computer Interaction · Computer Science 2019-02-19 Yao Xie , Ge Gao , Xiang 'Anthony' Chen

AI systems are increasingly used in high-stakes domains such as credit rating, where fairness concerns are critical. Existing fairness assessments are typically conducted by AI experts or regulators using predefined protected attributes and…

Computers and Society · Computer Science 2026-02-10 Lin Luo , Satwik Ghanta , Yuri Nakao , Mathieu Chollet , Simone Stumpf

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

With the ongoing development of deep learning, an increasing number of AI models have surpassed the performance levels of human clinical practitioners. However, the prevalence of AI diagnostic products in actual clinical practice remains…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Chenglong Wang , Yinqiao Yi , Yida Wang , Chengxiu Zhang , Yun Liu , Kensaku Mori , Mei Yuan , Guang Yang

Artificial intelligence (AI) is increasingly intervening in our lives, raising widespread concern about its unintended and undeclared side effects. These developments have brought attention to the problem of AI auditing: the systematic…

Computers and Society · Computer Science 2024-10-08 Sarah H. Cen , Rohan Alur

Artificial intelligence (AI) systems utilizing deep neural networks (DNNs) and machine learning (ML) algorithms are widely used for solving important problems in bioinformatics, biomedical informatics, and precision medicine. However,…

Quantitative Methods · Quantitative Biology 2023-02-24 Md. Rezaul Karim , Tanhim Islam , Oya Beyan , Christoph Lange , Michael Cochez , Dietrich Rebholz-Schuhmann , Stefan Decker

Mitigating algorithmic bias is a critical task in the development and deployment of machine learning models. While several toolkits exist to aid machine learning practitioners in addressing fairness issues, little is known about the…

Human-Computer Interaction · Computer Science 2023-03-02 Zahra Ashktorab , Benjamin Hoover , Mayank Agarwal , Casey Dugan , Werner Geyer , Hao Bang Yang , Mikhail Yurochkin

With the growing prevalence of machine learning and artificial intelligence-based medical decision support systems, it is equally important to ensure that these systems provide patient outcomes in a fair and equitable fashion. This paper…

Machine Learning · Statistics 2024-10-30 Jeffrey Smith , Andre Holder , Rishikesan Kamaleswaran , Yao Xie

As artificial intelligence (AI) becomes increasingly embedded in healthcare delivery, this chapter explores the critical aspects of developing reliable and ethical Clinical Decision Support Systems (CDSS). Beginning with the fundamental…

Artificial Intelligence · Computer Science 2025-02-18 Muhammet Alkan , Idris Zakariyya , Samuel Leighton , Kaushik Bhargav Sivangi , Christos Anagnostopoulos , Fani Deligianni

The increasing deployment of artificial intelligence (AI) tools to inform decision making across diverse areas including healthcare, employment, social benefits, and government policy, presents a serious risk for disabled people, who have…

Artificial Intelligence · Computer Science 2022-11-24 Denis Newman-Griffis , Jessica Sage Rauchberg , Rahaf Alharbi , Louise Hickman , Harry Hochheiser

Biases inherent in both data and algorithms make the fairness of widespread machine learning (ML)-based decision-making systems less than optimal. To improve the trustfulness of such ML decision systems, it is crucial to be aware of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Biying Fu , Naser Damer

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

The paper offers a contribution to the interdisciplinary constructs of analyzing fairness issues in automatic algorithmic decisions. Section 1 shows that technical choices in supervised learning have social implications that need to be…

Computers and Society · Computer Science 2022-06-08 Thierry Kirat , Olivia Tambou , Virginie Do , Alexis Tsoukiàs

When a model informs decisions about people, distribution shifts can create undue disparities. However, it is hard for external entities to check for distribution shift, as the model and its training set are often proprietary. In this…

Machine Learning · Computer Science 2022-09-09 Marc Juarez , Samuel Yeom , Matt Fredrikson

Personal devices are omnipresent in our lives, seamlessly monitoring our activities, from smart rings tracking sleep patterns to smartwatches keeping an eye on missed heartbeats. The rich data streams from such devices fuel advanced…

Computers and Society · Computer Science 2026-03-04 Sofia Yfantidou , Marios Constantinides , Dimitris Spathis , Athena Vakali , Daniele Quercia , Fahim Kawsar

Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Aditya Parikh , Sneha Das , Aasa Feragen

We consider the paradigm of a black box AI system that makes life-critical decisions. We propose an "arguing machines" framework that pairs the primary AI system with a secondary one that is independently trained to perform the same task.…

Artificial Intelligence · Computer Science 2018-09-25 Lex Fridman , Li Ding , Benedikt Jenik , Bryan Reimer

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain "how" imaging features in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sumedha Singla , Motahhare Eslami , Brian Pollack , Stephen Wallace , Kayhan Batmanghelich

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero