English
Related papers

Related papers: Decoding Decision Reasoning: A Counterfactual-Powe…

200 papers

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Qianmengke Zhao , Ye Wang , Qun Liu

The science of solving clinical problems by analyzing images generated in clinical practice is known as medical image analysis. The aim is to extract information in an effective and efficient manner for improved clinical diagnosis. The…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Syed Muhammad Anwar , Muhammad Majid , Adnan Qayyum , Muhammad Awais , Majdi Alnowami , Muhammad Khurram Khan

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

How can we find interpretable, domain-appropriate models of natural phenomena given some complex, raw data such as images? Can we use such models to derive scientific insight from the data? In this paper, we propose some methods for…

Machine Learning · Computer Science 2024-02-06 Christopher J. Soelistyo , Alan R. Lowe

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

Machine Learning · Computer Science 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

It has been rightfully emphasized that the use of AI for clinical decision making could amplify health disparities. An algorithm may encode protected characteristics, and then use this information for making predictions due to undesirable…

Machine Learning · Computer Science 2022-07-22 Ben Glocker , Charles Jones , Melanie Bernhardt , Stefan Winzeck

Limited expert time is a key bottleneck in medical imaging. Due to advances in image classification, AI can now serve as decision-support for medical experts, with the potential for great gains in radiologist productivity and, by extension,…

Machine Learning · Computer Science 2021-06-10 Tomas Folke , Scott Cheng-Hsin Yang , Sean Anderson , Patrick Shafto

In Explainable AI, rule extraction translates model knowledge into logical rules, such as IF-THEN statements, crucial for understanding patterns learned by black-box models. This could significantly aid in fields like disease diagnosis,…

Machine Learning · Computer Science 2024-08-16 Yu Chen , Tianyu Cui , Alexander Capstick , Nan Fletcher-Loyd , Payam Barnaghi

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

Aligning the decision-making process of machine learning algorithms with that of experienced radiologists is crucial for reliable diagnosis. While existing methods have attempted to align their diagnosis behaviors to those of radiologists…

Machine Learning · Computer Science 2025-02-10 Mingzhou Liu , Ching-Wen Lee , Xinwei Sun , Yu Qiao , Yizhou Wang

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Deep learning shows promise for medical image analysis but lacks interpretability, hindering adoption in healthcare. Attribution techniques that explain model reasoning may increase trust in deep learning among clinical stakeholders. This…

Machine Learning · Computer Science 2023-08-08 Yusuf Brima , Marcellin Atemkeng

Would you trust physicians if they cannot explain their decisions to you? Medical diagnostics using machine learning gained enormously in importance within the last decade. However, without further enhancements many state-of-the-art machine…

Machine Learning · Computer Science 2022-06-01 Emanuel Slany , Yannik Ott , Stephan Scheele , Jan Paulus , Ute Schmid

Predictive modelling is important for health data analysis and data-driven clinical decision-making. However, predictive studies are challenging to design optimally by hand when tens or even hundreds of features require selection,…

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Schrasing Tong , Lalana Kagal

Medicine is rife with high-stakes uncertainty. Doctors routinely make clinical judgments and decisions that juggle many fundamental unknowns, like predictions about what might be causing a patients' symptoms or decisions about what…

The identification and quantification of markers in medical images is critical for diagnosis, prognosis and management of patients in clinical practice. Supervised- or weakly supervised training enables the detection of findings that are…