English
Related papers

Related papers: Decoding Decision Reasoning: A Counterfactual-Powe…

200 papers

In the field of medical image analysis, achieving high accuracy is not enough; ensuring well-calibrated predictions is also crucial. Confidence scores of a deep neural network play a pivotal role in explainability by providing insights into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Abhishek Singh Sambyal , Usma Niyaz , Narayanan C. Krishnan , Deepti R. Bathula

In recent years, Artificial Intelligence (AI) has proven its relevance for medical decision support. However, the "black-box" nature of successful AI algorithms still holds back their wide-spread deployment. In this paper, we describe an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Gwenolé Quellec , Hassan Al Hajj , Mathieu Lamard , Pierre-Henri Conze , Pascale Massin , Béatrice Cochener

Ensuring both transparency and safety is critical when deploying Deep Neural Networks (DNNs) in high-risk applications, such as medicine. The field of explainable AI (XAI) has proposed various methods to comprehend the decision-making…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maximilian Dreyer , Reduan Achtibat , Wojciech Samek , Sebastian Lapuschkin

Artificial intelligence (AI)-based decision support systems can be highly accurate yet still fail to support users or improve decisions. Existing theories of AI-assisted decision-making focus on calibrating reliance on AI advice, leaving it…

Human-Computer Interaction · Computer Science 2026-02-03 Venkatesh Sivaraman , Eric P. Mason , Mengfan Ellen Li , Jessica Tong , Andrew J. King , Jeremy M. Kahn , Adam Perer

Providing high quality explanations for AI predictions based on machine learning is a challenging and complex task. To work well it requires, among other factors: selecting a proper level of generality/specificity of the explanation;…

Deep learning-based AI models have been extensively applied in genomics, achieving remarkable success across diverse applications. As these models gain prominence, there exists an urgent need for interpretability methods to establish…

Genomics · Quantitative Biology 2025-05-16 Chenyu Wang , Chaoying Zuo , Zihan Su , Yuhang Xing , Lu Li , Maojun Wang , Zeyu Zhang

Deep learning-based medical image analysis faces a significant barrier due to the lack of interpretability. Conventional explainable AI (XAI) techniques, such as Grad-CAM and SHAP, often highlight regions outside clinical interests. To…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuhao Zhang , Mingcheng Zhu , Zhiyao Luo

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Junlin Hou , Sicen Liu , Yequan Bie , Hongmei Wang , Andong Tan , Luyang Luo , Hao Chen

Artificial intelligence (AI) continues to transform data analysis in many domains. Progress in each domain is driven by a growing body of annotated data, increased computational resources, and technological innovations. In medicine, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Ahmad Chaddad , Qizong lu , Jiali Li , Yousef Katib , Reem Kateb , Camel Tanougast , Ahmed Bouridane , Ahmed Abdulkadir

Recently, artificial intelligence and machine learning in general have demonstrated remarkable performances in many tasks, from image processing to natural language processing, especially with the advent of deep learning. Along with…

Machine Learning · Computer Science 2020-10-23 Erico Tjoa , Cuntai Guan

Explainable AI consists in developing mechanisms allowing for an interaction between decision systems and humans by making the decisions of the formers understandable. This is particularly important in sensitive contexts like in the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Carlo Metta , Riccardo Guidotti , Yuan Yin , Patrick Gallinari , Salvatore Rinzivillo

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial…

Image and Video Processing · Electrical Eng. & Systems 2022-05-06 Bas H. M. van der Velden , Hugo J. Kuijf , Kenneth G. A. Gilhuijs , Max A. Viergever

Medical imaging plays an important role in the medical sector in identifying diseases. X-ray, computed tomography (CT) scans, and magnetic resonance imaging (MRI) are a few examples of medical imaging. Most of the time, these imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-09-01 Mosabbir Bhuiyan , MD Abdullah Al Nasim , Sarwar Saif , Kishor Datta Gupta , Md Jahangir Alam , Sajedul Talukder

The full acceptance of Deep Learning (DL) models in the clinical field is rather low with respect to the quantity of high-performing solutions reported in the literature. Particularly, end users are reluctant to rely on the rough…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Benjamin Lambert , Florence Forbes , Alan Tucholka , Senan Doyle , Harmonie Dehaene , Michel Dojat

The rapid integration of artificial intelligence (AI) into various industries has introduced new challenges in governance and regulation, particularly regarding the understanding of complex AI systems. A critical demand from decision-makers…

Machine Learning · Computer Science 2024-11-08 Cristian Munoz , Kleyton da Costa , Bernardo Modenesi , Adriano Koshiyama

The overarching goal of Explainable AI is to develop systems that not only exhibit intelligent behaviours, but also are able to explain their rationale and reveal insights. In explainable machine learning, methods that produce a high level…

Artificial Intelligence · Computer Science 2020-05-06 Xiuyi Fan , Siyuan Liu , Thomas C. Henderson

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

In decision making tasks under uncertainty, humans display characteristic biases in seeking, integrating, and acting upon information relevant to the task. Here, we reexamine data from previous carefully designed experiments, collected at…

Artificial Intelligence · Computer Science 2021-02-05 Soumya Chatterjee , Pradeep Shenoy

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman