English
Related papers

Related papers: MRxaI: Black-Box Explainability for Image Classifi…

200 papers

Estimating the test performance of software AI-based medical devices under distribution shifts is crucial for evaluating the safety, efficiency, and usability prior to clinical deployment. Due to the nature of regulated medical device…

Machine Learning · Computer Science 2022-07-14 Charles Lu , Syed Rakin Ahmed , Praveer Singh , Jayashree Kalpathy-Cramer

Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, human-interpretable…

Machine Learning · Computer Science 2022-06-03 Aparna Balagopalan , Haoran Zhang , Kimia Hamidieh , Thomas Hartvigsen , Frank Rudzicz , Marzyeh Ghassemi

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Recent brain tumor classification methods often report high accuracy but rely on deep, over-parameterized architectures with limited interpretability, making it difficult to determine whether predictions are driven by tumor-relevant…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Rajan Das Gupta , Md Imrul Hasan Showmick , Lei Wei , Mushfiqur Rahman Abir , Shanjida Akter , Md. Yeasin Rahat , Md. Jakir Hossen

Explainable Artificial Intelligence (XAI) techniques, such as Gradient-weighted Class Activation Mapping (Grad-CAM), have become indispensable for visualizing the reasoning process of deep neural networks in medical image analysis. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Teerapong Panboonyuen

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

Artificial intelligence systems are widely used by people with sensory disabilities, like loss of vision or hearing, to help perceive or navigate the world around them. This includes tasks like describing an image or object they cannot…

Human-Computer Interaction · Computer Science 2026-03-04 Shadab H. Choudhury

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alina Elena Baia , Valentina Poggioni , Andrea Cavallaro

Accurate and interpretable image-based diagnosis remains a fundamental challenge in medical AI, particularly under domain shifts and rare-class conditions. Deep learning models often struggle with real-world distribution changes, exhibit…

Machine Learning · Computer Science 2025-12-13 Midhat Urooj , Ayan Banerjee , Farhat Shaikh , Kuntal Thakur , Sandeep Gupta

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases may be limited due…

Artificial Intelligence · Computer Science 2020-10-22 Milad Moradi , Matthias Samwald

Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model…

Machine Learning · Computer Science 2025-12-04 Felix Tempel , Daniel Groos , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

The development of machine learning applications has increased significantly in recent years, motivated by the remarkable ability of learning-powered systems to discover and generalize intricate patterns hidden in massive datasets. Modern…

Machine Learning · Computer Science 2025-04-25 Evandro S. Ortigossa , Fábio F. Dias , Brian Barr , Claudio T. Silva , Luis Gustavo Nonato

The widespread adoption of black-box models in Artificial Intelligence has enhanced the need for explanation methods to reveal how these obscure models reach specific decisions. Retrieving explanations is fundamental to unveil possible…

Artificial Intelligence · Computer Science 2021-02-26 Francesco Bodria , Fosca Giannotti , Riccardo Guidotti , Francesca Naretto , Dino Pedreschi , Salvatore Rinzivillo

We are used to the availability of big data generated in nearly all fields of science as a consequence of technological progress. However, the analysis of such data possess vast challenges. One of these relates to the explainability of…

Artificial Intelligence · Computer Science 2022-09-14 Frank Emmert-Streib , Olli Yli-Harja , Matthias Dehmer

In recent years, Artificial Intelligence (AI) has proven its relevance for medical decision support. However, the "black-box" nature of successful AI algorithms still holds back their wide-spread deployment. In this paper, we describe an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Gwenolé Quellec , Hassan Al Hajj , Mathieu Lamard , Pierre-Henri Conze , Pascale Massin , Béatrice Cochener

Image captioning is a technology that produces text-based descriptions for an image. Deep learning-based solutions built on top of feature recognition may very well serve the purpose. But as with any other machine learning solution, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Rishi Kesav Mohan , Sanjay Sureshkumar , Vignesh Sivasubramaniam

Although Deep Neural Networks (DNNs) have great generalization and prediction capabilities, their functioning does not allow a detailed explanation of their behavior. Opaque deep learning models are increasingly used to make important…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Adrien Bennetot , Gianni Franchi , Javier Del Ser , Raja Chatila , Natalia Diaz-Rodriguez

There is a growing demand for the use of Artificial Intelligence (AI) and Machine Learning (ML) in healthcare, particularly as clinical decision support systems to assist medical professionals. However, the complexity of many of these…

Human-Computer Interaction · Computer Science 2025-05-13 Dima Alattal , Asal Khoshravan Azar , Puja Myles , Richard Branson , Hatim Abdulhussein , Allan Tucker