English
Related papers

Related papers: MRxaI: Black-Box Explainability for Image Classifi…

200 papers

In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in remote sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI,…

Advancements in high-throughput technologies have led to a shift from traditional hypothesis-driven methodologies to data-driven approaches. Multi-omics refers to the integrative analysis of data derived from multiple 'omes', such as…

Genomics · Quantitative Biology 2024-10-17 Ahmad Hussein , Mukesh Prasad , Ali Braytee

Deep learning models used in medical image analysis are prone to raising reliability concerns due to their black-box nature. To shed light on these black-box models, previous works predominantly focus on identifying the contribution of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Matan Atad , Vitalii Dmytrenko , Yitong Li , Xinyue Zhang , Matthias Keicher , Jan Kirschke , Bene Wiestler , Ashkan Khakzar , Nassir Navab

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

Artificial Intelligence · Computer Science 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

Visual explanation of ``black-box'' models allows researchers in explainable artificial intelligence (XAI) to interpret the model's decisions in a human-understandable manner. In this paper, we propose interpretable class activation mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Seyed Mojtaba Marvasti-Zadeh , Devin Goodsman , Nilanjan Ray , Nadir Erbilgin

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

We take a formal approach to the explainability problem of machine learning systems. We argue against the practice of interpreting black-box models via attributing scores to input components due to inherently conflicting goals of…

Machine Learning · Computer Science 2023-06-13 Kai Jia , Pasapol Saowakon , Limor Appelbaum , Martin Rinard

Ensuring trustworthiness in open-world visual recognition requires models that are interpretable, fair, and robust to distribution shifts. Yet modern vision systems are increasingly deployed as proprietary black-box APIs, exposing only…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Simone Carnemolla , Chiara Russo , Simone Palazzo , Quentin Bouniot , Daniela Giordano , Zeynep Akata , Matteo Pennisi , Concetto Spampinato

Causal machine learning tools are beginning to see use in real-world policy evaluation tasks to flexibly estimate treatment effects. One issue with these methods is that the machine learning models used are generally black boxes, i.e.,…

Machine Learning · Computer Science 2024-04-01 Patrick Rehill , Nicholas Biddle

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

Evaluating explainable AI (XAI) approaches is a challenging task in general, due to the subjectivity of explanations. In this paper, we focus on tabular data and the specific use case of AI models predicting the values of Boolean functions.…

Artificial Intelligence · Computer Science 2025-09-15 Stav Armoni-Friedmann , Hana Chockler , David A. Kelly

Would you trust physicians if they cannot explain their decisions to you? Medical diagnostics using machine learning gained enormously in importance within the last decade. However, without further enhancements many state-of-the-art machine…

Machine Learning · Computer Science 2022-06-01 Emanuel Slany , Yannik Ott , Stephan Scheele , Jan Paulus , Ute Schmid

Recent developments in Artificial Intelligence (AI) and their applications in critical industries such as healthcare, fin-tech and cybersecurity have led to a surge in research in explainability in AI. Innovative research methods are being…

Artificial Intelligence · Computer Science 2025-08-26 Aoun E Muhammad , Kin-Choong Yow , Nebojsa Bacanin-Dzakula , Muhammad Attique Khan

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

Artificial Intelligence · Computer Science 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

Artificial Intelligence (AI) has come to prominence as one of the major components of our society, with applications in most aspects of our lives. In this field, complex and highly nonlinear machine learning models such as ensemble models,…

Machine Learning · Computer Science 2021-01-29 Mattia Setzu , Riccardo Guidotti , Anna Monreale , Franco Turini , Dino Pedreschi , Fosca Giannotti

Recent work in model-agnostic explanations of black-box machine learning has demonstrated that interpretability of complex models does not have to come at the cost of accuracy or model flexibility. However, it is not clear what kind of…

Machine Learning · Statistics 2016-11-24 Sameer Singh , Marco Tulio Ribeiro , Carlos Guestrin

Model explainability is essential for the creation of trustworthy Machine Learning models in healthcare. An ideal explanation resembles the decision-making process of a domain expert and is expressed using concepts or terminology that is…

Machine Learning · Computer Science 2021-07-14 Sumedha Singla , Stephen Wallace , Sofia Triantafillou , Kayhan Batmanghelich

Artificial intelligence (AI) systems have substantially improved dermatologists' diagnostic accuracy for melanoma, with explainable AI (XAI) systems further enhancing clinicians' confidence and trust in AI-driven decisions. Despite these…

The advancements in deep learning-based methods for visual perception tasks have seen astounding growth in the last decade, with widespread adoption in a plethora of application areas from autonomous driving to clinical decision support…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kumar Abhishek , Deeksha Kamath