English
Related papers

Related papers: DiffExplainer: Unveiling Black Box Models Via Coun…

200 papers

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

Machine Learning · Computer Science 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transparent and their…

Artificial Intelligence · Computer Science 2019-11-28 Vanessa Buhrmester , David Münch , Michael Arens

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle

Recent advancement in machine learning algorithms reaches a point where medical devices can be equipped with artificial intelligence (AI) models for diagnostic support and routine automation in clinical settings. In medicine and healthcare,…

Machine Learning · Statistics 2025-02-21 Takeshi Abe , Yoshiyuki Asai

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

With the ongoing development of deep learning, an increasing number of AI models have surpassed the performance levels of human clinical practitioners. However, the prevalence of AI diagnostic products in actual clinical practice remains…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Chenglong Wang , Yinqiao Yi , Yida Wang , Chengxiu Zhang , Yun Liu , Kensaku Mori , Mei Yuan , Guang Yang

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

Deep neural networks have demonstrated promising performance on image recognition tasks. However, they may heavily rely on confounding factors, using irrelevant artifacts or bias within the dataset as the cue to improve performance. When a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Siyuan Yan , Zhen Yu , Xuelin Zhang , Dwarikanath Mahapatra , Shekhar S. Chandra , Monika Janda , Peter Soyer , Zongyuan Ge

Model explanation techniques play a critical role in understanding the source of a model's performance and making its decisions transparent. Here we investigate if explanation techniques can also be used as a mechanism for scientific…

Counterfactual explanations have been successfully applied to create human interpretable explanations for various black-box models. They are handy for tasks in the image domain, where the quality of the explanations benefits from recent…

Machine Learning · Computer Science 2025-03-27 Trung Duc Ha , Sidney Bender

Deep neural networks (DNNs) can accurately decode task-related information from brain activations. However, because of the nonlinearity of the DNN, the decisions made by DNNs are hardly interpretable. One of the promising approaches for…

Neurons and Cognition · Quantitative Biology 2021-10-29 Teppei Matsui , Masato Taki , Trung Quang Pham , Junichi Chikazoe , Koji Jimura

Existing tools for explaining the output of image classifiers can be divided into white-box, which rely on access to the model internals, and black-box, agnostic to the model. As the usage of AI in the medical domain grows, so too does the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Nathan Blake , Hana Chockler , David A. Kelly , Santiago Calderon Pena , Akchunya Chanchal

The widespread use of black-box AI models has raised the need for algorithms and methods that explain the decisions made by these models. In recent years, the AI research community is increasingly interested in models' explainability since…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Savvas Karatsiolis , Andreas Kamilaris

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

Computation and Language · Computer Science 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

Deep Learning has become a very valuable tool in different fields, and no one doubts the learning capacity of these models. Nevertheless, since Deep Learning models are often seen as black boxes due to their lack of interpretability, there…

Machine Learning · Computer Science 2021-04-23 Jokin Labaien , Ekhi Zugasti , Xabier De Carlos

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

Deep learning classifiers are prone to latching onto dominant confounders present in a dataset rather than on the causal markers associated with the target class, leading to poor generalization and biased predictions. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Nima Fathi , Amar Kumar , Brennan Nichyporuk , Mohammad Havaei , Tal Arbel