English
Related papers

Related papers: Explaining the Black-box Smoothly- A Counterfactua…

200 papers

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Physical and optical factors interacting with sensor characteristics create complex image degradation patterns. Despite advances in deep learning-based super-resolution, existing methods overlook the causal nature of degradation by adopting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhengyang Lu , Bingjie Lu , Feng Wang

In recent years, deep learning models have been extensively applied to biological data across various modalities. Discriminative deep learning models have excelled at classifying images into categories (e.g., healthy versus diseased,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Anis Bourou , Saranga Kingkor Mahanta , Thomas Boyer , Valérie Mezger , Auguste Genovesio

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Dwarikanath Mahapatra

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

Counterfactual explanations are increasingly used to address interpretability, recourse, and bias in AI decisions. However, we do not know how well counterfactual explanations help users to understand a systems decisions, since no large…

Human-Computer Interaction · Computer Science 2023-04-04 Greta Warren , Mark T Keane , Ruth M J Byrne

In this paper, we aim to explain the decisions of neural networks by utilizing multimodal information. That is counter-intuitive attributes and counter visual examples which appear when perturbed samples are introduced. Different from…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Sadaf Gulshad , Arnold Smeulders

Attribution-based explanation techniques capture key patterns to enhance visual interpretability; however, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of model misclassification,…

Artificial Intelligence · Computer Science 2025-11-12 Lintong Zhang , Kang Yin , Seong-Whan Lee

A variety of methods exist to explain image classification models. However, whether they provide any benefit to users over simply comparing various inputs and the model's respective predictions remains unclear. We conducted a user study…

Machine Learning · Computer Science 2022-04-26 Leon Sixt , Martin Schuessler , Oana-Iuliana Popescu , Philipp Weiß , Tim Landgraf

Post-hoc explanations for black box models have been studied extensively in classification and regression settings. However, explanations for models that output similarity between two inputs have received comparatively lesser attention. In…

Machine Learning · Computer Science 2022-02-03 Karthikeyan Natesan Ramamurthy , Amit Dhurandhar , Dennis Wei , Zaid Bin Tariq

The clinical adoption of artificial intelligence (AI) in medical diagnostics is critically hampered by its black-box nature, which prevents clinicians from verifying the rationale behind automated decisions. To overcome this fundamental…

The adoption of increasingly complex deep models has fueled an urgent need for insight into how these models make predictions. Counterfactual explanations form a powerful tool for providing actionable explanations to practitioners.…

Machine Learning · Computer Science 2024-11-05 Paraskevas Pegios , Aasa Feragen , Andreas Abildtrup Hansen , Georgios Arvanitidis

We study the problem of finding a universal (image-agnostic) perturbation to fool machine learning (ML) classifiers (e.g., neural nets, decision tress) in the hard-label black-box setting. Recent work in adversarial ML in the white-box…

Machine Learning · Computer Science 2018-11-14 Thomas A. Hogan , Bhavya Kailkhura

An integrated approach is proposed across visual and textual data to both determine and justify a medical diagnosis by a neural network. As deep learning techniques improve, interest grows to apply them in medical applications. To enable a…

Machine Learning · Computer Science 2019-07-15 Graham Spinks , Marie-Francine Moens

Facial analysis models are increasingly used in applications that have serious impacts on people's lives, ranging from authentication to surveillance tracking. It is therefore critical to develop techniques that can reveal unintended biases…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Remi Denton , Ben Hutchinson , Margaret Mitchell , Timnit Gebru , Andrew Zaldivar

An important step towards explaining deep image classifiers lies in the identification of image regions that contribute to individual class scores in the model's output. However, doing this accurately is a difficult task due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Steven Stalder , Nathanaël Perraudin , Radhakrishna Achanta , Fernando Perez-Cruz , Michele Volpi

Understanding expressions is vital for deciphering human behavior, and nowadays, end-to-end trained black box models achieve high performance. Due to the black-box nature of these models, it is unclear how they behave when applied…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Tim Büchner , Niklas Penzel , Orlando Guntinas-Lichius , Joachim Denzler

In recent years, there has been a rapidly expanding focus on explaining the predictions made by black-box AI systems that handle image and tabular data. However, considerably less attention has been paid to explaining the predictions of…

Machine Learning · Computer Science 2021-06-25 Eoin Delaney , Derek Greene , Mark T. Keane

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng