English
Related papers

Related papers: Explanation-Aware Learning for Enhanced Interpreta…

200 papers

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

To verify and validate networks, it is essential to gain insight into their decisions, limitations as well as possible shortcomings of training data. In this work, we propose a post-hoc, optimization based visual explanation method, which…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Jörg Wagner , Jan Mathias Köhler , Tobias Gindele , Leon Hetzel , Jakob Thaddäus Wiedemer , Sven Behnke

The interpretability of machine learning models has gained increasing attention, particularly in scientific domains where high precision and accountability are crucial. This research focuses on distinguishing between two critical data…

Machine Learning · Computer Science 2024-07-02 Jiajun Zhu , Siqi Miao , Rex Ying , Pan Li

Deep Learning of neural networks has progressively become more prominent in healthcare with models reaching, or even surpassing, expert accuracy levels. However, these success stories are tainted by concerning reports on the lack of model…

Machine Learning · Computer Science 2021-11-02 Matthew Watson , Bashar Awwad Shiekh Hasan , Noura Al Moubayed

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Predicting socioeconomic indicators from satellite imagery with deep learning has become an increasingly popular research direction. Post-hoc concept-based explanations can be an important step towards broader adoption of these models in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ivica Obadic , Alex Levering , Lars Pennig , Dario Oliveira , Diego Marcos , Xiaoxiang Zhu

Deep models are the defacto standard in visual decision problems due to their impressive performance on a wide array of visual tasks. On the other hand, their opaqueness has led to a surge of interest in explainable systems. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

We present a randomized controlled trial for a model-in-the-loop regression task, with the goal of measuring the extent to which (1) good explanations of model predictions increase human accuracy, and (2) faulty explanations decrease human…

Machine Learning · Computer Science 2020-07-27 Eric Chu , Deb Roy , Jacob Andreas

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

Interpretability of deep learning (DL) systems is gaining attention in medical imaging to increase experts' trust in the obtained predictions and facilitate their integration in clinical settings. We propose a deep visualization method to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Cristina González-Gonzalo , Bart Liefers , Bram van Ginneken , Clara I. Sánchez

Interpretability of deep learning is widely used to evaluate the reliability of medical imaging models and reduce the risks of inaccurate patient recommendations. For models exceeding human performance, e.g. predicting RNA structure from…

Quantitative Methods · Quantitative Biology 2022-08-31 Mara Graziani , Niccolò Marini , Nicolas Deutschmann , Nikita Janakarajan , Henning Müller , María Rodríguez Martínez

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

XAI gained considerable importance in recent years. Methods based on prototypical case-based reasoning have shown a promising improvement in explainability. However, these methods typically rely on additional post-hoc saliency techniques to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Steffen Meinert , Philipp Schlinge , Nils Strodthoff , Martin Atzmueller

There is an increasing interest in the use of Deep Learning (DL) based methods as a supporting analytical framework in oncology. However, most direct applications of DL will deliver models with limited transparency and explainability, which…

Quantitative Methods · Quantitative Biology 2023-01-26 Magdalena Wysocka , Oskar Wysocki , Marie Zufferey , Dónal Landers , André Freitas

Deep models that are both effective and explainable are desirable in many settings; prior explainable models have been unimodal, offering either image-based visualization of attention weights or text-based generation of post-hoc…

Artificial Intelligence · Computer Science 2018-02-23 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides…

Machine Learning · Computer Science 2025-11-21 Yang Ji , Ying Sun , Yuting Zhang , Zhigaoyuan Wang , Yuanxin Zhuang , Zheng Gong , Dazhong Shen , Chuan Qin , Hengshu Zhu , Hui Xiong

As the applications of Natural Language Processing (NLP) in sensitive areas like Political Profiling, Review of Essays in Education, etc. proliferate, there is a great need for increasing transparency in NLP models to build trust with…

Computation and Language · Computer Science 2022-11-29 Adel Rahimi , Shaurya Jain

Although deep models achieve high predictive performance, it is difficult for humans to understand the predictions they made. Explainability is important for real-world applications to justify their reliability. Many example-based…

Machine Learning · Statistics 2021-12-08 Tomoharu Iwata , Yuya Yoshikawa

Psychiatric questionnaires are highly context sensitive and often only weakly predict subsequent symptom severity, which makes the prognostic relationship difficult to learn. Although flexible nonlinear models can improve predictive…

Machine Learning · Computer Science 2026-03-02 Eric V. Strobl