English
Related papers

Related papers: Explanation-Aware Learning for Enhanced Interpreta…

200 papers

In this paper I argue that the search for explainable models and interpretable decisions in AI must be reformulated in terms of the broader project of offering a pragmatic and naturalistic account of understanding in AI. Intuitively, the…

Artificial Intelligence · Computer Science 2020-06-23 Andrés Páez

Explainable artificial intelligence (XAI) has become increasingly important in biomedical image analysis to promote transparency, trust, and clinical adoption of DL models. While several surveys have reviewed XAI techniques, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Getamesay Haile Dagnaw , Yanming Zhu , Muhammad Hassan Maqsood , Wencheng Yang , Xingshuai Dong , Xuefei Yin , Alan Wee-Chung Liew

Deep learning-based methods have become the de facto standard for industrial defect detection. However, their data-hungry nature and inherent "black-box" characteristics often lead to performance bottlenecks and limited trustworthiness in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hang-Cheng Dong , Guodong Liu , Dong Ye , Bingguo Liu

Deep learning-based medical image analysis faces a significant barrier due to the lack of interpretability. Conventional explainable AI (XAI) techniques, such as Grad-CAM and SHAP, often highlight regions outside clinical interests. To…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuhao Zhang , Mingcheng Zhu , Zhiyao Luo

Deep learning models achieve high predictive performance but lack intrinsic interpretability, hindering our understanding of the learned prediction behavior. Existing local explainability methods focus on associations, neglecting the causal…

Machine Learning · Computer Science 2025-09-18 Niklas Penzel , Joachim Denzler

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Image classifiers are typically scored on their test set accuracy, but high accuracy can mask a subtle type of model failure. We find that high scoring convolutional neural networks (CNNs) on popular benchmarks exhibit troubling pathologies…

Machine Learning · Computer Science 2021-12-08 Brandon Carter , Siddhartha Jain , Jonas Mueller , David Gifford

Recently generating natural language explanations has shown very promising results in not only offering interpretable explanations but also providing additional information and supervision for prediction. However, existing approaches…

Computation and Language · Computer Science 2022-05-30 Wangchunshu Zhou , Jinyi Hu , Hanlin Zhang , Xiaodan Liang , Maosong Sun , Chenyan Xiong , Jian Tang

Time-to-event prediction, e.g. cancer survival analysis or hospital length of stay, is a highly prominent machine learning task in medical and healthcare applications. However, only a few interpretable machine learning methods comply with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hubert Baniecki , Bartlomiej Sobieski , Patryk Szatkowski , Przemyslaw Bombinski , Przemyslaw Biecek

One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled.…

Artificial Intelligence · Computer Science 2023-12-12 Shawn Im , Jacob Andreas , Yilun Zhou

Deep learning (DL) models find increasing application in mental state decoding, where researchers seek to understand the mapping between mental states (e.g., perceiving fear or joy) and brain activity by identifying those brain regions (and…

Neurons and Cognition · Quantitative Biology 2022-10-17 Armin W. Thomas , Christopher Ré , Russell A. Poldrack

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanation quality can be…

Machine Learning · Computer Science 2020-11-10 Gregory Plumb , Maruan Al-Shedivat , Angel Alexander Cabrera , Adam Perer , Eric Xing , Ameet Talwalkar

In the present paper we present the potential of Explainable Artificial Intelligence methods for decision-support in medical image analysis scenarios. With three types of explainable methods applied to the same medical image data set our…

Artificial Intelligence · Computer Science 2021-05-20 Samanta Knapič , Avleen Malhi , Rohit Saluja , Kary Främling

To improve the performance of Intensive Care Units (ICUs), the field of bio-statistics has developed scores which try to predict the likelihood of negative outcomes. These help evaluate the effectiveness of treatments and clinical practice,…

Machine Learning · Computer Science 2019-08-23 William Caicedo-Torres , Jairo Gutierrez

Deep Learning methods are renowned for their performances, yet their lack of interpretability prevents them from high-stakes contexts. Recent model agnostic methods address this problem by providing post-hoc interpretability methods by…

Machine Learning · Computer Science 2021-11-30 Marco Repetto

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and…

Artificial Intelligence · Computer Science 2022-11-11 Yuanlong Li , Gaopan Huang , Min Zhou , Chuan Fu , Honglin Qiao , Yan He

Recent advances in deep learning have led to interest in training deep learning models on longitudinal healthcare records to predict a range of medical events, with models demonstrating high predictive performance. Predictive performance is…

Machine Learning · Computer Science 2022-11-23 Lin Lee Cheong , Tesfagabir Meharizghi , Wynona Black , Yang Guang , Weilin Meng

In the last years, deep learning has dramatically improved the performances in a variety of medical image analysis applications. Among different types of deep learning models, convolutional neural networks have been among the most…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Minh H. Vu , Gabriella Norman , Tufve Nyholm , Tommy Löfstedt

Machine learning models that offer excellent predictive performance often lack the interpretability necessary to support integrated human machine decision-making. In clinical medicine and other high-risk settings, domain experts may be…

Machine Learning · Computer Science 2021-04-19 Zach Wood-Doughty , Isabel Cachola , Mark Dredze