English
Related papers

Related papers: Exploring a Gradient-based Explainable AI Techniqu…

200 papers

Salient object detection has been attracting a lot of interest, and recently various heuristic computational models have been designed. In this paper, we formulate saliency map computation as a regression problem. Our method, which is based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Huaizu Jiang , Zejian Yuan , Ming-Ming Cheng , Yihong Gong , Nanning Zheng , Jingdong Wang

We present a novel method for reliably explaining the predictions of neural networks. We consider an explanation reliable if it identifies input features relevant to the model output by considering the input and the neighboring data points.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Dohun Lim , Hyeonseok Lee , Sungchan Kim

Understanding the reasons behind the predictions made by deep neural networks is critical for gaining human trust in many important applications, which is reflected in the increasing demand for explainability in AI (XAI) in recent years.…

Human-Computer Interaction · Computer Science 2021-08-31 Xiaotian Lu , Arseny Tolmachev , Tatsuya Yamamoto , Koh Takeuchi , Seiji Okajima , Tomoyoshi Takebayashi , Koji Maruhashi , Hisashi Kashima

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

When do gradient-based explanation algorithms provide perceptually-aligned explanations? We propose a criterion: the feature attributions need to be aligned with the tangent space of the data manifold. To provide evidence for this…

Machine Learning · Computer Science 2024-07-16 Sebastian Bordt , Uddeshya Upadhyay , Zeynep Akata , Ulrike von Luxburg

Saliency methods can aid understanding of deep neural networks. Recent years have witnessed many improvements to saliency methods, as well as new ways for evaluating them. In this paper, we 1) present a novel region-based attribution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Andrei Kapishnikov , Tolga Bolukbasi , Fernanda Viégas , Michael Terry

Much of studies on neural computation are based on network models of static neurons that produce analog output, despite the fact that information processing in the brain is predominantly carried out by dynamic neurons that produce discrete…

Neurons and Cognition · Quantitative Biology 2017-06-21 Dongsung Huh , Terrence J. Sejnowski

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

This study addresses the challenge of predicting post-stroke rigidity by emphasizing feature interactions through graph-based explainable AI. Post-stroke rigidity, characterized by increased muscle tone and stiffness, significantly affects…

Cardiac muscle tissue during relaxation is commonly modelled as a hyperelastic material with strongly nonlinear and anisotropic stress response. Adapting the behavior of such a model to experimental or patient data gives rise to a parameter…

Tissues and Organs · Quantitative Biology 2016-03-16 Gabriel Balaban , Martin S. Alnæs , Joakim Sundnes , Marie E. Rognes

Gaining insight into how deep convolutional neural network models perform image classification and how to explain their outputs have been a concern to computer vision researchers and decision makers. These deep models are often referred to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Daniel Omeiza , Skyler Speakman , Celia Cintas , Komminist Weldermariam

Timely and accurate diagnosis of neurodegenerative disorders, such as Alzheimer's disease, is central to disease management. Existing deep learning models require large-scale annotated datasets and often function as "black boxes".…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Duy-Cat Can , Quang-Huy Tang , Huong Ha , Binh T. Nguyen , Oliver Y. Chén

Accelerated MRI reconstructs images of clinical anatomies from sparsely sampled signal data to reduce patient scan times. While recent works have leveraged deep learning to accomplish this task, such approaches have often only been explored…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Michael S. Yao , Michael S. Hansen

We present a method of explainable artificial intelligence (XAI), "What I Know (WIK)", to provide additional information to verify the reliability of a deep learning model by showing an example of an instance in a training dataset that is…

Artificial Intelligence · Computer Science 2023-02-06 Shin-nosuke Ishikawa , Masato Todo , Masato Taki , Yasunobu Uchiyama , Kazunari Matsunaga , Peihsuan Lin , Taiki Ogihara , Masao Yasui

Recent explainable artificial intelligence (XAI) methods for time series primarily estimate point-wise attribution magnitudes, while overlooking the directional impact on predictions, leading to suboptimal identification of significant…

Machine Learning · Computer Science 2025-06-06 Hyeongwon Jang , Changhun Kim , Eunho Yang

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shafin Rahman , Sejuti Rahman , Omar Shahid , Md. Tahmeed Abdullah , Jubair Ahmed Sourov

Gradient descent is one of the most widely used iterative algorithms in modern statistical learning. However, its precise algorithmic dynamics in high-dimensional settings remain only partially understood, which has limited its broader…

Statistics Theory · Mathematics 2025-11-19 Qiyang Han , Xiaocong Xu

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

Trustworthy interpretation of deep learning models is critical for neuroimaging applications, yet commonly used Explainable AI (XAI) methods lack rigorous validation, risking misinterpretation. We performed the first large-scale, systematic…

Machine Learning · Computer Science 2025-08-07 Nys Tjade Siegel , James H. Cole , Mohamad Habes , Stefan Haufe , Kerstin Ritter , Marc-André Schulz