中文
相关论文

相关论文: Path-Weighted Integrated Gradients for Interpretab…

200 篇论文

Interpretability methods for deep neural networks mainly focus on the sensitivity of the class score with respect to the original or perturbed input, usually measured using actual or modified gradients. Some methods also use a…

计算机视觉与模式识别 · 计算机科学 2022-06-20 Md Mahfuzur Rahman , Noah Lewis , Sergey Plis

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

In this report, we applied integrated gradients to explaining a neural network for diabetic retinopathy detection. The integrated gradient is an attribution method which measures the contributions of input to the quantity of interest. We…

人工智能 · 计算机科学 2017-10-19 Linyi Li , Matt Fredrikson , Shayak Sen , Anupam Datta

There has been a surge in Explainable-AI (XAI) methods that provide insights into the workings of Deep Neural Network (DNN) models. Integrated Gradients (IG) is a popular XAI algorithm that attributes relevance scores to input features…

机器学习 · 计算机科学 2023-02-23 Ashwin Bhat , Arijit Raychowdhury

Many popular feature-attribution methods for interpreting deep neural networks rely on computing the gradients of a model's output with respect to its inputs. While these methods can indicate which input features may be important for the…

机器学习 · 计算机科学 2023-07-11 Kevin Du , Lucas Torroba Hennigen , Niklas Stoehr , Alexander Warstadt , Ryan Cotterell

The integration of discrete algorithmic components in deep learning architectures has numerous applications. Recently, Implicit Maximum Likelihood Estimation (IMLE, Niepert, Minervini, and Franceschi 2021), a class of gradient estimators…

机器学习 · 计算机科学 2023-02-07 Pasquale Minervini , Luca Franceschi , Mathias Niepert

Today's deep learning methods focus on how to design the most appropriate objective functions so that the prediction results of the model can be closest to the ground truth. Meanwhile, an appropriate architecture that can facilitate…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Chien-Yao Wang , I-Hau Yeh , Hong-Yuan Mark Liao

An important goal of medical imaging is to be able to precisely detect patterns of disease specific to individual scans; however, this is challenged in brain imaging by the degree of heterogeneity of shape and appearance. Traditional…

We study the problem of attributing the prediction of a deep network to its input features, a problem previously studied by several other works. We identify two fundamental axioms---Sensitivity and Implementation Invariance that attribution…

机器学习 · 计算机科学 2017-06-14 Mukund Sundararajan , Ankur Taly , Qiqi Yan

As the number of dementia patients rises, the need for accurate diagnostic procedures rises as well. Current methods, like using an MRI scan, rely on human input, which can be inaccurate. However, the decision logic behind machine learning…

图像与视频处理 · 电气工程与系统科学 2024-06-28 Tyler Morris , Ziming Liu , Longjian Liu , Xiaopeng Zhao

The need for explainable AI (XAI) is well established but relatively little has been published outside of the supervised learning paradigm. This paper focuses on a principled approach to applying explainability and interpretability to the…

机器学习 · 计算机科学 2022-07-26 John Sipple , Abdou Youssef

Interpretable models are crucial for supporting clinical decision-making, driving advances in their development and application for medical images. However, the nature of 3D volumetric data makes it inherently challenging to visualize and…

图形学 · 计算机科学 2025-06-26 Fabian Bongratz , Tom Nuno Wolf , Jaume Gual Ramon , Christian Wachinger

With the recent addition of Retrieval-Augmented Generation (RAG), the scope and importance of Information Retrieval (IR) has expanded. As a result, the importance of a deeper understanding of IR models also increases. However,…

信息检索 · 计算机科学 2024-07-08 Mathias Vast , Basile Van Cooten , Laure Soulier , Benjamin Piwowarski

Current methods for the interpretability of discriminative deep neural networks commonly rely on the model's input-gradients, i.e., the gradients of the output logits w.r.t. the inputs. The common assumption is that these input-gradients…

机器学习 · 计算机科学 2021-03-04 Suraj Srinivas , Francois Fleuret

The prevalence of dementia has increased over time as global life expectancy improves and populations age. An individual's risk of developing dementia is influenced by various genetic, lifestyle, and environmental factors, among others.…

神经元与认知 · 定量生物学 2024-01-12 Srilekha Mamidala

With the growing demand for interpretable deep learning models, this paper introduces Integrative CAM, an advanced Class Activation Mapping (CAM) technique aimed at providing a holistic view of feature importance across Convolutional Neural…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Aniket K. Singh , Debasis Chaudhuri , Manish P. Singh , Samiran Chattopadhyay

Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines…

机器学习 · 计算机科学 2024-05-21 Shuyang Liu , Zixuan Chen , Ge Shi , Ji Wang , Changjie Fan , Yu Xiong , Runze Wu Yujing Hu , Ze Ji , Yang Gao

The use of wearables in medicine and wellness, enabled by AI-based models, offers tremendous potential for real-time monitoring and interpretable event detection. Explainable AI (XAI) is required to assess what models have learned and build…

信号处理 · 电气工程与系统科学 2026-03-16 Maurice Kuschel , Solveig Vieluf , Claus Reinsberger , Tobias Loddenkemper , Tanuj Hasija

Estimating the structure of Bayesian networks as directed acyclic graphs (DAGs) from observational data is a fundamental challenge, particularly in causal discovery. Bayesian approaches excel by quantifying uncertainty and addressing…

机器学习 · 计算机科学 2026-02-17 Edwin V. Bonilla , Pantelis Elinas , He Zhao , Maurizio Filippone , Vassili Kitsios , Terry O'Kane

The study of the attribution of input features to the output of neural network models is an active area of research. While numerous Explainable AI (XAI) techniques have been proposed to interpret these models, the systematic and automated…

计算与语言 · 计算机科学 2026-03-13 Aria Nourbakhsh , Salima Lamsiyah , Adelaide Danilov , Christoph Schommer