中文
相关论文

相关论文: Strengthening Interpretability: An Investigative S…

200 篇论文

Integrated Gradients (IG) is a widely adopted feature attribution method that satisfies desirable axiomatic properties. However, the choice of integration path significantly affects the quality of attributions, and the standard…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

Explainable intrusion detection systems (IDS) are now recognized as essential for mission-critical networks, yet most "XAI" pipelines still bolt an approximate explainer onto an opaque classifier, leaving analysts with partial and sometimes…

密码学与安全 · 计算机科学 2025-07-22 Wen-Cheng Chung , Shu-Ting Huang , Hao-Ting Pai

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

We provide rigorous proofs that the Integrated Gradients (IG) attribution method for deep networks satisfies completeness and symmetry-preserving properties. We also study the uniqueness of IG as a path method preserving symmetry.

机器学习 · 计算机科学 2021-03-26 Miguel Lerma , Mirtha Lucas

We introduce path-sampled integrated gradients (PS-IG), a framework that generalizes feature attribution by computing the expected value over baselines sampled along the linear interpolation path. We prove that PS-IG is mathematically…

机器学习 · 计算机科学 2026-04-17 Firuz Kamalov , Fadi Thabtah , R. Sivaraj , Neda Abdelhamid

We introduce Riemannian Integrated Gradients (RIG); an extension of Integrated Gradients (IG) to Riemannian manifolds. We demonstrate that RIG restricts to IG when the Riemannian manifold is Euclidean space. We show that feature attribution…

机器学习 · 计算机科学 2025-03-04 Federico Costanza , Lachlan Simpson

This work builds upon previous efforts in online incremental learning, namely the Incremental Gaussian Mixture Network (IGMN). The IGMN is capable of learning from data streams in a single-pass by improving its model after analyzing each…

机器学习 · 计算机科学 2017-02-08 Rafael Pinto , Paulo Engel

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

机器学习 · 计算机科学 2025-03-04 Sarem Seitz

Integrated Gradients has become a popular method for post-hoc model interpretability. De-spite its popularity, the composition and relative impact of different regions of the integral path are not well understood. We explore these effects…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Vivek Miglani , Narine Kokhlikyan , Bilal Alsallakh , Miguel Martin , Orion Reblitz-Richardson

Integrated Gradients (IG), one of the most popular explainability methods available, still remains ambiguous in the selection of baseline, which may seriously impair the credibility of the explanations. This study proposes a new uniform…

机器学习 · 计算机科学 2022-04-13 Hanxiao Tan

While 3D Gaussian Splatting enables high-quality real-time rendering, existing Gaussian-based frameworks for 3D semantic segmentation still face significant challenges in boundary recognition accuracy. To address this, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Zehao Li , Wenwei Han , Yujun Cai , Hao Jiang , Baolong Bi , Shuqin Gao , Honglong Zhao , Zhaoqi Wang

Feature attribution is central to diagnosing and trusting deep neural networks, and Integrated Gradients (IG) is widely used due to its axiomatic properties. However, IG can yield unreliable explanations when the integration path between a…

机器学习 · 计算机科学 2026-05-19 Soyeon Kim , Seongwoo Lim , Kyowoon Lee , Jaesik Choi

We observe that existing model interpretation methods generally ignore the baseline, and such neglect often results in imprecise or even incorrect interpretation. In this paper, we reformulate the task of model interpretation and the…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yongjin Cui , Xiaohui Fan

Model compression is critical for deploying deep learning models on resource-constrained devices. We introduce a novel method enhancing knowledge distillation with integrated gradients (IG) as a data augmentation strategy. Our approach…

计算机视觉与模式识别 · 计算机科学 2025-06-18 David E. Hernandez , Jose Chang , Torbjörn E. M. Nordling

Interpretability is essential in Whole Slide Image (WSI) analysis for computational pathology, where understanding model predictions helps build trust in AI-assisted diagnostics. While Integrated Gradients (IG) and related attribution…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Anh Mai Vu , Tuan L. Vo , Ngoc Lam Quang Bui , Nam Nguyen Le Binh , Akash Awasthi , Huy Quoc Vo , Thanh-Huy Nguyen , Zhu Han , Chandra Mohan , Hien Van Nguyen

Integrated gradients are widely employed to evaluate the contribution of input features in classification models because it satisfies the axioms for attribution of prediction. This method, however, requires an appropriate baseline for…

机器学习 · 计算机科学 2018-11-28 Kazuki Tachikawa , Yuji Kawai , Jihoon Park , Minoru Asada

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

机器学习 · 计算机科学 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

Deep learning has become the standard approach for most machine learning tasks. While its impact is undeniable, interpreting the predictions of deep learning models from a human perspective remains a challenge. In contrast to model…

机器学习 · 计算机科学 2023-11-13 Kyriakos Axiotis , Sami Abu-al-haija , Lin Chen , Matthew Fahrbach , Gang Fu

Recently, there has been growing interest in developing optimization methods for solving large-scale machine learning problems. Most of these problems boil down to the problem of minimizing an average of a finite set of smooth and strongly…

最优化与控制 · 数学 2018-02-09 Aryan Mokhtari , Mert Gürbüzbalaban , Alejandro Ribeiro

With the recent addition of Retrieval-Augmented Generation (RAG), the scope and importance of Information Retrieval (IR) has expanded. As a result, the importance of a deeper understanding of IR models also increases. However,…

信息检索 · 计算机科学 2024-07-08 Mathias Vast , Basile Van Cooten , Laure Soulier , Benjamin Piwowarski