English
Related papers

Related papers: Advancing Attribution-Based Neural Network Explain…

200 papers

Three important criteria of existing convolutional neural networks (CNNs) are (1) test-set accuracy; (2) out-of-distribution accuracy; and (3) explainability. While these criteria have been studied independently, their relationship is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Mehdi Nourelahi , Lars Kotthoff , Peijie Chen , Anh Nguyen

Recent work has found that adversarially-robust deep networks used for image classification are more interpretable: their feature attributions tend to be sharper, and are more concentrated on the objects associated with the image's…

Machine Learning · Computer Science 2021-10-07 Zifan Wang , Matt Fredrikson , Anupam Datta

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson

A framework is presented to extract and understand decision-making information from a deep neural network (DNN) classifier of jet substructure tagging techniques. The general method studied is to provide expert variables that augment inputs…

Data Analysis, Statistics and Probability · Physics 2023-01-11 Garvita Agarwal , Lauren Hay , Ia Iashvili , Benjamin Mannix , Christine McLean , Margaret Morris , Salvatore Rappoccio , Ulrich Schubert

Reinforcement learning has become a cornerstone for enhancing the reasoning capabilities of Large Language Models, where group-based approaches such as GRPO have emerged as efficient paradigms that optimize policies by leveraging…

Interpretability is crucial for ensuring RL systems align with human values. However, it remains challenging to achieve in complex decision making domains. Existing methods frequently attempt interpretability at the level of fundamental…

Machine Learning · Computer Science 2025-06-03 Anna Soligo , Pietro Ferraro , David Boyle

Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yushuai Song , Weize Quan , Weining Wang , Jiahui Sun , Jing Liu , Meng Li , Pengbin Yu , Zhentao Chen , Wei Shen , Lunxi Yuan , Dong-ming Yan

Local explanation methods, also known as attribution methods, attribute a deep network's prediction to its input (cf. Baehrens et al. (2010)). We respond to the claim from Adebayo et al. (2018) that local explanation methods lack…

Machine Learning · Computer Science 2018-06-13 Mukund Sundararajan , Ankur Taly

Saliency map generation techniques are at the forefront of explainable AI literature for a broad range of machine learning applications. Our goal is to question the limits of these approaches on more complex tasks. In this paper we apply…

Machine Learning · Computer Science 2019-07-15 David Tuckey , Krysia Broda , Alessandra Russo

State-of-the-art attribution methods rely on adversarial sample generation that applies an all-pass filter across the frequency spectrum, discarding fine-grained high-frequency information that is demonstrably important for accurate feature…

Machine Learning · Computer Science 2026-05-11 Ali Yavari , Alireza Mohamadi , Elham Beydaghi , Philipp Seeböck , Rainer A. Leitgeb

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

Deep neural networks are one of the most successful classifiers across different domains. However, due to their limitations concerning interpretability their use is limited in safety critical context. The research field of explainable…

Machine Learning · Computer Science 2022-05-30 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Leave-One-Out (LOO) provides an intuitive measure of feature importance but is computationally prohibitive. While Layer-Wise Relevance Propagation (LRP) offers a potentially efficient alternative, its axiomatic soundness in modern…

Machine Learning · Computer Science 2025-10-22 Weiqiu You , Siqi Zeng , Yao-Hung Hubert Tsai , Makoto Yamada , Han Zhao

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

A number of backpropagation-based approaches such as DeConvNets, vanilla Gradient Visualization and Guided Backpropagation have been proposed to better understand individual decisions of deep convolutional neural networks. The saliency maps…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Jindong Gu , Yinchong Yang , Volker Tresp

Convolutional Neural Networks (CNNs) pre-trained on large-scale datasets such as ImageNet are widely used as feature extractors to construct high-accuracy classification models from scarce data for specific tasks. In such scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Daisuke Yasui , Toshitaka Matsuki , Hiroshi Sato

The deployment of Machine Learning models intraoperatively for tissue characterisation can assist decision making and guide safe tumour resections. For image classification models, pixel attribution methods are popular to infer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Alfie Roddan , Chi Xu , Serine Ajlouni , Irini Kakaletri , Patra Charalampaki , Stamatia Giannarou

Distance-based classifiers, such as k-nearest neighbors and support vector machines, continue to be a workhorse of machine learning, widely used in science and industry. In practice, to derive insights from these models, it is also…

Machine Learning · Computer Science 2026-05-05 Florian Bley , Jacob Kauffmann , Simon León Krug , Klaus-Robert Müller , Grégoire Montavon

Recent advances highlight Reinforcement Learning with Verifiable Rewards (RLVR) as a promising method for enhancing LLMs' capabilities. However, it remains unclear whether the current practice of RLVR truly expands a model's reasoning…

Machine Learning · Computer Science 2026-02-05 Fang Wu , Weihao Xuan , Ximing Lu , Mingjie Liu , Yi Dong , Zaid Harchaoui , Yejin Choi

This thesis explores advanced approaches to improve explainability in computer vision by analyzing and modeling the features exploited by deep neural networks. Initially, it evaluates attribution methods, notably saliency maps, by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Thomas Fel