English
Related papers

Related papers: Advancing Attribution-Based Neural Network Explain…

200 papers

To explain predictions made by complex machine learning models, many feature attribution methods have been developed that assign importance scores to input features. Some recent work challenges the robustness of these methods by showing…

Machine Learning · Computer Science 2023-11-01 Chris Lin , Ian Covert , Su-In Lee

While attribution methods, such as Shapley values, are widely used to explain the importance of features or training data in traditional machine learning, their application to Large Language Models (LLMs), particularly within…

Machine Learning · Computer Science 2025-07-08 Ikhtiyor Nematov , Tarik Kalai , Elizaveta Kuzmenko , Gabriele Fugagnoli , Dimitris Sacharidis , Katja Hose , Tomer Sagi

Attribution map visualization has arisen as one of the most effective techniques to understand the underlying inference process of Convolutional Neural Networks. In this task, the goal is to compute an score for each image pixel related…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Adria Ruiz , Antonio Agudo , Francesc Moreno

With the growing popularity of deep-learning models, model understanding becomes more important. Much effort has been devoted to demystify deep neural networks for better interpretability. Some feature attribution methods have shown…

Computation and Language · Computer Science 2022-04-27 Sheng Zhang , Jin Wang , Haitao Jiang , Rui Song

Deep learning (DL) has revolutionized the field of document image analysis, showcasing superhuman performance across a diverse set of tasks. However, the inherent black-box nature of deep learning models still presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

Machine Learning · Computer Science 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Large vision transformers present impressive scalability, as their performance can be well improved with increased model capacity. Nevertheless, their cumbersome parameters results in exorbitant computational and memory demands. By…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Chengchao Shen

To reduce the heavy computational burden of reactive power optimization of distribution networks, machine learning models are receiving increasing attention. However, most machine learning models (e.g., neural networks) are usually…

Systems and Control · Electrical Eng. & Systems 2023-11-08 Wenlong Liao , Benjamin Schäfer , Dalin Qin , Gonghao Zhang , Zhixian Wang , Zhe Yang

In the last decade neural network have made huge impact both in industry and research due to their ability to extract meaningful features from imprecise or complex data, and by achieving super human performance in several domains. However,…

Artificial Intelligence · Computer Science 2022-02-09 Dominique Mercier , Jwalin Bhatt , Andreas Dengel , Sheraz Ahmed

Current machine learning models have shown high efficiency in solving a wide variety of real-world problems. However, their black box character poses a major challenge for the understanding and traceability of the underlying decision-making…

Machine Learning · Computer Science 2021-08-30 Srishti Gautam , Marina M. -C. Höhne , Stine Hansen , Robert Jenssen , Michael Kampffmeyer

Deep learning models are widely applied in the signal processing community, yet their inner working procedure is often treated as a black box. In this paper, we investigate the use of eXplainable Artificial Intelligence (XAI) techniques to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-29 Luca Comanducci , Fabio Antonacci , Augusto Sarti

Large language models are known to contain representational redundancy across network depth, making depth pruning an effective approach for improving inference efficiency. Existing one-shot pruning methods rely on local layer importance or…

Machine Learning · Computer Science 2026-05-28 Vincent-Daniel Yun , Youngrae Kim , Woosang Lim , YoungJin Heo , Minkyu Kim , Sunwoo Lee

Different users of machine learning methods require different explanations, depending on their goals. To make machine learning accountable to society, one important goal is to get actionable options for recourse, which allow an affected…

Machine Learning · Statistics 2023-12-21 Hidde Fokkema , Rianne de Heide , Tim van Erven

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

A common approach to explaining NLP models is to use importance measures that express which tokens are important for a prediction. Unfortunately, such explanations are often wrong despite being persuasive. Therefore, it is essential to…

Computation and Language · Computer Science 2024-08-29 Andreas Madsen , Siva Reddy , Sarath Chandar

Most evaluations of attribution methods focus on the English language. In this work, we present a multilingual approach for evaluating attribution methods for the Natural Language Inference (NLI) task in terms of faithfulness and…

Computation and Language · Computer Science 2023-06-06 Kerem Zaman , Yonatan Belinkov

Deep neural networks are often considered opaque systems, prompting the need for explainability methods to improve trust and accountability. Existing approaches typically attribute test-time predictions either to input features (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Aziz Bacha , Thomas George

Interpretability is an emerging area of research in trustworthy machine learning. Safe deployment of machine learning system mandates that the prediction and its explanation be reliable and robust. Recently, it has been shown that the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Mayank Singh , Nupur Kumari , Puneet Mangla , Abhishek Sinha , Vineeth N Balasubramanian , Balaji Krishnamurthy

Deep Neural Networks (DNNs) have demonstrated impressive performance in complex machine learning tasks such as image classification or speech recognition. However, due to their multi-layer nonlinear structure, they are not transparent,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Wojciech Samek , Alexander Binder , Grégoire Montavon , Sebastian Bach , Klaus-Robert Müller

Interpretability tools are increasingly used to analyze failures of Large Language Models (LLMs), yet prior work largely focuses on short prompts or toy settings, leaving their behavior on commonly used benchmarks underexplored. To address…

Artificial Intelligence · Computer Science 2026-04-21 Rongyuan Tan , Jue Zhang , Zhuozhao Li , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang