English
Related papers

Related papers: Respect the model: Fine-grained and Robust Explana…

200 papers

In the evolving field of Explainable AI (XAI), interpreting the decisions of deep neural networks (DNNs) in computer vision tasks is an important process. While pixel-based XAI methods focus on identifying significant pixels, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Mounes Zaval , Sedat Ozer

Approaches to Natural language processing (NLP) may be classified along a double dichotomy open/opaque - strict/adaptive. The former axis relates to the possibility of inspecting the underlying processing rules, the latter to the use of…

Information Retrieval · Computer Science 2021-02-19 Telmo Menezes , Camille Roth

We introduce Neural Representation of Distribution (NeRD) technique, a module for convolutional neural networks (CNNs) that can estimate the feature distribution by optimizing an underlying function mapping image coordinates to the feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 Hang Zhang , Rongguang Wang , Jinwei Zhang , Chao Li , Gufeng Yang , Pascal Spincemaille , Thanh Nguyen , Yi Wang

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

Understanding how information is represented in neural networks is a fundamental challenge in both neuroscience and artificial intelligence. Despite their nonlinear architectures, recent evidence suggests that neural networks encode…

Machine Learning · Computer Science 2025-03-04 David Klindt , Charles O'Neill , Patrik Reizinger , Harald Maurer , Nina Miolane

Semi-structured explanation depicts the implicit process of a reasoner with an explicit representation. This explanation highlights how available information in a specific query is utilised and supplemented with information a reasoner…

Computation and Language · Computer Science 2024-01-25 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Human understandable explanation of deep learning models is essential for various critical and sensitive applications. Unlike image or tabular data where the importance of each input feature (for the classifier's decision) can be directly…

Machine Learning · Computer Science 2025-04-07 Shahbaz Rezaei , Xin Liu

Approaches for appraising feature importance approximations, alternatively referred to as attribution methods, have been established across an extensive array of contexts. The development of resilient techniques for performance benchmarking…

Machine Learning · Computer Science 2026-01-06 Junhwa Song , Keumgang Cha , Junghoon Seo

Explainable AI (XAI) methods reveal which features influence model predictions, yet provide limited means for practitioners to act on these explanations. Activation steering of components identified via XAI offers a path toward actionable…

Artificial Intelligence · Computer Science 2026-05-27 Tobias Labarta , Maximilian Dreyer , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin

Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fidelity. While…

Machine Learning · Computer Science 2026-05-28 Sai-Aakash Ramesh , Archit Sood , Andrew Corbett , Tim Dodwell

Recent development in the field of explainable artificial intelligence (XAI) has helped improve trust in Machine-Learning-as-a-Service (MLaaS) systems, in which an explanation is provided together with the model prediction in response to…

Machine Learning · Computer Science 2022-12-15 Truc Nguyen , Phung Lai , NhatHai Phan , My T. Thai

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

Explainable Artificial Intelligence (XAI) is a young but very promising field of research. Unfortunately, the progress in this field is currently slowed down by divergent and incompatible goals. We separate various threads tangled within…

Artificial Intelligence · Computer Science 2024-07-30 Przemyslaw Biecek , Wojciech Samek

The increasing complexity and frequency of cyber-threats demand intrusion detection systems (IDS) that are not only accurate but also interpretable. This paper presented a novel IDS framework that integrated Explainable Artificial…

Deep learning has been successfully applied to medical image segmentation, enabling accurate identification of regions of interest such as organs and lesions. This approach works effectively across diverse datasets, including those with…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Tianyi Ren , Juampablo Heras Rivera , Hitender Oswal , Yutong Pan , Agamdeep Chopra , Jacob Ruzevick , Mehmet Kurt

With the rapid development of eXplainable Artificial Intelligence (XAI), a long line of past work has shown concerns about the Out-of-Distribution (OOD) problem in perturbation-based post-hoc XAI models and explanations are socially…

Machine Learning · Computer Science 2022-06-23 Liu Zhendong , Wenyu Jiang , Yi Zhang , Chongjun Wang

The trustworthiness of neural networks is often challenged because they lack the ability to express uncertainty and explain their skill. This can be problematic given the increasing use of neural networks in high stakes decision-making such…

Atmospheric and Oceanic Physics · Physics 2022-12-07 Mariana C. A. Clare , Maike Sonnewald , Redouane Lguensat , Julie Deshayes , Venkatramani Balaji

Deep neural networks (DNNs) have demonstrated remarkable success, yet their wide adoption is often hindered by their opaque decision-making. To address this, attribution methods have been proposed to assign relevance values to each part of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Danielle Cohen , Hila Chefer , Lior Wolf

Attribution methods aim to explain a neural network's prediction by highlighting the most relevant image areas. A popular approach is to backpropagate (BP) a custom relevance score using modified rules, rather than the gradient. We analyze…

Machine Learning · Computer Science 2024-02-20 Leon Sixt , Maximilian Granz , Tim Landgraf

Modern vision models achieve remarkable accuracy, but explaining where evidence arises, what the model encodes, and how internal computations assemble that evidence remains fragmented. We introduce an iERF-centric framework that unifies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Yearim Kim , Sangyu Han , Nojun Kwak