English
Related papers

Related papers: Respect the model: Fine-grained and Robust Explana…

200 papers

Recent advancement in deep-neural network performance led to the development of new state-of-the-art approaches in numerous areas. However, the black-box nature of neural networks often prohibits their use in areas where model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Davor Vukadin , Petar Afrić , Marin Šilić , Goran Delač

In this paper, we propose Describe-and-Dissect (DnD), a novel method to describe the roles of hidden neurons in vision networks. DnD utilizes recent advancements in multimodal deep learning to produce complex natural language descriptions,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Nicholas Bai , Rahul A. Iyer , Tuomas Oikarinen , Akshay Kulkarni , Tsui-Wei Weng

Despite the growing interest in Explainable Artificial Intelligence (XAI), explainability is rarely considered during hyperparameter tuning or neural architecture optimization, where the focus remains primarily on minimizing predictive…

Machine Learning · Computer Science 2025-05-26 Alexander Hinterleitner , Thomas Bartz-Beielstein

The robustness of image recognition algorithms remains a critical challenge, as current models often depend on large quantities of labeled data. In this paper, we propose a hybrid approach that combines the adaptability of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Sina Ditzel , Achref Jaziri , Iuliia Pliushch , Visvanathan Ramesh

Deep neural networks (DNNs) are increasingly being used as controllers in reactive systems. However, DNNs are highly opaque, which renders it difficult to explain and justify their actions. To mitigate this issue, there has been a surge of…

Artificial Intelligence · Computer Science 2023-10-06 Shahaf Bassan , Guy Amir , Davide Corsi , Idan Refaeli , Guy Katz

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Selective rationalization has become a common mechanism to ensure that predictive models reveal how they use any available features. The selection may be soft or hard, and identifies a subset of input features relevant for prediction. The…

Computation and Language · Computer Science 2019-12-17 Mo Yu , Shiyu Chang , Yang Zhang , Tommi S. Jaakkola

Apart from the high accuracy of machine learning models, what interests many researchers in real-life problems (e.g., fraud detection, credit scoring) is to find hidden patterns in data; particularly when dealing with their challenging…

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Answer Set Programming (ASP) is a popular declarative reasoning and problem solving approach in symbolic AI. Its rule-based formalism makes it inherently attractive for explainable and interpretive reasoning, which is gaining importance…

Artificial Intelligence · Computer Science 2026-01-22 Thomas Eiter , Tobias Geibinger , Zeynep G. Saribatur

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

Convolutional neural networks (CNNs) have recently attracted great attention in geoscience due to their ability to capture non-linear system behavior and extract predictive spatiotemporal patterns. Given their black-box nature however, and…

Geophysics · Physics 2022-09-07 Antonios Mamalakis , Elizabeth A. Barnes , Imme Ebert-Uphoff

The black-box nature of deep neural networks (DNN) has brought to attention the issues of transparency and fairness. Deep Reinforcement Learning (Deep RL or DRL), which uses DNN to learn its policy, value functions etc, is thus also subject…

Machine Learning · Computer Science 2023-01-24 Erico Tjoa , Guan Cuntai

Deep learning has significantly improved time series classification, yet the lack of explainability in these models remains a major challenge. While Explainable AI (XAI) techniques aim to make model decisions more transparent, their…

Machine Learning · Computer Science 2026-02-16 Yannik Hahn , Antonin Königsfeld , Hasan Tercan , Tobias Meisen

Achieving transparency in black-box deep learning algorithms is still an open challenge. High dimensional features and decisions given by deep neural networks (NN) require new algorithms and methods to expose its mechanisms. Current…

Machine Learning · Computer Science 2020-06-12 Schyler C. Sun , Chen Li , Zhuangkun Wei , Antonios Tsourdos , Weisi Guo

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most…

Artificial Intelligence · Computer Science 2024-06-18 Ahmed M Salih

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

Machine Learning · Computer Science 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

Singular value decomposition (SVD) has a crucial role in model order reduction. It is often utilized in the offline stage to compute basis functions that project the high-dimensional nonlinear problem into a low-dimensionsl model which is,…

Numerical Analysis · Mathematics 2016-11-09 Alessandro Alla , J. Nathan Kutz

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez