English
Related papers

Related papers: Local-to-Global Logical Explanations for Deep Visi…

200 papers

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

Deep neural networks have demonstrated remarkable performance in many data-driven and prediction-oriented applications, and sometimes even perform better than humans. However, their most significant drawback is the lack of interpretability,…

Machine Learning · Computer Science 2023-02-22 Jiahui Li , Kun Kuang , Lin Li , Long Chen , Songyang Zhang , Jian Shao , Jun Xiao

In this work, we propose CLass-Enhanced Attentive Response (CLEAR): an approach to visualize and understand the decisions made by deep neural networks (DNNs) given a specific input. CLEAR facilitates the visualization of attentive regions…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Devinder Kumar , Alexander Wong , Graham W. Taylor

In-context learning (ICL) enables multimodal large language models (MLLMs) to classify images from a few labelled examples. Yet, how these models use the provided context remains opaque. While Chain-of-Thought prompting is widely used,…

Artificial Intelligence · Computer Science 2026-05-28 Carmen Quiles-Ramírez , Leticia L. Rodríguez , Nicolás Martorell , Natalia Díaz-Rodríguez

The decision-making process of many state-of-the-art machine learning models is inherently inscrutable to the extent that it is impossible for a human to interpret the model directly: they are black box models. This has led to a call for…

Information Retrieval · Computer Science 2019-07-09 Ilse van der Linden , Hinda Haned , Evangelos Kanoulas

We introduce Discovering Conceptual Network Explanations (DCNE), a new approach for generating human-comprehensible visual explanations to enhance the interpretability of deep neural image classifiers. Our method automatically finds visual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Neehar Kondapaneni , Markus Marks , Oisin Mac Aodha , Pietro Perona

Deep neural networks learn fragile "shortcut" features, rendering them difficult to interpret (black box) and vulnerable to adversarial attacks. This paper proposes semantic features as a general architectural solution to this problem. The…

Machine Learning · Computer Science 2024-04-18 Maciej Satkiewicz

Graph Neural Networks (GNNs) achieve state-of-the-art performance in various graph-related tasks. However, the black-box nature often limits their interpretability and trustworthiness. Numerous explainability methods have been proposed to…

Machine Learning · Computer Science 2023-11-13 Jialin Chen , Kenza Amara , Junchi Yu , Rex Ying

Explaining the decisions of models is becoming pervasive in the image processing domain, whether it is by using post-hoc methods or by creating inherently interpretable models. While the widespread use of surrogate explainers is a welcome…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Alexander Hepburn , Raul Santos-Rodriguez

Deep reinforcement learning (DRL), through learning policies or values represented by neural networks, has successfully addressed many complex control problems. However, the neural networks introduced by DRL lack interpretability and…

Machine Learning · Computer Science 2025-02-04 Zeyu Jiang , Hai Huang , Xingquan Zuo

Deep visual models are susceptible to adversarial perturbations to inputs. Although these signals are carefully crafted, they still appear noise-like patterns to humans. This observation has led to the argument that deep visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Naveed Akhtar , Muhammad A. A. K. Jalwana , Mohammed Bennamoun , Ajmal Mian

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Artificial intelligence, particularly through recent advancements in deep learning, has achieved exceptional performances in many tasks in fields such as natural language processing and computer vision. In addition to desirable evaluation…

Machine Learning · Computer Science 2024-03-04 Sean Xie , Soroush Vosoughi , Saeed Hassanpour

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Interpretability techniques aim to provide the rationale behind a model's decision, typically by explaining either an individual prediction (local explanation, e.g. 'why is this patient diagnosed with this condition') or a class of…

We describe a computational model of humans' ability to provide a detailed interpretation of components in a scene. Humans can identify in an image meaningful components almost everywhere, and identifying these components is an essential…

Artificial Intelligence · Computer Science 2021-10-19 Guy Ben-Yosef , Liav Assif , Daniel Harari , Shimon Ullman

We present a method for visualising the response of a deep neural network to a specific input. For image data for instance our method will highlight areas that provide evidence in favor of, and against choosing a certain class. The method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Luisa M. Zintgraf , Taco S. Cohen , Max Welling

Representations in the hidden layers of Deep Neural Networks (DNN) are often hard to interpret since it is difficult to project them into an interpretable domain. Graph Convolutional Networks (GCN) allow this projection, but existing…

Computation and Language · Computer Science 2019-09-25 Robert Schwarzenberg , Marc Hübner , David Harbecke , Christoph Alt , Leonhard Hennig

Despite the huge success of deep convolutional neural networks in face recognition (FR) tasks, current methods lack explainability for their predictions because of their "black-box" nature. In recent years, studies have been carried out to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zewei Xu , Yuhang Lu , Touradj Ebrahimi