English
Related papers

Related papers: P-TAME: Explain Any Image Classifier with Trained …

200 papers

Deep neural networks (DNN) are black box algorithms. They are trained using a gradient descent back propagation technique which trains weights in each layer for the sole goal of minimizing training error. Hence, the resulting weights cannot…

Machine Learning · Computer Science 2018-11-05 Daniel Goldfarb

Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Murat Kucukosmanoglu , Javier O. Garcia , Justin Brooks , Kanika Bansal

This paper describes an adaptation of the Local Interpretable Model-Agnostic Explanations (LIME) AI method to operate under a biometric verification setting. LIME was initially proposed for networks with the same output classes used for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Fernando Alonso-Fernandez , Kevin Hernandez-Diaz , Jose M. Buades , Prayag Tiwari , Josef Bigun

We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jon Donnelly , Alina Jade Barnett , Chaofan Chen

Deep neural networks (DNNs) have become ubiquitous thanks to their remarkable ability to model complex patterns across various domains such as computer vision, speech recognition, robotics, etc. While large DNN models are often more…

Machine Learning · Computer Science 2025-11-18 Omkar Shende , Gayathri Ananthanarayanan , Marcello Traiola

While deep neural network (DNN)-based perception models are useful for many applications, these models are black boxes and their outputs are not yet well understood. To confidently enable a real-world, decision-making system to utilize such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Sara Pohland , Claire Tomlin

Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has…

Machine Learning · Computer Science 2019-10-16 Juntang Zhuang , Nicha C. Dvornek , Xiaoxiao Li , Junlin Yang , James S. Duncan

The lack of transparency of Deep Neural Networks continues to be a limitation that severely undermines their reliability and usage in high-stakes applications. Promising approaches to overcome such limitations are Prototype-Based…

Machine Learning · Computer Science 2025-07-21 Jon Vadillo , Roberto Santana , Jose A. Lozano , Marta Kwiatkowska

Deep neural networks (DNNs) have recently been applied and used in many advanced and diverse tasks, such as medical diagnosis, automatic driving, etc. Due to the lack of transparency of the deep models, DNNs are often criticized for their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Qing Yang , Xia Zhu , Jong-Kae Fwu , Yun Ye , Ganmei You , Yuan Zhu

Image blur and image noise are common distortions during image acquisition. In this paper, we systematically study the effect of image distortions on the deep neural network (DNN) image classifiers. First, we examine the DNN classifier…

Computer Vision and Pattern Recognition · Computer Science 2017-01-10 Yiren Zhou , Sibo Song , Ngai-Man Cheung

Deep learning models have achieved promising results in breast cancer classification, yet their 'black-box' nature raises interpretability concerns. This research addresses the crucial need to gain insights into the decision-making process…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ann-Kristin Balve , Peter Hendrix

In recent years, artificial intelligence (AI) systems have come to the forefront. These systems, mostly based on Deep learning (DL), achieve excellent results in areas such as image processing, natural language processing, or speech…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Frantisek Sefcik , Wanda Benesova

Graph neural networks (GNNs) are powerful tools for conducting inference on graph data but are often seen as "black boxes" due to difficulty in extracting meaningful subnetworks driving predictive performance. Many interpretable GNN methods…

Machine Learning · Statistics 2024-12-17 Whitney Sloneker , Shalin Patel , Michael Wang , Lorin Crawford , Ritambhara Singh

In Autonomous Driving (AD) transparency and safety are paramount, as mistakes are costly. However, neural networks used in AD systems are generally considered black boxes. As a countermeasure, we have methods of explainable AI (XAI), such…

Machine Learning · Computer Science 2024-04-29 Mohamed Roshdi , Julian Petzold , Mostafa Wahby , Hussein Ebrahim , Mladen Berekovic , Heiko Hamann

Deep learning models are used in critical applications, in which mistakes can have serious consequences. Therefore, it is crucial to understand how and why models generate predictions. This understanding provides useful information to check…

While deep feature learning has revolutionized techniques for static-image understanding, the same does not quite hold for video processing. Architectures and optimization techniques used for video are largely based off those for static…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Achal Dave , Olga Russakovsky , Deva Ramanan

While deep learning has been successfully applied to the data-driven classification of anomalous diffusion mechanisms, how the algorithm achieves the feat still remains a mystery. In this study, we use a well-known technique aimed at…

Machine Learning · Computer Science 2024-10-23 Jaeyong Bae , Yongjoo Baek , Hawoong Jeong

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

A variety of methods have been proposed to try to explain how deep neural networks make their decisions. Key to those approaches is the need to sample the pixel space efficiently in order to derive importance maps. However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Thomas Fel , Melanie Ducoffe , David Vigouroux , Remi Cadene , Mikael Capelle , Claire Nicodeme , Thomas Serre

Medical image classification is crucial for supporting healthcare professionals in decision-making and training. While Convolutional Neural Networks (CNNs) have traditionally dominated this field, Transformer-based models are gaining…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 S. Park , J. Kim