English
Related papers

Related papers: This Looks Like That, Because ... Explaining Proto…

200 papers

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Existing interpretation algorithms have found that, even deep models make the same and right predictions on the same image, they might rely on different sets of input features for classification. However, among these sets of features, some…

Machine Learning · Computer Science 2021-09-03 Xuhong Li , Haoyi Xiong , Siyu Huang , Shilei Ji , Dejing Dou

How interpretable are the features of leading vision models? The question is increasingly pressing as these models move from research benchmarks into high-stakes deployments, yet existing methods cannot answer it reliably. We close this gap…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Julien Colin , Lore Goetschalckx , Nuria Oliver , Thomas Serre

Explaining predictions of black-box neural networks is crucial when applied to decision-critical tasks. Thus, attribution maps are commonly used to identify important image regions, despite prior work showing that humans prefer explanations…

Machine Learning · Computer Science 2023-12-20 Tom Nuno Wolf , Fabian Bongratz , Anne-Marie Rickmann , Sebastian Pölsterl , Christian Wachinger

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Human perception is routinely assessing the similarity between images, both for decision making and creative thinking. But the underlying cognitive process is not really well understood yet, hence difficult to be mimicked by computer vision…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Olivier Risser-Maroix , Amine Marzouki , Hala Djeghim , Camille Kurtz , Nicolas Lomenie

Recognising and locating image patches or sets of image features is an important task underlying much work in computer vision. Traditionally this has been accomplished using template matching. However, template matching is notoriously…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 M. W. Spratling

While deep neural networks are extremely effective at classifying images, they remain opaque and hard to interpret. We introduce local and global explanation methods for black-box models that generate explanations in terms of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Bhavan Vasu , Giuseppe Raffa , Prasad Tadepalli

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

In spite of several claims stating that some models are more interpretable than others -- e.g., "linear models are more interpretable than deep neural networks" -- we still lack a principled notion of interpretability to formally compare…

Artificial Intelligence · Computer Science 2020-11-16 Pablo Barceló , Mikaël Monet , Jorge Pérez , Bernardo Subercaseaux

Prototype-based methods are of the particular interest for domain specialists and practitioners as they summarize a dataset by a small set of representatives. Therefore, in a classification setting, interpretability of the prototypes is as…

Machine Learning · Computer Science 2019-11-12 Babak Hosseini , Barbara Hammer

Due to the high inter-class similarity caused by the complex composition and the co-existing objects across scenes, numerous studies have explored object semantic knowledge within scenes to improve scene recognition. However, a resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Chuanxin Song , Hanbo Wu , Xin Ma , Yibin Li

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

As AI systems grow more capable, it becomes increasingly important that their decisions remain understandable and aligned with human expectations. A key challenge is the limited interpretability of deep models. Post-hoc methods like GradCAM…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mahdi Alehdaghi , Rajarshi Bhattacharya , Pourya Shamsolmoali , Rafael M. O. Cruz , Maguelonne Heritier , Eric Granger

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

Prototypical Learning is based on the idea that there is a point (which we call prototype) around which the embeddings of a class are clustered. It has shown promising results in scenarios with little labeled data or to design explainable…

Machine Learning · Computer Science 2024-06-25 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon , Luis Vicente , Antonio Miguel , Eduardo Lleida

Due to the sensitive nature of medicine, it is particularly important and highly demanded that AI methods are explainable. This need has been recognised and there is great research interest in xAI solutions with medical applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Luisa Gallée , Catharina Silvia Lisson , Christoph Gerhard Lisson , Daniela Drees , Felix Weig , Daniel Vogele , Meinrad Beer , Michael Götz

Despite significant advances in machine learning, decision-making of artificial agents is still not perfect and often requires post-hoc human interventions. If the prediction of a model relies on unreasonable factors it is desirable to…

Machine Learning · Computer Science 2023-10-10 Michael Gerstenberger , Sebastian Lapuschkin , Peter Eisert , Sebastian Bosse

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we adapt the mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mikołaj Sacha , Dawid Rymarczyk , Łukasz Struski , Jacek Tabor , Bartosz Zieliński

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

Machine Learning · Computer Science 2023-07-25 Patrik Hammersborg , Inga Strümke