English
Related papers

Related papers: SIC: Similarity-Based Interpretable Image Classifi…

200 papers

The task of remote sensing image scene classification (RSISC), which aims at classifying remote sensing images into groups of semantic categories based on their contents, has taken the important role in a wide range of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Lam Pham , Khoa Tran , Dat Ngo , Jasmin Lampert , Alexander Schindler

To tackle increasingly complex tasks, it has become an essential ability of neural networks to learn abstract representations. These task-specific representations and, particularly, the invariances they capture turn neural networks into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Robin Rombach , Patrick Esser , Björn Ommer

We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jon Donnelly , Alina Jade Barnett , Chaofan Chen

Attention mechanisms form a core component of several successful deep learning architectures, and are based on one key idea: ''The output depends only on a small (but unknown) segment of the input.'' In several practical applications like…

Machine Learning · Computer Science 2023-05-16 Lakshmi Narayan Pandey , Rahul Vashisht , Harish G. Ramaswamy

The diagnosis of oral diseases presents a problematic clinical challenge, characterized by a wide spectrum of pathologies with overlapping symptomatology. To address this, we developed Clinical Semantic Intelligence (CSI), a novel…

Artificial Intelligence · Computer Science 2025-07-22 Mohammad Mashayekhi , Sara Ahmadi Majd , Arian AmirAmjadi , Parsa Hosseini

As vision-language models are deployed at scale, understanding their internal mechanisms becomes increasingly critical. Existing interpretability methods predominantly rely on activations, making them dataset-dependent, vulnerable to data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Francesco Gentile , Nicola Dall'Asen , Francesco Tonini , Massimiliano Mancini , Lorenzo Vaquero , Elisa Ricci

Effectively explaining decisions of black-box machine learning models is critical to responsible deployment of AI systems that rely on them. Recognizing their importance, the field of explainable AI (XAI) provides several techniques to…

Artificial Intelligence · Computer Science 2025-07-25 Yao Rong , Peizhu Qian , Vaibhav Unhelkar , Enkelejda Kasneci

Convolutional neural networks (CNNs) are widely used for high-stakes applications like medicine, often surpassing human performance. However, most explanation methods rely on post-hoc attribution, approximating the decision-making process…

Machine Learning · Computer Science 2026-02-23 Kerol Djoumessi , Philipp Berens

The opportunity to utilize complex functional data types for conducting classification tasks is emerging with the growing availability of imaging data. However, the tools capable of effectively managing imaging data are limited, let alone…

Methodology · Statistics 2025-07-22 Shuoyang Wang , Guanqun Cao , Yuan Huang

Most classification models treat different object classes in parallel and the misclassifications between any two classes are treated equally. In contrast, human beings can exploit high-level information in making a prediction of an unknown…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Kaidong Li , Nina Y. Wang , Yiju Yang , Guanghui Wang

How do two deep neural networks differ in how they arrive at a decision? Measuring the similarity of deep networks has been a long-standing open question. Most existing methods provide a single number to measure the similarity of two…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Neehar Kondapaneni , Oisin Mac Aodha , Pietro Perona

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Changqi Sun , Hao Xu , Yuntian Chen , Dongxiao Zhang

Combining neural networks with continuous logic and multicriteria decision making tools can reduce the black box nature of neural models. In this study, we show that nilpotent logical systems offer an appropriate mathematical framework for…

Artificial Intelligence · Computer Science 2020-05-01 Orsolya Csiszár , Gábor Csiszár , József Dombi

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

Composed Image Retrieval (CIR), which aims to find a target image from a reference image and a modification text, presents the core challenge of performing unified reasoning across visual and semantic modalities. While current approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Weihuang Lin , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

The growing reproducibility crisis in machine learning has brought forward a need for careful examination of research findings. This paper investigates the claims made by Lei et al. (2023) regarding their proposed method, LICO, for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Luan Fletcher , Robert van der Klis , Martin Sedláček , Stefan Vasilev , Christos Athanasiadis

Quantifying the causal influence of input features within neural networks has become a topic of increasing interest. Existing approaches typically assess direct, indirect, and total causal effects. This work treats NNs as structural causal…

Machine Learning · Statistics 2025-08-07 Saptarshi Saha , Dhruv Vansraj Rathore , Soumadeep Saha , Utpal Garain , David Doermann

Composed Image Retrieval (CIR) aims to retrieve a target image based on a query composed of a reference image, and a relative caption that specifies the desired modification. Despite the rapid development of CIR models, their performance is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yikun Liu , Jiangchao Yao , Weidi Xie , Yanfeng Wang

Since early machine learning models, metrics such as accuracy and precision have been the de facto way to evaluate and compare trained models. However, a single metric number doesn't fully capture the similarities and differences between…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ahmad Mustapha , Wael Khreich , Wes Masri

Machine learning solutions for pattern classification problems are nowadays widely deployed in society and industry. However, the lack of transparency and accountability of most accurate models often hinders their safe use. Thus, there is a…

Machine Learning · Computer Science 2021-12-24 Gonzalo Nápoles , Yamisleydi Salgueiro , Isel Grau , Maikel Leon Espinosa