English
Related papers

Related papers: Causal Explanations of Image Misclassifications

200 papers

We develop a method for generating causal post-hoc explanations of black-box classifiers based on a learned low-dimensional representation of the data. The explanation is causal in the sense that changing learned latent factors produces a…

Machine Learning · Computer Science 2020-10-23 Matthew O'Shaughnessy , Gregory Canal , Marissa Connor , Mark Davenport , Christopher Rozell

The confusion matrix is a standard tool for evaluating classifiers by providing insights into class-level errors. In heterogeneous settings, its values are shaped by two main factors: class similarity -- how easily the model confuses two…

Machine Learning · Computer Science 2026-03-31 Johan Erbani , Pierre-Edouard Portier , Elod Egyed-Zsigmond , Sonia Ben Mokhtar , Diana Nurbakova

Convolutional Neural Networks (CNNs) currently achieve state-of-the-art accuracy in image classification. With a growing number of classes, the accuracy usually drops as the possibilities of confusion increase. Interestingly, the class…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Bilal Alsallakh , Amin Jourabloo , Mao Ye , Xiaoming Liu , Liu Ren

Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category. These insights help radiologists to visualize deformities in medical imaging. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Shakeeb Murtaza

Purpose: A major barrier to the implementation of artificial intelligence for medical applications is the lack of explainability and high confidence for incorrect decisions, specifically with out-of-domain samples. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Mikyla K. Bowen , Jesse W. Wilson

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN…

Machine Learning · Computer Science 2022-12-20 Tianxiang Zhao , Dongsheng Luo , Xiang Zhang , Suhang Wang

Convolutional Neural Networks (CNNs) serve as the workhorse of deep learning, finding applications in various fields that rely on images. Given sufficient data, they exhibit the capacity to learn a wide range of concepts across diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Saorj Kumar , Prince Asiamah , Oluwatoyin Jolaoso , Ugochukwu Esiowu

The adoption of Deep Neural Networks (DNNs) in critical fields where predictions need to be accompanied by justifications is hindered by their inherent black-box nature. In this paper, we introduce P-TAME (Perturbation-based Trainable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Mariano V. Ntrougkas , Vasileios Mezaris , Ioannis Patras

Explaining the prediction of deep neural networks (DNNs) and semantic image compression are two active research areas of deep learning with a numerous of applications in decision-critical systems, such as surveillance cameras, drones and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Xiang Li , Shihao Ji

Confounders in deep learning are in general detrimental to model's generalization where they infiltrate feature representations. Therefore, learning causal features that are free of interference from confounders is important. Most previous…

Machine Learning · Computer Science 2022-10-11 Xin Li , Zhizheng Zhang , Guoqiang Wei , Cuiling Lan , Wenjun Zeng , Xin Jin , Zhibo Chen

Typical neural network trainings have substantial variance in test-set performance between repeated runs, impeding hyperparameter comparison and training reproducibility. In this work we present the following results towards understanding…

Machine Learning · Computer Science 2024-06-11 Keller Jordan

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN…

Machine Learning · Computer Science 2023-09-06 Tianxiang Zhao , Dongsheng Luo , Xiang Zhang , Suhang Wang

Deep Convolutional Neural Networks (CNNs) have been successfully used in many low-level vision problems like image denoising. Although the conditional image generation techniques have led to large improvements in this task, there has been…

Image and Video Processing · Electrical Eng. & Systems 2020-03-10 Ioannis Marras , Grigorios G. Chrysos , Ioannis Alexiou , Gregory Slabaugh , Stefanos Zafeiriou

Few-shot image classification is challenging due to the lack of ample samples in each class. Such a challenge becomes even tougher when the number of classes is very large, i.e., the large-class few-shot scenario. In this novel scenario,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Bingcong Li , Bo Han , Zhuowei Wang , Jing Jiang , Guodong Long

In the realm of image processing and computer vision (CV), machine learning (ML) architectures are widely applied. Convolutional neural networks (CNNs) solve a wide range of image processing issues and can solve image compression problem.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Sonain Jamil , Md. Jalil Piran , MuhibUrRahman

What makes images similar? To measure the similarity between images, they are typically embedded in a feature-vector space, in which their distance preserve the relative dissimilarity. However, when learning such similarity embeddings the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Andreas Veit , Serge Belongie , Theofanis Karaletsos

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Mateusz Buda , Atsuto Maki , Maciej A. Mazurowski

Neural networks have proven effective at solving difficult problems but designing their architectures can be challenging, even for image classification problems alone. Our goal is to minimize human participation, so we employ evolutionary…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Esteban Real , Sherry Moore , Andrew Selle , Saurabh Saxena , Yutaka Leon Suematsu , Jie Tan , Quoc Le , Alex Kurakin

We present a causal inference framework to improve Weakly-Supervised Semantic Segmentation (WSSS). Specifically, we aim to generate better pixel-level pseudo-masks by using only image-level labels -- the most crucial step in WSSS. We…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Dong Zhang , Hanwang Zhang , Jinhui Tang , Xiansheng Hua , Qianru Sun