English
Related papers

Related papers: Visualization of Supervised and Self-Supervised Ne…

200 papers

Saliency methods can aid understanding of deep neural networks. Recent years have witnessed many improvements to saliency methods, as well as new ways for evaluating them. In this paper, we 1) present a novel region-based attribution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Andrei Kapishnikov , Tolga Bolukbasi , Fernanda Viégas , Michael Terry

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

In deep learning, visualization techniques extract the salient patterns exploited by deep networks for image classification, focusing on single images; no effort has been spent in investigating whether these patterns are systematically…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Marco Carletti , Marco Godi , Maedeh Aghaei , Francesco Giuliari , Marco Cristani

This document summarizes different visual explanations methods such as CAM, Grad-CAM, Localization using Multiple Instance Learning - Saliency-based methods, Saliency-driven Class-Impressions, Muting pixels in input image - Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Dipesh Tamboli

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Michal Byra , Henrik Skibbe

For convolutional neural network models that optimize an image embedding, we propose a method to highlight the regions of images that contribute most to pairwise similarity. This work is a corollary to the visualization tools developed for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-04 Abby Stylianou , Richard Souvenir , Robert Pless

This article presents the prediction difference analysis method for visualizing the response of a deep neural network to a specific input. When classifying images, the method highlights areas in a given input image that provide evidence for…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Luisa M Zintgraf , Taco S Cohen , Tameem Adel , Max Welling

Image super-resolution (SR) techniques have been developing rapidly, benefiting from the invention of deep networks and its successive breakthroughs. However, it is acknowledged that deep learning and deep neural networks are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jinjin Gu , Chao Dong

Discriminative localization is essential for fine-grained image classification task, which devotes to recognizing hundreds of subcategories in the same basic-level category. Reflecting on discriminative regions of objects, key differences…

Computer Vision and Pattern Recognition · Computer Science 2017-12-01 Xiangteng He , Yuxin Peng , Junjie Zhao

Deep learning algorithms lack human-interpretable accounts of how they transform raw visual input into a robust semantic understanding, which impedes comparisons between different architectures, training objectives, and the human brain. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Gustaw Opiełka , Jessica Loke , Steven Scholte

Deep learning based salient object detection has recently achieved great success with its performance greatly outperforms any other unsupervised methods. However, annotating per-pixel saliency masks is a tedious and inefficient procedure.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Guanbin Li , Yuan Xie , Liang Lin

We study the problem of large scale, multi-label visual recognition with a large number of possible classes. We propose a method for augmenting a trained neural network classifier with auxiliary capacity in a manner designed to…

Machine Learning · Statistics 2015-04-15 David Warde-Farley , Andrew Rabinovich , Dragomir Anguelov

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Self-supervised representation learning targets to learn convnet-based image representations from unlabeled data. Inspired by the success of NLP methods in this area, in this work we propose a self-supervised approach based on spatially…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Spyros Gidaris , Andrei Bursuc , Nikos Komodakis , Patrick Pérez , Matthieu Cord

We present a method for visualising the response of a deep neural network to a specific input. For image data for instance our method will highlight areas that provide evidence in favor of, and against choosing a certain class. The method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Luisa M. Zintgraf , Taco S. Cohen , Max Welling

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo