English
Related papers

Related papers: Consistent Explanations by Contrastive Learning

200 papers

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems. However, these deep models are perceived as "black box" methods considering the lack of understanding of their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Aditya Chattopadhyay , Anirban Sarkar , Prantik Howlader , Vineeth N Balasubramanian

We propose a technique for producing "visual explanations" for decisions from a large class of CNN-based models, making them more transparent. Our approach - Gradient-weighted Class Activation Mapping (Grad-CAM), uses the gradients of any…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Ramprasaath R. Selvaraju , Michael Cogswell , Abhishek Das , Ramakrishna Vedantam , Devi Parikh , Dhruv Batra

Explanation methods facilitate the development of models that learn meaningful concepts and avoid exploiting spurious correlations. We illustrate a previously unrecognized limitation of the popular neural network explanation method…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Rachel Lea Draelos , Lawrence Carin

We propose a technique for making Convolutional Neural Network (CNN)-based models more transparent by visualizing input regions that are 'important' for predictions -- or visual explanations. Our approach, called Gradient-weighted Class…

Gradient-weighted Class Activation Mapping (Grad- CAM), is an example-based explanation method that provides a gradient activation heat map as an explanation for Convolution Neural Network (CNN) models. The drawback of this method is that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Tanmay Chakraborty , Utkarsh Trehan , Khawla Mallat , Jean-Luc Dugelay

Graph Contrastive Learning (GCL) establishes a new paradigm for learning graph representations without human annotations. Although remarkable progress has been witnessed recently, the success behind GCL is still left somewhat mysterious. In…

Machine Learning · Computer Science 2021-10-27 Yanqiao Zhu , Yichen Xu , Qiang Liu , Shu Wu

Significant progress has been achieved on the improvement and downstream usages of the Contrastive Language-Image Pre-training (CLIP) vision-language model, while less attention is paid to the interpretation of CLIP. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Chenyang Zhao , Kun Wang , Janet H. Hsiao , Antoni B. Chan

Class Activation Mapping (CAM) methods are widely used to generate visual explanations for deep learning classifiers in medical imaging. However, existing evaluation frameworks assess whether explanations are correct, measured by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Kabilan Elangovan , Daniel Ting

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Graph neural network (GNN) explanations have largely been facilitated through post-hoc introspection. While this has been deemed successful, many post-hoc explanation methods have been shown to fail in capturing a model's learned…

Machine Learning · Computer Science 2021-06-28 Donald Loveland , Shusen Liu , Bhavya Kailkhura , Anna Hiszpanski , Yong Han

Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions. In this paper, we develop a novel post-hoc visual explanation method called…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Haofan Wang , Zifan Wang , Mengnan Du , Fan Yang , Zijian Zhang , Sirui Ding , Piotr Mardziel , Xia Hu

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Visualizing the features captured by Convolutional Neural Networks (CNNs) is one of the conventional approaches to interpret the predictions made by these models in numerous image recognition applications. Grad-CAM is a popular solution…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Sam Sattarzadeh , Mahesh Sudhakar , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

The Grad-CAM algorithm provides a way to identify what parts of an image contribute most to the output of a classifier deep network. The algorithm is simple and widely used for localization of objects in an image, although some researchers…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Miguel Lerma , Mirtha Lucas

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Graph representation learning has emerged as a powerful technique for addressing real-world problems. Various downstream graph learning tasks have benefited from its recent developments, such as node classification, similarity search, and…

Machine Learning · Computer Science 2020-07-03 Jiezhong Qiu , Qibin Chen , Yuxiao Dong , Jing Zhang , Hongxia Yang , Ming Ding , Kuansan Wang , Jie Tang

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

Dilated Convolution with Learnable Spacing (DCLS) is a recent advanced convolution method that allows enlarging the receptive fields (RF) without increasing the number of parameters, like the dilated convolution, yet without imposing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Rabih Chamas , Ismail Khalfaoui-Hassani , Timothee Masquelier
‹ Prev 1 2 3 10 Next ›