English
Related papers

Related papers: Batch-CAM: Introduction to better reasoning in con…

200 papers

Training Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. This slows down the training by requiring lower learning rates…

Machine Learning · Computer Science 2015-03-03 Sergey Ioffe , Christian Szegedy

Deep convolutional networks often append additive constant ("bias") terms to their convolution operations, enabling a richer repertoire of functional mappings. Biases are also used to facilitate training, by subtracting mean response over…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Sreyas Mohan , Zahra Kadkhodaie , Eero P. Simoncelli , Carlos Fernandez-Granda

The convolutional neural network (CNN) has become a powerful tool for various biomedical image analysis tasks, but there is a lack of visual explanation for the machinery of CNNs. In this paper, we present a novel algorithm,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Guannan Zhao , Bo Zhou , Kaiwen Wang , Rui Jiang , Min Xu

Weakly supervised learning has emerged as an appealing alternative to alleviate the need for large labeled datasets in semantic segmentation. Most current approaches exploit class activation maps (CAMs), which can be generated from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Gaurav Patel , Jose Dolz

Multitask learning is a popular approach to training high-performing neural networks with improved generalization. In this paper, we propose a background class to achieve improved generalization at a lower computation compared to multitask…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 H M Dipu Kabir

Class activation map (CAM) has been widely used to highlight image regions that contribute to class predictions. Despite its simplicity and computational efficiency, CAM often struggles to identify discriminative regions that distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Ziheng Zhang , Jianyang Gu , Arpita Chowdhury , Zheda Mai , David Carlyn , Tanya Berger-Wolf , Yu Su , Wei-Lun Chao

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Gradient-weighted Class Activation Mapping (Grad- CAM), is an example-based explanation method that provides a gradient activation heat map as an explanation for Convolution Neural Network (CNN) models. The drawback of this method is that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Tanmay Chakraborty , Utkarsh Trehan , Khawla Mallat , Jean-Luc Dugelay

Increasing demands for understanding the internal behavior of convolutional neural networks (CNNs) have led to remarkable improvements in explanation methods. Particularly, several class activation mapping (CAM) based methods, which…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hyungsik Jung , Youngrock Oh

Deep feedforward neural networks with piecewise linear activations are currently producing the state-of-the-art results in several public datasets. The combination of deep learning models and piecewise linear activation functions allows for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-03 Zhibin Liao , Gustavo Carneiro

Deep learning-based methods have become the de facto standard for industrial defect detection. However, their data-hungry nature and inherent "black-box" characteristics often lead to performance bottlenecks and limited trustworthiness in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hang-Cheng Dong , Guodong Liu , Dong Ye , Bingguo Liu

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

Batch Normalization (BN) is an important preprocessing step to many deep learning applications. Since it is a data-dependent process, for some homogeneous datasets it is a redundant or even a performance-degrading process. In this paper, we…

Machine Learning · Computer Science 2022-12-01 Wael Alsobhi , Tarik Alafif , Alaa Abdel-Hakim , Weiwei Zong

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

We consider a light-weight method which allows to improve the explainability of localized classification networks. The method considers (Grad)CAM maps during the training process by modification of the training loss and does not require…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Alfred Schöttl

Modern meta-learning approaches for image classification rely on increasingly deep networks to achieve state-of-the-art performance, making batch normalization an essential component of meta-learning pipelines. However, the hierarchical…

Machine Learning · Statistics 2020-07-14 John Bronskill , Jonathan Gordon , James Requeima , Sebastian Nowozin , Richard E. Turner

Modern deep learning models are over-parameterized, where different optima can result in widely varying generalization performance. The Sharpness-Aware Minimization (SAM) technique modifies the fundamental loss function that steers gradient…

Background: Deep learning models are typically trained using stochastic gradient descent or one of its variants. These methods update the weights using their gradient, estimated from a small fraction of the training data. It has been…

Machine Learning · Statistics 2018-01-03 Elad Hoffer , Itay Hubara , Daniel Soudry

Deep learning (DL) has gained popularity in recent years as an effective tool for classifying the current health and predicting the future of industrial equipment. However, most DL models have black-box components with an underlying…

Machine Learning · Computer Science 2023-08-22 Hao Lu , Austin M. Bray , Chao Hu , Andrew T. Zimmerman , Hongyi Xu

Understanding the decisions of deep learning (DL) models is essential for the acceptance of DL to risk-sensitive applications. Although methods, like class activation maps (CAMs), give a glimpse into the black box, they do miss some crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yanli Li , Tahereh Hassanzadeh , Denis P. Shamonin , Monique Reijnierse , Annette H. M. van der Helm-van Mil , Berend C. Stoel