English
Related papers

Related papers: Quantized and Interpretable Learning Scheme for De…

200 papers

Interpretation and improvement of deep neural networks relies on better understanding of their underlying mechanisms. In particular, gradients of classes or concepts with respect to the input features (e.g., pixels in images) are often used…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lennart Brocki , Neo Christopher Chung

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Semantic segmentation is a challenging task in the absence of densely labelled data. Only relying on class activation maps (CAM) with image-level labels provides deficient segmentation supervision. Prior works thus consider pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Lian Xu , Wanli Ouyang , Mohammed Bennamoun , Farid Boussaid , Ferdous Sohel , Dan Xu

Quantization is a technique for reducing deep neural networks (DNNs) training and inference times, which is crucial for training in resource constrained environments or applications where inference is time critical. State-of-the-art (SOTA)…

Machine Learning · Computer Science 2023-05-24 Lorenz Kummer , Kevin Sidak , Tabea Reichmann , Wilfried Gansterer

Neural network quantization enables the deployment of large models on resource-constrained devices. Current post-training quantization methods fall short in terms of accuracy for INT4 (or lower) but provide reasonable accuracy for INT8 (or…

Machine Learning · Computer Science 2020-03-17 Yury Nahshan , Brian Chmiel , Chaim Baskin , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

A popular track of network compression approach is Quantization aware Training (QAT), which accelerates the forward pass during the neural network training and inference. However, not much prior efforts have been made to quantize and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Kaixin Xu , Alina Hui Xiu Lee , Ziyuan Zhao , Zhe Wang , Min Wu , Weisi Lin

Learning convolutional neural networks (CNNs) with low bitwidth is challenging because performance may drop significantly after quantization. Prior arts often discretize the network weights by carefully tuning hyper-parameters of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chaofan Tao , Rui Lin , Quan Chen , Zhaoyang Zhang , Ping Luo , Ngai Wong

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Video classification is productive in many practical applications, and the recent deep learning has greatly improved its accuracy. However, existing works often model video frames indiscriminately, but from the view of motion, video frames…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunzhen Zhao , Yuxin Peng

This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Despite the success of CNN models on a variety of Image classification and segmentation tasks, their extensive computational and storage demands pose considerable challenges for real-world deployment on resource-constrained devices.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Ahmed Luqman , Khuzemah Qazi , Murray Patterson , Malik Jahan Khan , Imdadullah Khan

In this paper, we propose an efficient saliency map generation method, called Group score-weighted Class Activation Mapping (Group-CAM), which adopts the "split-transform-merge" strategy to generate saliency maps. Specifically, for an input…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Qinglong Zhang , Lu Rao , Yubin Yang

Machine learning models have shown increased accuracy in classification tasks when the training process incorporates human perceptual information. However, a challenge in training human-guided models is the cost associated with collecting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Colton R. Crum , Aidan Boyd , Kevin Bowyer , Adam Czajka

Gradient-based saliency maps have been widely used to explain the decisions of deep neural network classifiers. However, standard gradient-based interpretation maps, including the simple gradient and integrated gradient algorithms, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Shizhan Gong , Qi Dou , Farzan Farnia

Class Activation Mapping (CAM) has been widely adopted to generate saliency maps which provides visual explanations for deep neural networks (DNNs). The saliency maps are conventionally generated by fusing the channels of the target feature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Guangwu Qian , Zhen-Qun Yang , Xu-Lu Zhang , Yaowei Wang , Qing Li , Xiao-Yong Wei

Segmentation using deep learning has shown promising directions in medical imaging as it aids in the analysis and diagnosis of diseases. Nevertheless, a main drawback of deep models is that they require a large amount of pixel-level labels,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Sukesh Adiga , Jose Dolz , Herve Lombaert

We propose a novel value-aware quantization which applies aggressively reduced precision to the majority of data while separately handling a small amount of large data in high precision, which reduces total quantization errors under very…

Neural and Evolutionary Computing · Computer Science 2018-04-24 Eunhyeok Park , Sungjoo Yoo , Peter Vajda

This paper presents an approach for top-down saliency detection guided by visual classification tasks. We first learn how to compute visual saliency when a specific visual task has to be accomplished, as opposed to most state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Francesca Murabito , Concetto Spampinato , Simone Palazzo , Konstantin Pogorelov , Michael Riegler

The high cost of pixel-level annotations makes it appealing to train saliency detection models with weak supervision. However, a single weak supervision source usually does not contain enough information to train a well-performing model. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yu Zeng , Yunzhi Zhuge , Huchuan Lu , Lihe Zhang , Mingyang Qian , Yizhou Yu

Deep neural networks have been proven effective in a wide range of tasks. However, their high computational and memory costs make them impractical to deploy on resource-constrained devices. To address this issue, quantization schemes have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jie Hu , Mengze Zeng , Enhua Wu