English
Related papers

Related papers: Quantized and Interpretable Learning Scheme for De…

200 papers

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Alexandre Englebert , Olivier Cornu , Christophe De Vleeschouwer

Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and…

Materials Science · Physics 2021-05-26 Keith T. Butler , Manh Duc Le , Jeyarajan Thiyagalingam , Toby G. Perring

Efficient inference is critical for deploying deep learning models on edge AI devices. Low-bit quantization (e.g., 3- and 4-bit) with fixed-point arithmetic improves efficiency, while low-power memory technologies like analog nonvolatile…

Machine Learning · Computer Science 2025-07-15 Anmol Biswas , Raghav Singhal , Sivakumar Elangovan , Shreyas Sabnis , Udayan Ganguly

Quantization techniques applied to the inference of deep neural networks have enabled fast and efficient execution on resource-constraint devices. The success of quantization during inference has motivated the academic community to explore…

Machine Learning · Computer Science 2021-05-11 Marios Fournarakis , Markus Nagel

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

Graph neural networks (GNNs) have demonstrated strong performance on a wide variety of tasks due to their ability to model non-uniform structured data. Despite their promise, there exists little research exploring methods to make them more…

Machine Learning · Computer Science 2021-03-16 Shyam A. Tailor , Javier Fernandez-Marques , Nicholas D. Lane

Prior works have shown that neural networks can be heavily pruned while preserving performance, but the impact of pruning on model interpretability remains unclear. In this work, we investigate how magnitude-based pruning followed by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanish Suwal , Dipkamal Bhusal , Michael Clifford , Nidhi Rastogi

Deep learning interpretation is essential to explain the reasoning behind model predictions. Understanding the robustness of interpretation methods is important especially in sensitive domains such as medical applications since…

Machine Learning · Computer Science 2019-10-21 Alexander Levine , Sahil Singla , Soheil Feizi

Weight quantization is used to deploy high-performance deep learning models on resource-limited hardware, enabling the use of low-precision integers for storage and computation. Spiking neural networks (SNNs) share the goal of enhancing…

Neural and Evolutionary Computing · Computer Science 2024-05-01 Sreyes Venkatesh , Razvan Marinescu , Jason K. Eshraghian

It is known that deep neural networks (DNNs) classify an input image by paying particular attention to certain specific pixels; a graphical representation of the magnitude of attention to each pixel is called a saliency-map. Saliency-maps…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Satoshi Munakata , Caterina Urban , Haruki Yokoyama , Koji Yamamoto , Kazuki Munakata

Existing weakly supervised semantic segmentation (WSSS) methods usually utilize the results of pre-trained saliency detection (SD) models without explicitly modeling the connections between the two tasks, which is not the most efficient…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Yu Zeng , Yunzhi Zhuge , Huchuan Lu , Lihe Zhang

Deep neural networks have been proven to be highly effective tools in various domains, yet their computational and memory costs restrict them from being widely deployed on portable devices. The recent rapid increase of edge computing…

Neural and Evolutionary Computing · Computer Science 2023-06-01 Ayan Shymyrbay , Mohammed E. Fouda , Ahmed Eltawil

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

Machine Learning · Computer Science 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Quantized deep neural networks (QDNNs) are necessary for low-power, high throughput, and embedded applications. Previous studies mostly focused on developing optimization methods for the quantization of given models. However, quantization…

Machine Learning · Computer Science 2020-06-02 Yoonho Boo , Sungho Shin , Wonyong Sung

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

Reasoning models excel at complex tasks such as coding and mathematics, yet their inference is often slow and token-inefficient. To improve the inference efficiency, post-training quantization (PTQ) usually comes with the cost of large…

Machine Learning · Computer Science 2026-01-22 Keyu Lv , Manyi Zhang , Xiaobo Xia , Jingchen Ni , Shannan Yan , Xianzhi Yu , Lu Hou , Chun Yuan , Haoli Bai

Convolutional Neural Networks (CNNs) compression is crucial to deploying these models in edge devices with limited resources. Existing channel pruning algorithms for CNNs have achieved plenty of success on complex models. They approach the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Alireza Ganjdanesh , Shangqian Gao , Heng Huang

Deep learning algorithms lack human-interpretable accounts of how they transform raw visual input into a robust semantic understanding, which impedes comparisons between different architectures, training objectives, and the human brain. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Gustaw Opiełka , Jessica Loke , Steven Scholte