English
Related papers

Related papers: Quantized and Interpretable Learning Scheme for De…

200 papers

We introduce a method to train Quantized Neural Networks (QNNs) --- neural networks with extremely low precision (e.g., 1-bit) weights and activations, at run-time. At train-time the quantized weights and activations are used for computing…

Neural and Evolutionary Computing · Computer Science 2016-09-23 Itay Hubara , Matthieu Courbariaux , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Although considerable progress has been obtained in neural network quantization for efficient inference, existing methods are not scalable to heterogeneous devices as one dedicated model needs to be trained, transmitted, and stored for one…

Machine Learning · Computer Science 2022-12-13 Hai Wu , Ruifei He , Haoru Tan , Xiaojuan Qi , Kaibin Huang

Deep neural networks have achieved strong performance in genomic sequence classification; however, relating their predictions to biologically meaningful sequence patterns remains challenging. In this work, we present AttnGen, an…

Machine Learning · Computer Science 2026-05-15 Rayhaneh Shabani Nia , Ali Karkehabadi

Deep learning techniques have been successfully deployed for automating plant stress identification and quantification. In recent years, there is a growing push towards training models that are interpretable -i.e. that justify their…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Koushik Nagasubramanian , Asheesh K. Singh , Arti Singh , Soumik Sarkar , Baskar Ganapathysubramanian

The human visual system employs a selective attention mechanism to understand the visual world in an eficient manner. In this paper, we show how computational models of this mechanism can be exploited for the computer vision application of…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Samuel F. Dodge , Lina J. Karam

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

The deployment of deep neural networks on resource-constrained devices necessitates effective model com- pression strategies that judiciously balance the reduction of model size with the preservation of performance. This study introduces a…

Machine Learning · Computer Science 2025-05-02 Mohammad Zbeeb , Mariam Salman , Mohammad Bazzi , Ammar Mohanna

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Quantization-aware training (QAT) is a representative model compression method to reduce redundancy in weights and activations. However, most existing QAT methods require end-to-end training on the entire dataset, which suffers from long…

Machine Learning · Computer Science 2024-08-21 Xijie Huang , Zechun Liu , Shih-Yang Liu , Kwang-Ting Cheng

Visual saliency prediction using transformers - Convolutional neural networks (CNNs) have significantly advanced computational modelling for saliency prediction. However, accurately simulating the mechanisms of visual attention in the human…

Multimedia · Computer Science 2022-06-30 Jianxun Lou , Hanhe Lin , David Marshall , Dietmar Saupe , Hantao Liu

Deep Neural Networks are powerful tools for understanding complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. Saliency-Guided Training (SGT) methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

Deep neural networks deployed in safety-critical, resource-constrained environments must balance efficiency and robustness. Existing methods treat compression and certified robustness as separate goals, compromising either efficiency or…

Machine Learning · Computer Science 2025-06-16 Changming Xu , Gagandeep Singh

Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Zhenlin Xu , Marc Niethammer

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

Deep learning opacity often impedes deployment in high-stakes domains. We propose a training framework that aligns model focus with class-representative features without requiring pixel-level annotations. To this end, we introduce…

Artificial Intelligence · Computer Science 2026-02-16 Giacomo Ignesti , Davide Moroni , Massimo Martinelli

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan , Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana