English
Related papers

Related papers: Improving Accuracy of Binary Neural Networks using…

200 papers

Supervised classification is the most active and emerging research trends in today's scenario. In this view, Artificial Neural Network (ANN) techniques have been widely employed and growing interest to the researchers day by day. ANN…

Machine Learning · Computer Science 2019-05-16 Arijit Nandi , Nanda Dulal Jana

This paper describes a CNN where all CNN style 2D convolution operations that lower to matrix matrix multiplication are fully binary. The network is derived from a common building block structure that is consistent with a constructive proof…

Machine Learning · Computer Science 2021-03-08 Arthur J. Redfern , Lijun Zhu , Molly K. Newquist

Binary Neural Networks (BNNs), known to be one among the effectively compact network architectures, have achieved great outcomes in the visual tasks. Designing efficient binary architectures is not trivial due to the binary nature of the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Hai Phan , Zechun Liu , Dang Huynh , Marios Savvides , Kwang-Ting Cheng , Zhiqiang Shen

The ATLAS experiment at the Large Hadron Collider explores the use of modern neural networks for a multi-dimensional calibration of its calorimeter signal defined by clusters of topologically connected cells (topo-clusters). The Bayesian…

High Energy Physics - Experiment · Physics 2026-02-03 ATLAS Collaboration

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32x memory saving. In…

Computer Vision and Pattern Recognition · Computer Science 2016-08-04 Mohammad Rastegari , Vicente Ordonez , Joseph Redmon , Ali Farhadi

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

Quantized Neural Networks (QNNs) are often used to improve network efficiency during the inference phase, i.e. after the network has been trained. Extensive research in the field suggests many different quantization schemes. Still, the…

Machine Learning · Computer Science 2018-06-19 Ron Banner , Itay Hubara , Elad Hoffer , Daniel Soudry

Network pruning is aimed at imposing sparsity in a neural network architecture by increasing the portion of zero-valued weights for reducing its size regarding energy-efficiency consideration and increasing evaluation speed. In most of the…

Machine Learning · Computer Science 2018-07-17 Amirsina Torfi , Rouzbeh A. Shirvani , Sobhan Soleymani , Nasser M. Nasrabadi

Neural networks (NN) have achieved state-of-the-art performance in various applications. Unfortunately in applications where training data is insufficient, they are often prone to overfitting. One effective way to alleviate this problem is…

Machine Learning · Computer Science 2016-11-03 Hao Wang , Xingjian Shi , Dit-Yan Yeung

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computation and storage demand, but at the cost of degraded…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Yanfei Li , Tong Geng , Samuel Stein , Ang Li , Huimin Yu

This study examined the viability of enhancing the prediction accuracy of artificial neural networks (ANNs) in image classification tasks by developing ANNs with evolution patterns similar to those of biological neural networks. ResNet is a…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Ziyuan Huang , Mark Newman , Maria Vaida , Srikar Bellur , Roozbeh Sadeghian , Andrew Siu , Hui Wang , Kevin Huggins

Recent studies have shown that Binary Graph Neural Networks (GNNs) are promising for saving computations of GNNs through binarized tensors. Prior work, however, mainly focused on algorithm designs or training techniques, leaving it open to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Jou-An Chen , Hsin-Hsuan Sung , Xipeng Shen , Sutanay Choudhury , Ang Li

Binary Neural Networks~(BNNs) have been proven to be highly effective for deploying deep neural networks on mobile and embedded platforms. Most existing works focus on minimizing quantization errors, improving representation ability, or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jingyang Xiang , Zuohui Chen , Siqi Li , Qing Wu , Yong Liu

Verifying and explaining the behavior of neural networks is becoming increasingly important, especially when they are deployed in safety-critical applications. In this paper, we study verification problems for Binarized Neural Networks…

Machine Learning · Computer Science 2021-03-15 Yedi Zhang , Zhe Zhao , Guangke Chen , Fu Song , Taolue Chen

The Spiking Neural Network (SNN), as one of the biologically inspired neural network infrastructures, has drawn increasing attention recently. It adopts binary spike activations to transmit information, thus the multiplications of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yufei Guo , Yuanpei Chen , Xiaode Liu , Weihang Peng , Yuhan Zhang , Xuhui Huang , Zhe Ma

Despite the increasing prevalence of deep neural networks, their applicability in resource-constrained devices is limited due to their computational load. While modern devices exhibit a high level of parallelism, real-time latency is still…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Amir Ben Dror , Niv Zehngut , Avraham Raviv , Evgeny Artyomov , Ran Vitek , Roy Jevnisek

Convolutional Neural Networks (CNNs) have proven to be highly effective in solving a broad spectrum of computer vision tasks, such as classification, identification, and segmentation. These methods can be deployed in both centralized and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-12 Victor Forattini Jansen , Emanuel Teixeira Martins , Yasmin Souza Lima , Flavio de Oliveira Silva , Rodrigo Moreira , Larissa Ferreira Rodrigues Moreira

Neural networks have shown great performance in cognitive tasks. When deploying network models on mobile devices with limited resources, weight quantization has been widely adopted. Binary quantization obtains the highest compression but…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Hsin-Pai Cheng , Yuanjun Huang , Xuyang Guo , Yifei Huang , Feng Yan , Hai Li , Yiran Chen

Bowers and colleagues argue that DNNs are poor models of biological vision because they often learn to rival human accuracy by relying on strategies that differ markedly from those of humans. We show that this problem is worsening as DNNs…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Drew Linsley , Thomas Serre

Low-precision weights and activations in deep neural networks (DNNs) outperform their full-precision counterparts in terms of hardware efficiency. When implemented with low-precision operations, specifically in the extreme case where…

Artificial Intelligence · Computer Science 2024-07-09 Behnam Ghavami , Mohammad Shahidzadeh , Lesley Shannon , Steve Wilton