English
Related papers

Related papers: XNOR-Net: ImageNet Classification Using Binary Con…

200 papers

Convolutional neural networks have achieved astonishing results in different application areas. Various methods which allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks seem to…

Machine Learning · Computer Science 2018-09-28 Joseph Bethge , Haojin Yang , Christian Bartz , Christoph Meinel

Binary Neural Networks (BNNs) use 1-bit weights and activations to efficiently execute deep convolutional neural networks on edge devices. Nevertheless, the binarization of the first layer is conventionally excluded, as it leads to a large…

Machine Learning · Computer Science 2023-05-05 Lorenzo Vorabbi , Davide Maltoni , Stefano Santi

We present a neural network architecture and training method designed to enable very rapid training and low implementation complexity. Due to its training speed and very few tunable parameters, the method has strong potential for…

Neural and Evolutionary Computing · Computer Science 2015-08-18 Mark D. McDonnell , Tony Vladusich

Optical and hybrid convolutional neural networks (CNNs) recently have become of increasing interest to achieve low-latency, low-power image classification and computer vision tasks. However, implementing optical nonlinearity is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Anna Wirth-Singh , Jinlin Xiang , Minho Choi , Johannes E. Fröch , Luocheng Huang , Shane Colburn , Eli Shlizerman , Arka Majumdar

Weight and activation binarization can efficiently compress deep neural networks and accelerate model inference, but cause severe accuracy degradation. Existing optimization methods for binary neural networks (BNNs) focus on fitting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Ping Xue , Yang Lu , Jingfei Chang , Xing Wei , Zhen Wei

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Binary neural networks (BNNs) have 1-bit weights and activations. Such networks are well suited for FPGAs, as their dominant computations are bitwise arithmetic and the memory requirement is also significantly reduced. However, compared to…

Machine Learning · Computer Science 2020-12-23 Yichi Zhang , Junhao Pan , Xinheng Liu , Hongzheng Chen , Deming Chen , Zhiru Zhang

Recent trends show recognition accuracy increasing even more profoundly. Inference process of Deep Convolutional Neural Networks (DCNN) has a large number of parameters, requires a large amount of computation, and can be very slow. The…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Ryuji Kamiya , Takayoshi Yamashita , Mitsuru Ambai , Ikuro Sato , Yuji Yamauchi , Hironobu Fujiyoshi

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

This paper proposes ReBNet, an end-to-end framework for training reconfigurable binary neural networks on software and developing efficient accelerators for execution on FPGA. Binary neural networks offer an intriguing opportunity for…

Machine Learning · Computer Science 2018-03-29 Mohammad Ghasemzadeh , Mohammad Samragh , Farinaz Koushanfar

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pavel Kaloshin

Recently ConvNets or convolutional neural networks (CNN) have come up as state-of-the-art classification and detection algorithms, achieving near-human performance in visual detection. However, ConvNet algorithms are typically very…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Bert Moons , Bert De Brabandere , Luc Van Gool , Marian Verhelst

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

Recent work has shown that fast, compact low-bitwidth neural networks can be surprisingly accurate. These networks use homogeneous binarization: all parameters in each layer or (more commonly) the whole model have the same low bitwidth…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Josh Fromm , Shwetak Patel , Matthai Philipose

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

Deep convolutional neural networks (CNNs) have shown appealing performance on various computer vision tasks in recent years. This motivates people to deploy CNNs to realworld applications. However, most of state-of-art CNNs require large…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Qinghao Hu , Peisong Wang , Jian Cheng

VPR is a fundamental task for autonomous navigation as it enables a robot to localize itself in the workspace when a known location is detected. Although accuracy is an essential requirement for a VPR technique, computational and energy…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Bruno Ferrarini , Michael Milford , Klaus D. McDonald-Maier , Shoaib Ehsan

Binary neural network (BNN) is an extreme quantization version of convolutional neural networks (CNNs) with all features and weights mapped to just 1-bit. Although BNN saves a lot of memory and computation demand to make CNN applicable on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xulong Shi , Zhi Qi , Jiaxuan Cai , Keqi Fu , Yaru Zhao , Zan Li , Xuanyu Liu , Hao Liu

Deep neural network has been ensured as a key technology in the field of many challenging and vigorously researched computer vision tasks. Furthermore, classical ResNet is thought to be a state-of-the-art convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Prathibha Varghese , G. Arockia Selva Saroja

Binary Neural Networks (BNNs) are increasingly preferred over full-precision Convolutional Neural Networks(CNNs) to reduce the memory and computational requirements of inference processing with minimal accuracy drop. BNNs convert CNN model…

Hardware Architecture · Computer Science 2023-03-21 Sairam Sri Vatsavai , Venkata Sai Praneeth Karempudi , Ishan Thakkar