English
Related papers

Related papers: Optimizing data-flow in Binary Neural Networks

200 papers

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Applications of Binary Neural Networks (BNNs) are promising for embedded systems with hard constraints on computing power. Contrary to conventional neural networks with the floating-point datatype, BNNs use binarized weights and activations…

Emerging Technologies · Computer Science 2022-11-14 Mahdi Zahedi , Taha Shahroodi , Stephan Wong , Said Hamdioui

Binary neural networks (BNN) have been studied extensively since they run dramatically faster at lower memory and power consumption than floating-point networks, thanks to the efficiency of bit operations. However, contemporary BNNs whose…

Machine Learning · Computer Science 2018-12-04 Shilin Zhu , Xin Dong , Hao Su

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed

Recent works on Binary Neural Networks (BNNs) have made promising progress in narrowing the accuracy gap of BNNs to their 32-bit counterparts. However, the accuracy gains are often based on specialized model designs using additional 32-bit…

Machine Learning · Computer Science 2021-06-15 Nianhui Guo , Joseph Bethge , Haojin Yang , Kai Zhong , Xuefei Ning , Christoph Meinel , Yu Wang

Convolutional neural networks have recently achieved significant breakthroughs in various image classification tasks. However, they are computationally expensive,which can make their feasible mplementation on embedded and low-power devices…

Machine Learning · Computer Science 2018-08-02 Mir Khan , Heikki Huttunen , Jani Boutellier

For binary neural networks (BNNs) to become the mainstream on-device computer vision algorithm, they must achieve a superior speed-vs-accuracy tradeoff than 8-bit quantization and establish a similar degree of general applicability in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Guhong Nie , Lirui Xiao , Menglong Zhu , Dongliang Chu , Yue Shen , Peng Li , Kang Yang , Li Du , Bo Chen

Based on the assumption that there exists a neural network that efficiently represents a set of Boolean functions between all binary inputs and outputs, we propose a process for developing and deploying neural networks whose weight…

Machine Learning · Computer Science 2020-02-25 Minje Kim , Paris Smaragdis

Binarized Neural Networks (BNNs) can significantly reduce the inference latency and energy consumption in resource-constrained devices due to their pure-logical computation and fewer memory accesses. However, training BNNs is difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Ruizhou Ding , Ting-Wu Chin , Zeye Liu , Diana Marculescu

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown efficiency in latent information analysis but fall short when…

Machine Learning · Computer Science 2021-08-11 Hongwu Peng , Shanglin Zhou , Scott Weitze , Jiaxin Li , Sahidul Islam , Tong Geng , Ang Li , Wei Zhang , Minghu Song , Mimi Xie , Hang Liu , Caiwen Ding

Binary neural network (BNN) provides a promising solution to deploy parameter-intensive deep single image super-resolution (SISR) models onto real devices with limited storage and computational resources. To achieve comparable performance…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Zhiqiang Lang , Chongxing Song , Lei Zhang , Wei Wei

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren

Binarized Neural Network (BNN) removes bitwidth redundancy in classical CNN by using a single bit (-1/+1) for network parameters and intermediate representations, which has greatly reduced the off-chip data transfer and storage overhead.…

Machine Learning · Computer Science 2018-10-05 Cheng Fu , Shilin Zhu , Hao Su , Ching-En Lee , Jishen Zhao

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

For the efficient execution of deep convolutional neural networks (CNN) on edge devices, various approaches have been presented which reduce the bit width of the network parameters down to 1 bit. Binarization of the first layer was always…

Machine Learning · Computer Science 2018-12-11 Robert Dürichen , Thomas Rocznik , Oliver Renz , Christian Peters

Bayesian method is capable of capturing real world uncertainties/incompleteness and properly addressing the over-fitting issue faced by deep neural networks. In recent years, Bayesian Neural Networks (BNNs) have drawn tremendous attentions…

Machine Learning · Computer Science 2020-05-11 Xiaotao Jia , Jianlei Yang , Runze Liu , Xueyan Wang , Sorin Dan Cotofana , Weisheng Zhao

Binary Neural Networks (BNNs) are showing tremendous success on realistic image classification tasks. Notably, their accuracy is similar to the state-of-the-art accuracy obtained by full-precision models tailored to edge devices. In this…

Hardware Architecture · Computer Science 2022-12-02 Franyell Silfa , Jose Maria Arnau , Antonio González

Binary convolutional networks have lower computational load and lower memory foot-print compared to their full-precision counterparts. So, they are a feasible alternative for the deployment of computer vision applications on limited…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Mete Can Kaya , Alperen İnci , Alptekin Temizel

A key enabler of deploying convolutional neural networks on resource-constrained embedded systems is the binary neural network (BNN). BNNs save on memory and simplify computation by binarizing both features and weights. Unfortunately,…

Machine Learning · Computer Science 2023-10-19 Floran de Putter , Henk Corporaal
‹ Prev 1 2 3 10 Next ›