English
Related papers

Related papers: A comprehensive review of Binary Neural Network

200 papers

Applications of Binary Neural Networks (BNNs) are promising for embedded systems with hard constraints on computing power. Contrary to conventional neural networks with the floating-point datatype, BNNs use binarized weights and activations…

Emerging Technologies · Computer Science 2022-11-14 Mahdi Zahedi , Taha Shahroodi , Stephan Wong , Said Hamdioui

Though deep neural network models exhibit outstanding performance for various applications, their large model size and extensive floating-point operations render deployment on mobile computing platforms a major challenge, and, in…

Cryptography and Security · Computer Science 2022-08-04 Huming Qiu , Hua Ma , Zhi Zhang , Yifeng Zheng , Anmin Fu , Pan Zhou , Yansong Gao , Derek Abbott , Said F. Al-Sarawi

Binary neural networks (BNNs) constrain weights and activations to +1 or -1 with limited storage and computational cost, which is hardware-friendly for portable devices. Recently, BNNs have achieved remarkable progress and been adopted into…

Machine Learning · Computer Science 2021-10-12 Jiehua Zhang , Zhuo Su , Yanghe Feng , Xin Lu , Matti Pietikäinen , Li Liu

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru

Convolutional neural networks have achieved astonishing results in different application areas. Various methods which allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks seem to…

Machine Learning · Computer Science 2018-09-28 Joseph Bethge , Haojin Yang , Christian Bartz , Christoph Meinel

Binary Neural Networks (BNNs), neural networks with weights and activations constrained to -1(0) and +1, are an alternative to deep neural networks which offer faster training, lower memory consumption and lightweight models, ideal for use…

Machine Learning · Computer Science 2022-05-23 Kinshuk Dua

Compact neural networks are essential for affordable and power efficient deep learning solutions. Binary Neural Networks (BNNs) take compactification to the extreme by constraining both weights and activations to two levels, $\{+1, -1\}$.…

Machine Learning · Computer Science 2020-06-16 Vishnu Raj , Nancy Nayak , Sheetal Kalyani

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

Machine Learning · Computer Science 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

Binary Neural Networks (BNNs) can drastically reduce memory size and accesses by applying bit-wise operations instead of standard arithmetic operations. Therefore it could significantly improve the efficiency and lower the energy…

Machine Learning · Computer Science 2017-05-31 Haojin Yang , Martin Fritzsche , Christian Bartz , Christoph Meinel

Binary Neural Networks (BNNs) can significantly accelerate the inference time of a neural network by replacing its expensive floating-point arithmetic with bitwise operations. Most existing solutions, however, do not fully optimize data…

Machine Learning · Computer Science 2023-04-04 L. Vorabbi , D. Maltoni , S. Santi

We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory…

Machine Learning · Computer Science 2017-12-01 Xiaofan Lin , Cong Zhao , Wei Pan

Deep learning has demonstrated tremendous success in variety of application domains in the past few years. This new field of machine learning has been growing rapidly and applied in most of the application domains with some new modalities…

In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Jiuxiang Gu , Zhenhua Wang , Jason Kuen , Lianyang Ma , Amir Shahroudy , Bing Shuai , Ting Liu , Xingxing Wang , Li Wang , Gang Wang , Jianfei Cai , Tsuhan Chen

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

Binary Neural Networks (BNNs) have emerged as a promising solution for reducing the memory footprint and compute costs of deep neural networks, but they suffer from quality degradation due to the lack of freedom as activations and weights…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Changhun Lee , Hyungjun Kim , Eunhyeok Park , Jae-Joon Kim

Deep Neural Networks (DNNs) have achieved great success in a variety of machine learning (ML) applications, delivering high-quality inferencing solutions in computer vision, natural language processing, and virtual reality, etc. However,…

Machine Learning · Computer Science 2022-08-29 Xiaofan Zhang , Yao Chen , Cong Hao , Sitao Huang , Yuhong Li , Deming Chen

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

In this paper, we study 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While efficient, the lacking of representational capability and the training difficulty impede 1-bit CNNs from…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Zechun Liu , Wenhan Luo , Baoyuan Wu , Xin Yang , Wei Liu , Kwang-Ting Cheng

Verifying and explaining the behavior of neural networks is becoming increasingly important, especially when they are deployed in safety-critical applications. In this paper, we study verification problems for Binarized Neural Networks…

Machine Learning · Computer Science 2021-03-15 Yedi Zhang , Zhe Zhao , Guangke Chen , Fu Song , Taolue Chen

In recent years, advances in deep learning have resulted in unprecedented leaps in diverse tasks spanning from speech and object recognition to context awareness and health monitoring. As a result, an increasing number of AI-enabled…

Machine Learning · Computer Science 2019-05-20 Mario Almeida , Stefanos Laskaridis , Ilias Leontiadis , Stylianos I. Venieris , Nicholas D. Lane