English
Related papers

Related papers: A comprehensive review of Binary Neural Network

200 papers

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren

Binary Neural Networks (BNNs) show great promise for real-world embedded devices. As one of the critical steps to achieve a powerful BNN, the scale factor calculation plays an essential role in reducing the performance gap to their…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Sheng Xu , Yanjing Li , Tiancheng Wang , Teli Ma , Baochang Zhang , Peng Gao , Yu Qiao , Jinhu Lv , Guodong Guo

Significant computational cost and memory requirements for deep neural networks (DNNs) make it difficult to utilize DNNs in resource-constrained environments. Binary neural network (BNN), which uses binary weights and binary activations,…

Neural and Evolutionary Computing · Computer Science 2019-03-26 Hyungjun Kim , Yulhwa Kim , Sungju Ryu , Jae-Joon Kim

Recent breakthroughs in Deep Learning (DL) applications have made DL models a key component in almost every modern computing system. The increased popularity of DL applications deployed on a wide-spectrum of platforms have resulted in a…

Machine Learning · Computer Science 2018-09-17 Diana Marculescu , Dimitrios Stamoulis , Ermao Cai

Convolutional neural networks have achieved astonishing results in different application areas. Various methods that allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks are a…

Machine Learning · Computer Science 2018-12-06 Joseph Bethge , Marvin Bornstein , Adrian Loy , Haojin Yang , Christoph Meinel

Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data. As they generalize the operations of classical CNNs on grids to arbitrary topologies, GNNs also bring much of the…

Machine Learning · Computer Science 2021-03-31 Mehdi Bahri , Gaétan Bahl , Stefanos Zafeiriou

This paper proposes ReBNet, an end-to-end framework for training reconfigurable binary neural networks on software and developing efficient accelerators for execution on FPGA. Binary neural networks offer an intriguing opportunity for…

Machine Learning · Computer Science 2018-03-29 Mohammad Ghasemzadeh , Mohammad Samragh , Farinaz Koushanfar

Binary neural networks have attracted tremendous attention due to the efficiency for deploying them on mobile devices. Since the weak expression ability of binary weights and features, their accuracy is usually much lower than that of…

Machine Learning · Computer Science 2019-09-18 Mingzhu Shen , Kai Han , Chunjing Xu , Yunhe Wang

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Deep learning has been a groundbreaking technology in various fields as well as in communications systems. In spite of the notable advancements of deep neural network (DNN) based technologies in recent years, the high computational…

Information Theory · Computer Science 2018-08-08 Minhoe Kim , Woonsup Lee , Jungmin Yoon , Ohyun Jo

Application-specific integrated circuit (ASIC) implementations for Deep Neural Networks (DNNs) have been adopted in many systems because of their higher classification speed. However, although they may be characterized by better accuracy,…

Neural and Evolutionary Computing · Computer Science 2018-02-08 Ruizhou Ding , Zeye Liu , Rongye Shi , Diana Marculescu , R. D. Blanton

The advancement of deep convolutional neural networks (DCNNs) has driven significant improvement in the accuracy of recognition systems for many computer vision tasks. However, their practical applications are often restricted in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiaxin Gu , Ce Li , Baochang Zhang , Jungong Han , Xianbin Cao , Jianzhuang Liu , David Doermann

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With new memory…

Optical Diffraction Neural Networks (DNNs), a subset of Optical Neural Networks (ONNs), show promise in mirroring the prowess of electronic networks. This study introduces the Hybrid Diffraction Neural Network (HDNN), a novel architecture…

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common…

Machine Learning · Computer Science 2021-04-20 Lukas Baischer , Matthias Wess , Nima TaheriNejad

Deep neural networks (DNNs) are reshaping the field of information processing. With their exponential growth challenging existing electronic hardware, optical neural networks (ONNs) are emerging to process DNN tasks in the optical domain…

Binarized Neural Networks (BNN) offer efficient implementations for machine learning tasks and facilitate Privacy-Preserving Machine Learning (PPML) by simplifying operations with binary values. Nevertheless, challenges persist in terms of…

Machine Learning · Computer Science 2024-12-24 Benchang Dong , Zhili Chen , Xin Chen , Shiwen Wei , Jie Fu , Huifa Li

Binary Neural Networks (BNNs) are neural networks which use binary weights and activations instead of the typical 32-bit floating point values. They have reduced model sizes and allow for efficient inference on mobile or embedded devices…

Machine Learning · Computer Science 2020-03-25 Joseph Bethge , Christian Bartz , Haojin Yang , Ying Chen , Christoph Meinel