English
Related papers

Related papers: Design Automation for Binarized Neural Networks: A…

200 papers

Binary neural networks (BNNs) have demonstrated their ability to solve complex tasks with comparable accuracy as full-precision deep neural networks (DNNs), while also reducing computational power and storage requirements and increasing the…

Machine Learning · Computer Science 2022-07-12 Riccardo Schiavone , Maria A. Zuluaga

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

Recent advances in neural networks (NNs) exhibit unprecedented success at transforming large, unstructured data streams into compact higher-level semantic information for tasks such as handwriting recognition, image classification, and…

Hardware Architecture · Computer Science 2017-06-09 Vincent T. Lee , Armin Alaghi , John P. Hayes , Visvesh Sathe , Luis Ceze

Deep learning algorithms have shown tremendous success in many recognition tasks; however, these algorithms typically include a deep neural network (DNN) structure and a large number of parameters, which makes it challenging to implement…

Neural and Evolutionary Computing · Computer Science 2018-04-23 Shihui Yin , Gaurav Srivastava , Shreyas K. Venkataramanaiah , Chaitali Chakrabarti , Visar Berisha , Jae-sun Seo

Low-precision weights and activations in deep neural networks (DNNs) outperform their full-precision counterparts in terms of hardware efficiency. When implemented with low-precision operations, specifically in the extreme case where…

Artificial Intelligence · Computer Science 2024-07-09 Behnam Ghavami , Mohammad Shahidzadeh , Lesley Shannon , Steve Wilton

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Applications of Binary Neural Networks (BNNs) are promising for embedded systems with hard constraints on computing power. Contrary to conventional neural networks with the floating-point datatype, BNNs use binarized weights and activations…

Emerging Technologies · Computer Science 2022-11-14 Mahdi Zahedi , Taha Shahroodi , Stephan Wong , Said Hamdioui

Recent works on Binary Neural Networks (BNNs) have made promising progress in narrowing the accuracy gap of BNNs to their 32-bit counterparts. However, the accuracy gains are often based on specialized model designs using additional 32-bit…

Machine Learning · Computer Science 2021-06-15 Nianhui Guo , Joseph Bethge , Haojin Yang , Kai Zhong , Xuefei Ning , Christoph Meinel , Yu Wang

Neural network hardware is considered an essential part of future edge devices. In this paper, we propose a binary-weight spiking neural network (BW-SNN) hardware architecture for low-power real-time object classification on edge platforms.…

Signal Processing · Electrical Eng. & Systems 2020-03-16 Pai-Yu Tan , Po-Yao Chuang , Yen-Ting Lin , Cheng-Wen Wu , Juin-Ming Lu

Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of…

Hardware Architecture · Computer Science 2021-04-13 Mario Fischer , Juergen Wassner

Binarization is a powerful compression technique for neural networks, significantly reducing FLOPs, but often results in a significant drop in model performance. To address this issue, partial binarization techniques have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Udbhav Bamba , Neeraj Anand , Saksham Aggarwal , Dilip K. Prasad , Deepak K. Gupta

Deep neural networks, (DNNs, a.k.a. NNs), have been widely used in various tasks and have been proven to be successful. However, the accompanied expensive computing and storage costs make the deployments in resource-constrained devices a…

Machine Learning · Computer Science 2023-08-01 Ye Tao , Wanwei Liu , Fu Song , Zhen Liang , Ji Wang , Hongxu Zhu

Deep convolutional neural networks (DCNNs) have recently demonstrated high-quality results in single-image super-resolution (SR). DCNNs often suffer from over-parametrization and large amounts of redundancy, which results in inefficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Yinglan Ma , Hongyu Xiong , Zhe Hu , Lizhuang Ma

This paper proposes an low power approximate multiplier architecture for deep neural network (DNN) applications. A 4:2 compressor, introducing only a single combination error, is designed and integrated into an 8x8 unsigned multiplier. This…

Hardware Architecture · Computer Science 2025-09-03 Pragun Jaswal , L. Hemanth Krishna , B. Srinivasu

Binary Neural Networks (BNNs), neural networks with weights and activations constrained to -1(0) and +1, are an alternative to deep neural networks which offer faster training, lower memory consumption and lightweight models, ideal for use…

Machine Learning · Computer Science 2022-05-23 Kinshuk Dua

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren

Binarized neural networks (BNNs) are gaining interest in the deep learning community due to their significantly lower computational and memory cost. They are particularly well suited to reconfigurable logic devices, which contain an…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Nicholas J. Fraser , Yaman Umuroglu , Giulio Gambardella , Michaela Blott , Philip Leong , Magnus Jahre , Kees Vissers

Binarized Neural Network (BNN) removes bitwidth redundancy in classical CNN by using a single bit (-1/+1) for network parameters and intermediate representations, which has greatly reduced the off-chip data transfer and storage overhead.…

Machine Learning · Computer Science 2018-10-05 Cheng Fu , Shilin Zhu , Hao Su , Ching-En Lee , Jishen Zhao

In this paper, we propose a low-power hardware for efficient deployment of binarized neural networks (BNNs) that have been trained for physiological datasets. BNNs constrain weights and feature-map to 1 bit, can pack in as many 1-bit…

Signal Processing · Electrical Eng. & Systems 2019-03-28 Morteza Hosseini , Hirenkumar Paneliya , Uttej Kallakuri , Mohit Khatwani , Tinoosh Mohsenin

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu
‹ Prev 1 2 3 10 Next ›