English
Related papers

Related papers: PiC-BNN: A 128-kbit 65 nm Processing-in-CAM-Based …

200 papers

Binary Neural Networks (BNNs) are showing tremendous success on realistic image classification tasks. Notably, their accuracy is similar to the state-of-the-art accuracy obtained by full-precision models tailored to edge devices. In this…

Hardware Architecture · Computer Science 2022-12-02 Franyell Silfa , Jose Maria Arnau , Antonio González

This paper describes a CNN where all CNN style 2D convolution operations that lower to matrix matrix multiplication are fully binary. The network is derived from a common building block structure that is consistent with a constructive proof…

Machine Learning · Computer Science 2021-03-08 Arthur J. Redfern , Lijun Zhu , Molly K. Newquist

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

This work proposes a Processing-In-Sensor Accelerator, namely PISA, as a flexible, energy-efficient, and high-performance solution for real-time and smart image processing in AI devices. PISA intrinsically implements a coarse-grained…

Hardware Architecture · Computer Science 2022-02-21 Shaahin Angizi , Sepehr Tabrizchi , Arman Roohi

Binarized convolutional neural networks (BCNNs) are widely used to improve memory and computation efficiency of deep convolutional neural networks (DCNNs) for mobile and AI chips based applications. However, current BCNNs are not able to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Chunlei Liu , Wenrui Ding , Xin Xia , Yuan Hu , Baochang Zhang , Jianzhuang Liu , Bohan Zhuang , Guodong Guo

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

Machine Learning · Computer Science 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

Large-scale deep neural networks are both memory intensive and computation-intensive, thereby posing stringent requirements on the computing platforms. Hardware accelerations of deep neural networks have been extensively investigated in…

Machine Learning · Computer Science 2018-06-12 Yanzhi Wang , Zheng Zhan , Jiayu Li , Jian Tang , Bo Yuan , Liang Zhao , Wujie Wen , Siyue Wang , Xue Lin

Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy consumption. These advantages make them particularly well…

Machine Learning · Computer Science 2026-02-18 Luca Colombo , Fabrizio Pittorino , Daniele Zambon , Carlo Baldassi , Manuel Roveri , Cesare Alippi

Binary neural networks are the extreme case of network quantization, which has long been thought of as a potential edge machine learning solution. However, the significant accuracy gap to the full-precision counterparts restricts their…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Nianhui Guo , Joseph Bethge , Christoph Meinel , Haojin Yang

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time and when computing the parameters' gradient at train-time. We conduct two sets of experiments, each based on a…

Machine Learning · Computer Science 2016-03-11 Itay Hubara , Daniel Soudry , Ran El Yaniv

Binary Neural Networks (BNNs) can drastically reduce memory size and accesses by applying bit-wise operations instead of standard arithmetic operations. Therefore it could significantly improve the efficiency and lower the energy…

Machine Learning · Computer Science 2017-05-31 Haojin Yang , Martin Fritzsche , Christian Bartz , Christoph Meinel

Successful motor-imagery brain-computer interface (MI-BCI) algorithms either extract a large number of handcrafted features and train a classifier, or combine feature extraction and classification within deep convolutional neural networks…

Signal Processing · Electrical Eng. & Systems 2020-10-15 Michael Hersche , Luca Benini , Abbas Rahimi

Recently, RRAM-based Binary Neural Network (BNN) hardware has been gaining interests as it requires 1-bit sense-amp only and eliminates the need for high-resolution ADC and DAC. However, RRAM-based BNN hardware still requires…

Neural and Evolutionary Computing · Computer Science 2019-04-16 Yulhwa Kim , Hyungjun Kim , Jae-Joon Kim

Binary Neural Networks (BNNs) are neural networks which use binary weights and activations instead of the typical 32-bit floating point values. They have reduced model sizes and allow for efficient inference on mobile or embedded devices…

Machine Learning · Computer Science 2020-03-25 Joseph Bethge , Christian Bartz , Haojin Yang , Ying Chen , Christoph Meinel

Convolutional neural networks (CNNs) have revolutionized the world of computer vision over the last few years, pushing image classification beyond human accuracy. The computational effort of today's CNNs requires power-hungry parallel…

Hardware Architecture · Computer Science 2017-02-27 Renzo Andri , Lukas Cavigelli , Davide Rossi , Luca Benini

Binary neural networks (BNNs) have been widely adopted to reduce the computational cost and memory storage on edge-computing devices by using one-bit representation for activations and weights. However, as neural networks become…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Quang Hieu Vo , Linh-Tam Tran , Sung-Ho Bae , Lok-Won Kim , Choong Seon Hong

Hashing retrieval is a pivotal technology for large-scale similarity search, widely applied in retrieval-augmented generation (RAG) for large language models (LLMs), massive image repositories, and bioinformatics sequence matching. However,…

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Changqing Xu , Yijian Pei , Zili Wu , Yi Liu , Yintang Yang