English
Related papers

Related papers: Neural Network-Hardware Co-design for Scalable RRA…

200 papers

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and…

Hardware Architecture · Computer Science 2021-09-10 Kamilya Smagulova , Mohammed E. Fouda , Fadi Kurdahi , Khaled Salama , Ahmed Eltawil

Always-on AI applications, from environmental sensors to biomedical implants, require ultra-low power consumption. Analog circuits offer a path to sub-microwatt inference, yet existing analog implementations are limited to feedforward…

Hardware Architecture · Computer Science 2026-05-27 Arthur Fyon , Julien Brandoit , Loris Mendolia , Damien Ernst , Jean-Michel Redouté , Guillaume Drion

Resistive random access memories (RRAM) are novel nonvolatile memory technologies, which can be embedded at the core of CMOS, and which could be ideal for the in-memory implementation of deep neural networks. A particularly exciting vision…

Emerging Technologies · Computer Science 2019-04-09 Tifenn Hirtzlin , Marc Bocquet , Jacques-Olivier Klein , Etienne Nowak , Elisa Vianello , Jean-Michel Portal , Damien Querlioz

Reducing computational costs is an important issue for development of embedded systems. Binary-weight Neural Networks (BNNs), in which weights are binarized and activations are quantized, are employed to reduce computational costs of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Tse-Wei Chen , Wei Tao , Dongyue Zhao , Kazuhiro Mima , Tadayuki Ito , Kinya Osa , Masami Kato

Artificial neural networks have become ubiquitous in modern life, which has triggered the emergence of a new class of application specific integrated circuits for their acceleration. ReRAM-based accelerators have gained significant traction…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Jason K. Eshraghian , Sung-Mo Kang , Seungbum Baek , Garrick Orchard , Herbert Ho-Ching Iu , Wen Lei

We propose a new algorithm for training neural networks with binary activations and multi-level weights, which enables efficient processing-in-memory circuits with embedded nonvolatile memories (eNVM). Binary activations obviate costly DACs…

Machine Learning · Computer Science 2020-10-13 Siming Ma , David Brooks , Gu-Yeon Wei

Binary neural networks (BNNs) have 1-bit weights and activations. Such networks are well suited for FPGAs, as their dominant computations are bitwise arithmetic and the memory requirement is also significantly reduced. However, compared to…

Machine Learning · Computer Science 2020-12-23 Yichi Zhang , Junhao Pan , Xinheng Liu , Hongzheng Chen , Deming Chen , Zhiru Zhang

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Binary Neural Networks (BNNs) have emerged as a promising solution for reducing the memory footprint and compute costs of deep neural networks, but they suffer from quality degradation due to the lack of freedom as activations and weights…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Changhun Lee , Hyungjun Kim , Eunhyeok Park , Jae-Joon Kim

Significant computational cost and memory requirements for deep neural networks (DNNs) make it difficult to utilize DNNs in resource-constrained environments. Binary neural network (BNN), which uses binary weights and binary activations,…

Neural and Evolutionary Computing · Computer Science 2019-03-26 Hyungjun Kim , Yulhwa Kim , Sungju Ryu , Jae-Joon Kim

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Crossbar memory arrays have been touted as the workhorse of in-memory computing (IMC)-based acceleration of Deep Neural Networks (DNNs), but the associated hardware non-idealities limit their efficacy. To address this, cross-layer design…

Emerging Technologies · Computer Science 2026-04-07 Jeffry Victor , Chunguang Wang , Sumeet K. Gupta

We propose a co-design approach for compute-in-memory inference for deep neural networks (DNN). We use multiplication-free function approximators based on ell_1 norm along with a co-adapted processing array and compute flow. Using the…

Hardware Architecture · Computer Science 2021-02-02 Shamma Nasrin , Diaa Badawi , Ahmet Enis Cetin , Wilfred Gomes , Amit Ranjan Trivedi

This paper proposes ReBNet, an end-to-end framework for training reconfigurable binary neural networks on software and developing efficient accelerators for execution on FPGA. Binary neural networks offer an intriguing opportunity for…

Machine Learning · Computer Science 2018-03-29 Mohammad Ghasemzadeh , Mohammad Samragh , Farinaz Koushanfar

Binary neural networks utilize 1-bit quantized weights and activations to reduce both the model's storage demands and computational burden. However, advanced binary architectures still incorporate millions of inefficient and…

Machine Learning · Computer Science 2024-03-07 Ruichen Ma , Guanchao Qiao , Yian Liu , Liwei Meng , Ning Ning , Yang Liu , Shaogang Hu

Recent advances in algorithm-hardware co-design for deep neural networks (DNNs) have demonstrated their potential in automatically designing neural architectures and hardware designs. Nevertheless, it is still a challenging optimization…

Machine Learning · Computer Science 2021-11-29 Hongxiang Fan , Martin Ferianc , Zhiqiang Que , He Li , Shuanglong Liu , Xinyu Niu , Wayne Luk

The increasing amount of data processed on edge and the demand for reducing the energy consumption for large neural network architectures have initiated the transition from traditional von Neumann architectures towards in-memory computing…

Emerging Technologies · Computer Science 2022-09-27 O. Krestinskaya , L. Zhang , K. N. Salama

Binary Neural Networks (BNNs) are promising to deliver accuracy comparable to conventional deep neural networks at a fraction of the cost in terms of memory and energy. In this paper, we introduce the XNOR Neural Engine (XNE), a fully…

Neural and Evolutionary Computing · Computer Science 2018-07-23 Francesco Conti , Pasquale Davide Schiavone , Luca Benini

Neural network hardware is considered an essential part of future edge devices. In this paper, we propose a binary-weight spiking neural network (BW-SNN) hardware architecture for low-power real-time object classification on edge platforms.…

Signal Processing · Electrical Eng. & Systems 2020-03-16 Pai-Yu Tan , Po-Yao Chuang , Yen-Ting Lin , Cheng-Wen Wu , Juin-Ming Lu