English
Related papers

Related papers: Adaptive Precision CNN Accelerator Using Radix-X P…

200 papers

Deep learning has made remarkable progress in various tasks, surpassing human performance in some cases. However, one drawback of neural networks is catastrophic forgetting, where a network trained on one task forgets the solution when…

Neural and Evolutionary Computing · Computer Science 2024-01-04 Simone D'Agostino , Filippo Moro , Tifenn Hirtzlin , Julien Arcamone , Niccolò Castellani , Damien Querlioz , Melika Payvand , Elisa Vianello

Memristor crossbars enable vector-matrix multiplication (VMM), and are promising for low-power applications. However, it can be difficult to write the memristor conductance values exactly. To improve the accuracy of VMM, we propose a scheme…

Signal Processing · Electrical Eng. & Systems 2025-10-07 Binyu Lu , Matthias Frey , Stark Draper , Jingge Zhu

Convolutional neural networks (CNNs) achieve remarkable performance in a wide range of fields. However, intensive memory access of activations introduces considerable energy consumption, impeding deployment of CNNs on resourceconstrained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yu-Shan Tai , Chieh-Fang Teng , Cheng-Yang Chang , An-Yeu Wu

The memory demands of large-scale deep neural networks (DNNs) require synaptic weight values to be stored and updated in off-chip memory like dynamic random-access memory, which reduces energy efficiency and increases training time.…

Applied Physics · Physics 2025-10-08 Abhishek Kumar , Peter D. Hodgson , Manus Hayne , Avirup Dasgupta

Segmentation of white matter lesions and deep grey matter structures is an important task in the quantification of magnetic resonance imaging in multiple sclerosis. In this paper we explore segmentation solutions based on convolutional…

A Compressive Sensing (CS) approach is applied to utilize intrinsic computation capabilities of Spin-Orbit Torque Magnetic Random Access Memory (SOT-MRAM) devices for IoT applications wherein lifetime energy, device area, and manufacturing…

Emerging Technologies · Computer Science 2019-12-03 Soheil Salehi , Ronald F. DeMara

As conventional memory technologies are challenged by their technological physical limits, emerging technologies driven by novel materials are becoming an attractive option for future memory architectures. Among these technologies,…

Materials Science · Physics 2015-05-28 Omid Kavehei , Said Al-Sarawi , Kyoung-Rok Cho , Kamran Eshraghian , Derek Abbott

Architectures that incorporate Computing-in-Memory (CiM) using emerging non-volatile memory (NVM) devices have become strong contenders for deep neural network (DNN) acceleration due to their impressive energy efficiency. Yet, a significant…

Hardware Architecture · Computer Science 2024-01-12 Zheyu Yan , Xiaobo Sharon Hu , Yiyu Shi

Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representations for deep neural networks. While hard constraining…

Machine Learning · Computer Science 2015-11-20 Zhirong Wu , Dahua Lin , Xiaoou Tang

We propose a co-design approach for compute-in-memory inference for deep neural networks (DNN). We use multiplication-free function approximators based on ell_1 norm along with a co-adapted processing array and compute flow. Using the…

Hardware Architecture · Computer Science 2021-02-02 Shamma Nasrin , Diaa Badawi , Ahmet Enis Cetin , Wilfred Gomes , Amit Ranjan Trivedi

Memristor based neural networks have great potentials in on-chip neuromorphic computing systems due to the fast computation and low-energy consumption. However, the imprecise properties of existing memristor devices generally result in…

Emerging Technologies · Computer Science 2019-06-07 Yaoyuan Wang , Shuang Wu , Ziyang Zhang , Lei Tian , Luping Shi

Neural networks powered by artificial intelligence play a pivotal role in current estimation and classification applications due to the escalating computational demands of evolving deep learning systems. The hindrances posed by existing…

Optics · Physics 2023-06-06 Wenwen Zhang , Hao Zhang

This paper describes a novel approach of packing sparse convolutional neural networks for their efficient systolic array implementations. By combining subsets of columns in the original filter matrix associated with a convolutional layer,…

Machine Learning · Computer Science 2018-11-13 H. T. Kung , Bradley McDanel , Sai Qian Zhang

The operations used for neural network computation map favorably onto simple analog circuits, which outshine their digital counterparts in terms of compactness and efficiency. Nevertheless, such implementations have been largely supplanted…

Neural and Evolutionary Computing · Computer Science 2020-02-24 Jonathan Binas , Daniel Neil , Giacomo Indiveri , Shih-Chii Liu , Michael Pfeiffer

Resistive Random-Access Memory (RRAM) is well-suited to accelerate neural network (NN) workloads as RRAM-based Processing-in-Memory (PIM) architectures natively support highly-parallel multiply-accumulate (MAC) operations that form the…

Hardware Architecture · Computer Science 2022-11-11 Aditya Manglik , Minesh Patel , Haiyu Mao , Behzad Salami , Jisung Park , Lois Orosa , Onur Mutlu

This paper proposes an adaptive auxiliary task learning based approach for object counting problems. Unlike existing auxiliary task learning based methods, we develop an attention-enhanced adaptively shared backbone network to enable both…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Yanda Meng , Joshua Bridge , Meng Wei , Yitian Zhao , Yihong Qiao , Xiaoyun Yang , Xiaowei Huang , Yalin Zheng

The paper presents a systematic study and implementation of a reconfigurable combinatorial multi-operand adder for use in Deep Learning systems. The size of carry changes with the number of operands and hence a reliable algorithm to…

Hardware Architecture · Computer Science 2020-08-10 Shilpa Mayannavar , Uday Wali

Transistor-based memories are rapidly approaching their maximum density per unit area. Resistive crossbar arrays enable denser memory due to the small size of switching devices. However, due to the resistive nature of these memories, they…

Emerging Technologies · Computer Science 2019-03-06 Mohammed E Fouda , Ahmed M. Eltawil , Fadi Kurdahi

Convolution neural network demonstrates great capability for multiple tasks, such as image classification and many others. However, much resource is required to train a network. Hence much effort has been made to accelerate neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Fuyuan Lyu , Shien Zhu , Weichen Liu

Convolutional neural networks (CNNs) require high throughput hardware accelerators for real time applications owing to their huge computational cost. Most traditional CNN accelerators rely on single core, linear processing elements (PEs) in…

Hardware Architecture · Computer Science 2020-07-21 Mahmood Azhar Qureshi , Arslan Munir