English
Related papers

Related papers: Binary Weighted Memristive Analog Deep Neural Netw…

200 papers

The current work reports an efficient deep neural network (DNN) accelerator where synaptic weight elements are controlled by ferroelectric domain dynamics. An integrated device-to-algorithm framework for benchmarking novel synaptic devices…

Emerging Technologies · Computer Science 2022-10-14 Sayani Majumdar

Deep learning based on unrolled algorithm has served as an effective method for accelerated magnetic resonance imaging (MRI). However, many methods ignore the direct use of edge information to assist MRI reconstruction. In this work, we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-16 Jianpeng Cao

To develop a deep-learning method for achieving fast high-resolution MR elastography from highly undersampled data without the need of high-quality training dataset. We first framed the deep neural network representation as a nonlinear…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Xi Peng

The field of artificial intelligence faces significant challenges in achieving both biological plausibility and computational efficiency, particularly in visual learning tasks. Current artificial neural networks, such as convolutional…

Machine Learning · Computer Science 2024-09-27 Jacobo Ruiz , Manas Gupta

For the efficient execution of deep convolutional neural networks (CNN) on edge devices, various approaches have been presented which reduce the bit width of the network parameters down to 1 bit. Binarization of the first layer was always…

Machine Learning · Computer Science 2018-12-11 Robert Dürichen , Thomas Rocznik , Oliver Renz , Christian Peters

Post-training, layer-wise quantization is preferable because it is free from retraining and is hardware-friendly. Nevertheless, accuracy degradation has occurred when a neural network model has a big difference of per-out-channel weight…

Machine Learning · Computer Science 2020-08-14 Jihun Oh , SangJeong Lee , Meejeong Park , Pooni Walagaurav , Kiseok Kwon

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Binary neural networks (BNNs) are an attractive solution for developing and deploying deep neural network (DNN)-based applications in resource constrained devices. Despite their success, BNNs still suffer from a fixed and limited…

Machine Learning · Computer Science 2023-06-26 Riccardo Schiavone , Francesco Galati , Maria A. Zuluaga

Binary Neural Network (BNN) shows its predominance in reducing the complexity of deep neural networks. However, it suffers severe performance degradation. One of the major impediments is the large quantization error between the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Mingbao Lin , Rongrong Ji , Zihan Xu , Baochang Zhang , Yan Wang , Yongjian Wu , Feiyue Huang , Chia-Wen Lin

We study the performance of stochastically trained deep neural networks (DNNs) whose synaptic weights are implemented using emerging memristive devices that exhibit limited dynamic range, resolution, and variability in their programming…

Machine Learning · Statistics 2017-11-13 Anakha V Babu , Bipin Rajendran

In low-latency or mobile applications, lower computation complexity, lower memory footprint and better energy efficiency are desired. Many prior works address this need by removing redundant parameters. Parameter quantization replaces…

Machine Learning · Computer Science 2021-11-16 Cheng-Chou Lan

This article presents design techniques proposed for efficient hardware implementation of feedforward artificial neural networks (ANNs) under parallel and time-multiplexed architectures. To reduce their design complexity, after the weights…

Hardware Architecture · Computer Science 2021-08-05 Mohammadreza Esmali Nojehdeh , Sajjad Parvin , Mustafa Altun

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-08-29 Xing Wang , Jie Liang

In this paper, we firstly introduce a method to efficiently implement large-scale high-dimensional convolution with realistic memristor-based circuit components. An experiment verified simulator is adapted for accurate prediction of analog…

Neural and Evolutionary Computing · Computer Science 2018-10-05 Fan Zhang , Miao Hu

We suggest a novel methodology to obtain a digital representation of analog signals and to perform its back-conversion using memristive devices. In the proposed converters, the same memristive systems are used for two purposes: as elements…

Instrumentation and Detectors · Physics 2012-07-04 Y. V. Pershin , E. Sazonov , M. Di Ventra

Weight quantization is one of the most important techniques of Deep Neural Networks (DNNs) model compression method. A recent work using systematic framework of DNN weight quantization with the advanced optimization algorithm ADMM…

Machine Learning · Computer Science 2019-05-03 Sheng Lin , Xiaolong Ma , Shaokai Ye , Geng Yuan , Kaisheng Ma , Yanzhi Wang

MobileNet and Binary Neural Networks are two among the most widely used techniques to construct deep learning models for performing a variety of tasks on mobile and embedded platforms.In this paper, we present a simple yet efficient scheme…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Hai Phan , Dang Huynh , Yihui He , Marios Savvides , Zhiqiang Shen

Reducing energy consumption has become a pressing need for modern machine learning, which has achieved many of its most impressive results by scaling to larger and more energy-consumptive neural networks. Unfortunately, the main algorithm…

Machine Learning · Computer Science 2025-07-10 Risi Jaiswal , Supriyo Datta , Joseph G. Makin

Recent advances in neural networks (NNs) exhibit unprecedented success at transforming large, unstructured data streams into compact higher-level semantic information for tasks such as handwriting recognition, image classification, and…

Hardware Architecture · Computer Science 2017-06-09 Vincent T. Lee , Armin Alaghi , John P. Hayes , Visvesh Sathe , Luis Ceze

Analog crossbar arrays comprising programmable nonvolatile resistors are under intense investigation for acceleration of deep neural network training. However, the ubiquitous asymmetric conductance modulation of practical resistive devices…