English
Related papers

Related papers: Efficient Training of the Memristive Deep Belief N…

200 papers

Memristive neural networks (MNNs), which use memristors as neurons or synapses, have become a hot research topic recently. However, most memristors are not compatible with mainstream integrated circuit technology and their stabilities in…

Emerging Technologies · Computer Science 2019-01-03 Zhiri Tang , Ruohua Zhu , Peng Lin , Jin He , Hao Wang , Qijun Huang , Sheng Chang , Qiming Ma

The memristive crossbar aims to implement analog weighted neural network, however, the realistic implementation of such crossbar arrays is not possible due to limited switching states of memristive devices. In this work, we propose the…

Emerging Technologies · Computer Science 2018-08-03 Olga Krestinskaya , Alex Pappachen James

Using memristive properties common for the titanium dioxide thin film devices, we designed a simple write algorithm to tune device conductance at a specific bias point to 1% relative accuracy (which is roughly equivalent to 7-bit precision)…

Materials Science · Physics 2015-05-30 Fabien Alibart , Ligang Gao , Brian Hoskins , Dmitri Strukov

Deep Learning and its applications have gained tremendous interest recently in both academia and industry. Restricted Boltzmann Machines (RBMs) offer a key methodology to implement deep learning paradigms. This paper presents a novel…

Emerging Technologies · Computer Science 2018-01-09 Vivek Parmar , Manan Suri

In this paper, a spintronic neuromorphic reconfigurable Array (SNRA) is developed to fuse together power-efficient probabilistic and in-field programmable deterministic computing during both training and evaluation phases of restricted…

Emerging Technologies · Computer Science 2019-01-09 Ramtin Zand , Ronald F. DeMara

Artificial Neural Network computation relies on intensive vector-matrix multiplications. Recently, the emerging nonvolatile memory (NVM) crossbar array showed a feasibility of implementing such operations with high energy efficiency, thus…

Emerging Technologies · Computer Science 2017-04-03 Hyungjun Kim , Taesu Kim , Jinseok Kim , Jae-Joon Kim

Deep 'Analog Artificial Neural Networks' (ANNs) perform complex classification problems with remarkably high accuracy. However, they rely on humongous amount of power to perform the calculations, veiling the accuracy benefits. The…

Emerging Technologies · Computer Science 2018-04-17 Parami Wijesinghe , Aayush Ankit , Abhronil Sengupta , Kaushik Roy

Deep neural networks are state-of-the-art models for understanding the content of images, video and raw input data. However, implementing a deep neural network in embedded systems is a challenging task, because a typical deep neural…

Machine Learning · Computer Science 2016-04-22 Xichuan Zhou , Shengli Li , Kai Qin , Kunping Li , Fang Tang , Shengdong Hu , Shujun Liu , Zhi Lin

In this paper, deep neural network (DNN) is utilized to improve the belief propagation (BP) detection for massive multiple-input multiple-output (MIMO) systems. A neural network architecture suitable for detection task is firstly introduced…

Signal Processing · Electrical Eng. & Systems 2018-04-06 Xiaosi Tan , Weihong Xu , Yair Be'ery , Zaichen Zhang , Xiaohu You , Chuan Zhang

This paper presents a memristor-based compute-in-memory hardware accelerator for on-chip training and inference, focusing on its accuracy and efficiency against device variations, conductance errors, and input noise. Utilizing realistic…

Neural and Evolutionary Computing · Computer Science 2024-08-28 M. Reza Eslami , Dhiman Biswas , Soheib Takhtardeshir , Sarah S. Sharif , Yaser M. Banad

Analog crossbar architectures for accelerating neural network training and inference have made tremendous progress over the past several years. These architectures are ideal for dense layers with fewer than roughly a thousand neurons.…

Emerging Technologies · Computer Science 2020-03-06 Jack D. Kendall , Ross D. Pantone , Juan C. Nino

The use of Deep Learning hardware algorithms for embedded applications is characterized by challenges such as constraints on device power consumption, availability of labeled data, and limited internet bandwidth for frequent training on…

Machine Learning · Computer Science 2021-02-02 Siqiao Ruan , Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Deep learning has been a successful model which can effectively represent several features of input space and remarkably improve image recognition performance on the deep architectures. In our research, an adaptive structural learning…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Shin Kamada , Takumi Ichimura

It is now widely accepted that memristive devices are perfect candidates for the emulation of biological synapses in neuromorphic systems. This is mainly because of the fact that like the strength of synapse, memristance of the memristive…

Neural and Evolutionary Computing · Computer Science 2012-11-26 Farnood Merrikh-Bayat , Saeed Bagheri Shouraki , Iman Esmaili Paeen Afrakoti

Nowadays, this is very popular to use the deep architectures in machine learning. Deep Belief Networks (DBNs) are deep architectures that use stack of Restricted Boltzmann Machines (RBM) to create a powerful generative model using training…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Mohammad Ali Keyvanrad , Mohammad Mehdi Homayounpour

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

Analog in-memory computing (AIMC) -- a promising approach for energy-efficient acceleration of deep learning workloads -- computes matrix-vector multiplications (MVMs) but only approximately, due to nonidealities that often are…

The operations used for neural network computation map favorably onto simple analog circuits, which outshine their digital counterparts in terms of compactness and efficiency. Nevertheless, such implementations have been largely supplanted…

Neural and Evolutionary Computing · Computer Science 2020-02-24 Jonathan Binas , Daniel Neil , Giacomo Indiveri , Shih-Chii Liu , Michael Pfeiffer

Recently, analog compute-in-memory (CIM) architectures based on emerging analog non-volatile memory (NVM) technologies have been explored for deep neural networks (DNN) to improve energy efficiency. Such architectures, however, leverage…

Signal Processing · Electrical Eng. & Systems 2020-08-07 Zhe Wan , Tianyi Wang , Yiming Zhou , Subramanian S. Iyer , Vwani P. Roychowdhury

Energy-efficient methods are addressed for leveraging low energy barrier nanomagnetic devices within neuromorphic architectures. Using a Magnetoresistive Random Access Memory (MRAM) probabilistic device (p-bit) as the basis of neuronal…

Emerging Technologies · Computer Science 2020-05-06 Hossein Pourmeidani , Punyashloka Debashis , Zhihong Chen , Ronald F. DeMara , Ramtin Zand