English
Related papers

Related papers: Artificial Synapse based on ULTRARAM Memory Device…

200 papers

Neuromorphic architectures, which incorporate parallel and in-memory processing, are crucial for accelerating artificial neural network (ANN) computations. This work presents a novel memristor-based multi-layer neural network (memristive…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapat , Manobendra Nath Mondal , Susmita Sur-Kolay

We demonstrate that extremely low resolution quantized (nominally 5-state) synapses with large stochastic variations in Domain Wall (DW) position can be both energy efficient and achieve reasonably high testing accuracies compared to Deep…

Mesoscale and Nanoscale Physics · Physics 2023-05-18 Walid A. Misba , Mark Lozano , Damien Querlioz , Jayasimha Atulasimha

In-memory computing is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. Crossbar arrays of resistive memory devices can be used to encode the network weights and perform efficient analog…

Neuromorphic computing, inspired by the brain, promises extreme efficiency for certain classes of learning tasks, such as classification and pattern recognition. The performance and power consumption of neuromorphic computing depends…

Emerging Technologies · Computer Science 2018-06-14 Baibhab Chatterjee , Priyadarshini Panda , Shovan Maity , Ayan Biswas , Kaushik Roy , Shreyas Sen

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and…

Hardware Architecture · Computer Science 2021-09-10 Kamilya Smagulova , Mohammed E. Fouda , Fadi Kurdahi , Khaled Salama , Ahmed Eltawil

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently, CapsuleNets have improved the generalization ability, as compared to DNNs, due to their…

Machine Learning · Computer Science 2019-04-15 Alberto Marchisio , Muhammad Abdullah Hanif , Mohammad Taghi Teimoori , Muhammad Shafique

Recently we have shown that an architecture based on resistive processing unit (RPU) devices has potential to achieve significant acceleration in deep neural network (DNN) training compared to today's software-based DNN implementations…

Emerging Technologies · Computer Science 2017-10-27 Seyoung Kim , Tayfun Gokmen , Hyung-Min Lee , Wilfried E. Haensch

In terms of energy efficiency and computational speed, neuromorphic electronics based on non-volatile memory devices is expected to be one of most promising hardware candidates for future artificial intelligence (AI). However, catastrophic…

Neural and Evolutionary Computing · Computer Science 2024-01-29 Lifu Zhang , Ji-An Li , Yang Hu , Jie Jiang , Rongjie Lai , Marcus K. Benna , Jian Shi

We study the performance of stochastically trained deep neural networks (DNNs) whose synaptic weights are implemented using emerging memristive devices that exhibit limited dynamic range, resolution, and variability in their programming…

Machine Learning · Statistics 2017-11-13 Anakha V Babu , Bipin Rajendran

The ability to learn continuously in artificial neural networks (ANNs) is often limited by catastrophic forgetting, a phenomenon in which new knowledge becomes dominant. By taking mechanisms of memory encoding in neuroscience (aka. engrams)…

Machine Learning · Computer Science 2025-03-28 Isabelle Aguilar , Luis Fernando Herbozo Contreras , Omid Kavehei

We present artificial neural network design using spin devices that achieves ultra low voltage operation, low power consumption, high speed, and high integration density. We employ spin torque switched nano-magnets for modelling neuron and…

Disordered Systems and Neural Networks · Physics 2012-08-16 Mrigank Sharad , Charles Augustine , Georgios Panagopoulos , Kaushik Roy

The first contribution of this paper is the development of extremely dense, energy-efficient mixed-signal vector-by-matrix-multiplication (VMM) circuits based on the existing 3D-NAND flash memory blocks, without any need for their…

Emerging Technologies · Computer Science 2019-08-08 Mohammad Bavandpour , Shubham Sahay , Mohammad Reza Mahmoodi , Dmitri B. Strukov

The superior density of passive analog-grade memristive crossbars may enable storing large synaptic weight matrices directly on specialized neuromorphic chips, thus avoiding costly off-chip communication. To ensure efficient use of such…

Emerging Technologies · Computer Science 2019-07-01 Hyungjin Kim , Hussein Nili , Mahmood Mahmoodi , Dmitri Strukov

Deep learning has made remarkable progress in various tasks, surpassing human performance in some cases. However, one drawback of neural networks is catastrophic forgetting, where a network trained on one task forgets the solution when…

Neural and Evolutionary Computing · Computer Science 2024-01-04 Simone D'Agostino , Filippo Moro , Tifenn Hirtzlin , Julien Arcamone , Niccolò Castellani , Damien Querlioz , Melika Payvand , Elisa Vianello

Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as "neuromorphic engineering". However, analog circuits are sensitive to process-induced variation among…

Machine Learning · Computer Science 2022-09-13 Julian Büchel , Dmitrii Zendrikov , Sergio Solinas , Giacomo Indiveri , Dylan R. Muir

Emerging nanodevices such as resistive memories are being considered for hardware realizations of a variety of artificial neural networks (ANNs), including highly promising online variants of the learning approaches known as reservoir…

Neural and Evolutionary Computing · Computer Science 2017-09-13 Christopher H. Bennett , Damien Querlioz , Jacques-Olivier Klein

Neural Networks (NN), although successfully applied to several Artificial Intelligence tasks, are often unnecessarily over-parametrised. In edge/fog computing, this might make their training prohibitive on resource-constrained devices,…

Machine Learning · Computer Science 2022-01-20 Lorenzo Valerio , Franco Maria Nardini , Andrea Passarella , Raffaele Perego

Compute In-Memory platforms such as memristive crossbars are gaining focus as they facilitate acceleration of Deep Neural Networks (DNNs) with high area and compute-efficiencies. However, the intrinsic non-idealities associated with the…

Machine Learning · Computer Science 2023-04-18 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

With a growing need to enable intelligence in embedded devices in the Internet of Things (IoT) era, secure hardware implementation of Deep Neural Networks (DNNs) has become imperative. We will focus on how to address adversarial robustness…

Machine Learning · Computer Science 2021-09-08 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Architectures that incorporate Computing-in-Memory (CiM) using emerging non-volatile memory (NVM) devices have become strong contenders for deep neural network (DNN) acceleration due to their impressive energy efficiency. Yet, a significant…

Hardware Architecture · Computer Science 2024-01-12 Zheyu Yan , Xiaobo Sharon Hu , Yiyu Shi