English
Related papers

Related papers: Examining the Role and Limits of Batchnorm Optimiz…

200 papers

Deep Neural Networks (DNNs) have been shown to be prone to adversarial attacks. Memristive crossbars, being able to perform Matrix-Vector-Multiplications (MVMs) efficiently, are used to realize DNNs on hardware. However, crossbar…

Emerging Technologies · Computer Science 2021-04-29 Abhiroop Bhattacharjee , Priyadarshini Panda

Large-scale deep learning models are increasingly constrained by their immense energy consumption, limiting their scalability and applicability for edge intelligence. In-memory computing (IMC) offers a promising solution by addressing the…

Machine Learning · Computer Science 2025-03-24 Yusuke Sakemi , Yuji Okamoto , Takashi Morie , Sou Nobukawa , Takeo Hosomi , Kazuyuki Aihara

With a growing need to enable intelligence in embedded devices in the Internet of Things (IoT) era, secure hardware implementation of Deep Neural Networks (DNNs) has become imperative. We will focus on how to address adversarial robustness…

Machine Learning · Computer Science 2021-09-08 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Conventional in-memory computing (IMC) architectures consist of analog memristive crossbars to accelerate matrix-vector multiplication (MVM), and digital functional units to realize nonlinear vector (NLV) operations in deep neural networks…

Machine Learning · Computer Science 2022-11-02 Md Hasibul Amin , Mohammed Elbtity , Ramtin Zand

Resistive crossbars designed with non-volatile memory devices have emerged as promising building blocks for Deep Neural Network (DNN) hardware, due to their ability to compactly and efficiently realize vector-matrix multiplication (VMM),…

Emerging Technologies · Computer Science 2020-06-03 Shubham Jain , Abhronil Sengupta , Kaushik Roy , Anand Raghunathan

The increasing computational demand of Deep Learning has propelled research in special-purpose inference accelerators based on emerging non-volatile memory (NVM) technologies. Such NVM crossbars promise fast and energy-efficient in-situ…

Emerging Technologies · Computer Science 2021-03-17 Deboleena Roy , Indranil Chakraborty , Timur Ibrayev , Kaushik Roy

A trend towards energy-efficiency, security and privacy has led to a recent focus on deploying DNNs on microcontrollers. However, limits on compute and memory resources restrict the size and the complexity of the ML models deployable in…

Machine Learning · Computer Science 2020-10-19 Fernando García-Redondo , Shidhartha Das , Glen Rosendale

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Resistive crossbars have attracted significant interest in the design of Deep Neural Network (DNN) accelerators due to their ability to natively execute massively parallel vector-matrix multiplications within dense memory arrays. However,…

Machine Learning · Computer Science 2021-01-11 Sourjya Roy , Shrihari Sridharan , Shubham Jain , Anand Raghunathan

Analog in-memory computing (AIMC) -- a promising approach for energy-efficient acceleration of deep learning workloads -- computes matrix-vector multiplications (MVMs) but only approximately, due to nonidealities that often are…

Compute In-Memory platforms such as memristive crossbars are gaining focus as they facilitate acceleration of Deep Neural Networks (DNNs) with high area and compute-efficiencies. However, the intrinsic non-idealities associated with the…

Machine Learning · Computer Science 2023-04-18 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Recently several structured pruning techniques have been introduced for energy-efficient implementation of Deep Neural Networks (DNNs) with lesser number of crossbars. Although, these techniques have claimed to preserve the accuracy of the…

Machine Learning · Computer Science 2022-01-17 Abhiroop Bhattacharjee , Lakshya Bhatnagar , Priyadarshini Panda

Analog In-Memory Compute (AIMC) can improve the energy efficiency of Deep Learning by orders of magnitude. Yet analog-domain device and circuit non-idealities -- within the analog ``Tiles'' performing Matrix-Vector Multiply (MVM) operations…

Hardware Architecture · Computer Science 2025-06-03 J. Luquin , C. Mackin , S. Ambrogio , A. Chen , F. Baldi , G. Miralles , M. J. Rasch , J. Büchel , M. Lalwani , W. Ponghiran , P. Solomon , H. Tsai , G. W. Burr , P. Narayanan

Leveraging the high density and energy efficiency of Compute-In-Memory (CIM) crossbar-based Deep Neural Network (DNN) accelerators requires optimal Design Space Exploration (DSE), which becomes increasingly challenging as complex models for…

Emerging Technologies · Computer Science 2026-05-12 Arnob Saha , Bibhas Manna , Nikhil Kotikalapudi , Md Zesun Ahmed Mia , Rahul Kumar , Madhavan Swaminathan , Abhronil Sengupta

Compute-in-memory (CiM)-based binary neural network (CiM-BNN) accelerators marry the benefits of CiM and ultra-low precision quantization, making them highly suitable for edge computing. However, CiM-enabled crossbar (Xbar) arrays are…

Hardware Architecture · Computer Science 2024-12-05 Akul Malhotra , Sumeet Kumar Gupta

Deep learning has proved successful in many applications but suffers from high computational demands and requires custom accelerators for deployment. Crossbar-based analog in-memory architectures are attractive for acceleration of deep…

Emerging Technologies · Computer Science 2024-03-21 Timur Ibrayev , Isha Garg , Indranil Chakraborty , Kaushik Roy

In-Memory Computing (IMC) hardware using Memristive Crossbar Arrays (MCAs) are gaining popularity to accelerate Deep Neural Networks (DNNs) since it alleviates the "memory wall" problem associated with von-Neumann architecture. The hardware…

Emerging Technologies · Computer Science 2021-06-24 Shubham Negi , Indranil Chakraborty , Aayush Ankit , Kaushik Roy

Recent years have seen a rapid rise of artificial neural networks being employed in a number of cognitive tasks. The ever-increasing computing requirements of these structures have contributed to a desire for novel technologies and…

Emerging Technologies · Computer Science 2022-05-06 Dovydas Joksas , Erwei Wang , Nikolaos Barmpatsalos , Wing H. Ng , Anthony J. Kenyon , George A. Constantinides , Adnan Mehonic

Manhattan Distance Mapping (MDM) is a post-training deep neural network (DNN) weight mapping technique for memristive bit-sliced compute-in-memory (CIM) crossbars that reduces parasitic resistance (PR) nonidealities. PR limits crossbar…

Hardware Architecture · Computer Science 2025-11-10 Matheus Farias , Wanghley Martins , H. T. Kung

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

Emerging Technologies · Computer Science 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang
‹ Prev 1 2 3 10 Next ›