English
Related papers

Related papers: Using Floating Gate Memory to Train Ideal Accuracy…

200 papers

Neuromorphic Multiply-And-Accumulate (MAC) circuits utilizing synaptic weight elements based on SRAM or novel Non-Volatile Memories (NVMs) provide a promising approach for highly efficient hardware representations of neural networks. NVM…

Emerging Technologies · Computer Science 2018-09-14 Borna Obradovic , Titash Rakshit , Ryan Hatcher , Jorge A. Kittl , Mark S. Rodder

Spiking Transformers have gained considerable attention because they achieve both the energy efficiency of Spiking Neural Networks (SNNs) and the high capacity of Transformers. However, the existing Spiking Transformer architectures,…

Neural and Evolutionary Computing · Computer Science 2023-12-15 Ziqing Wang , Qidong Zhao , Jinku Cui , Xu Liu , Dongkuan Xu

As neural networks are increasingly deployed in dynamic environments, they face the challenge of catastrophic forgetting, the tendency to overwrite previously learned knowledge when adapting to new tasks, resulting in severe performance…

Machine Learning · Computer Science 2026-03-31 Anika Singh , Aayush Dhaulakhandi , Varun Chopade , Likhith Malipati , David Martinez , Kevin Zhu

Compute-in-memory (CIM) accelerators for spiking neural networks (SNNs) are promising solutions to enable $\mu$s-level inference latency and ultra-low energy in edge vision applications. Yet, their current lack of flexibility at both the…

Hardware Architecture · Computer Science 2024-10-31 Nicolas Chauvaux , Adrian Kneip , Christoph Posch , Kofi Makinwa , Charlotte Frenkel

Hardware-based spiking neural networks (SNNs) are regarded as promising candidates for the cognitive computing system due to low power consumption and highly parallel operation. In this work, we train the SNN in which the firing time…

Neural and Evolutionary Computing · Computer Science 2022-03-17 Seongbin Oh , Dongseok Kwon , Gyuho Yeom , Won-Mook Kang , Soochang Lee , Sung Yun Woo , Jang Saeng Kim , Min Kyu Park , Jong-Ho Lee

This paper presents an implementation of multilayer feed forward neural networks (NN) to optimize CMOS analog circuits. For modeling and design recently neural network computational modules have got acceptance as an unorthodox and useful…

Neural and Evolutionary Computing · Computer Science 2012-12-13 Mriganka Chakraborty

Sparse neural networks can greatly facilitate the deployment of neural networks on resource-constrained platforms as they offer compact model sizes while retaining inference accuracy. Because of the sparsity in parameter matrices, sparse…

Machine Learning · Computer Science 2021-09-10 Febin Sunny , Mahdi Nikdast , Sudeep Pasricha

Recent years have seen a rapid rise of artificial neural networks being employed in a number of cognitive tasks. The ever-increasing computing requirements of these structures have contributed to a desire for novel technologies and…

Emerging Technologies · Computer Science 2022-05-06 Dovydas Joksas , Erwei Wang , Nikolaos Barmpatsalos , Wing H. Ng , Anthony J. Kenyon , George A. Constantinides , Adnan Mehonic

This paper presents a memristor-based compute-in-memory hardware accelerator for on-chip training and inference, focusing on its accuracy and efficiency against device variations, conductance errors, and input noise. Utilizing realistic…

Neural and Evolutionary Computing · Computer Science 2024-08-28 M. Reza Eslami , Dhiman Biswas , Soheib Takhtardeshir , Sarah S. Sharif , Yaser M. Banad

The rapid advancement of wireless communication technologies, including 5G, emerging 6G networks, and the large-scale deployment of the Internet of Things (IoT), has intensified the need for efficient spectrum utilization. Automatic…

Hardware Architecture · Computer Science 2026-01-07 Kuilian Yang , Li Zhang , Ahmed M. Eltawil , Khaled Nabil Salama

The advanced nanoscale integration available in silicon complementary metal-oxide-semiconductor (CMOS) technology provides a key motivation for its use in spin-based quantum computing applications. Initial demonstrations of quantum dot…

With the development of hardware-optimized deployment of spiking neural networks (SNNs), SNN processors based on field-programmable gate arrays (FPGAs) have become a research hotspot due to their efficiency and flexibility. However,…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Hou Yue , Xiang Shuiying , Zou Tao , Huang Zhiquan , Shi Shangxuan , Guo Xingxing , Zhang Yahui , Zheng Ling , Hao Yue

With the growing demand for intelligent computing, neuromorphic computing, a paradigm that mimics the structure and functionality of the human brain, offers a promising approach to developing new high-efficiency intelligent computing…

Hardware Architecture · Computer Science 2025-06-06 Yunhao Ma , Wanyi Jia , Yanyu Lin , Wenjie Lin , Xueke Zhu , Huihui Zhou , Fengwei An

As a result of the increasing demand for deep neural network (DNN)-based services, efforts to develop dedicated hardware accelerators for DNNs are growing rapidly. However,while accelerators with high performance and efficiency on…

Neural and Evolutionary Computing · Computer Science 2018-03-26 Sung Kim , Patrick Howe , Thierry Moreau , Armin Alaghi , Luis Ceze , Visvesh Sathe

Quantization based on the binary codes is gaining attention because each quantized bit can be directly utilized for computations without dequantization using look-up tables. Previous attempts, however, only allow for integer numbers of…

Machine Learning · Computer Science 2020-10-23 Dongsoo Lee , Se Jung Kwon , Byeongwook Kim , Yongkweon Jeon , Baeseong Park , Jeongin Yun

In this work, we propose "TimeFloats," an efficient train-in-memory architecture that performs 8-bit floating-point scalar product operations in the time domain. While building on the compute-in-memory paradigm's integrated storage and…

Hardware Architecture · Computer Science 2024-11-27 Maeesha Binte Hashem , Benjamin Parpillon , Divake Kumar , Dinithi Jayasuria , Amit Ranjan Trivedi

As deep neural networks (DNNs) grow to solve increasingly complex problems, they are becoming limited by the latency and power consumption of existing digital processors. For improved speed and energy efficiency, specialized analog optical…

Emerging Technologies · Computer Science 2022-06-24 Liane Bernstein , Alexander Sludds , Christopher Panuski , Sivan Trajtenberg-Mills , Ryan Hamerly , Dirk Englund

In order to port the performance of trained artificial neural networks (ANNs) to spiking neural networks (SNNs), which can be implemented in neuromorphic hardware with a drastically reduced energy consumption, an efficient ANN to SNN…

Neural and Evolutionary Computing · Computer Science 2020-01-22 Christoph Stöckl , Wolfgang Maass

Mixed-signal artificial neural networks (ANNs) that employ analog matrix-multiplication accelerators can achieve higher speed and improved power efficiency. Though analog computing is known to be susceptible to noise and device…

Signal Processing · Electrical Eng. & Systems 2021-07-01 Joseph Ulseth , Zheyuan Zhu , Guifang Li , Shuo Pang

Reduced precision computation for deep neural networks is one of the key areas addressing the widening compute gap driven by an exponential growth in model size. In recent years, deep learning training has largely migrated to 16-bit…

Machine Learning · Computer Science 2019-05-30 Naveen Mellempudi , Sudarshan Srinivasan , Dipankar Das , Bharat Kaul