English
Related papers

Related papers: Gradient-descent hardware-aware training and deplo…

200 papers

Spiking neural network (SNN) is studied in multidisciplinary domains to (i) enable order-of-magnitudes energy-efficient AI inference and (ii) computationally simulate neuro-scientific mechanisms. The lack of discrete theory obstructs the…

Neural and Evolutionary Computing · Computer Science 2024-07-03 Hyunseok Oh , Youngki Lee

Spintronic nano-neurons offer a promising route towards energy-efficient, high-performance hardware neural networks thanks to their inherent low-input nonlinear dynamics. However, training such networks remains a major bottleneck as it…

Brain-inspired spiking neural networks (SNNs) have recently drawn more and more attention due to their event-driven and energy-efficient characteristics. The integration of storage and computation paradigm on neuromorphic hardwares makes…

Neural and Evolutionary Computing · Computer Science 2022-10-14 Yufei Guo , Liwen Zhang , Yuanpei Chen , Xinyi Tong , Xiaode Liu , YingLei Wang , Xuhui Huang , Zhe Ma

Recent breakthroughs in neuromorphic computing show that local forms of gradient descent learning are compatible with Spiking Neural Networks (SNNs) and synaptic plasticity. Although SNNs can be scalably implemented using neuromorphic VLSI,…

Neural and Evolutionary Computing · Computer Science 2020-11-24 Melika Payvand , Mohammed E. Fouda , Fadi Kurdahi , Ahmed M. Eltawil , Emre O. Neftci

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Spiking Neural Networks(SNNs) provide a brain-inspired and event-driven mechanism that is believed to be critical to unlock energy-efficient deep learning. The mixture-of-experts approach mirrors the parallel distributed processing of…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Boxun Xu , Junyoung Hwang , Pruek Vanna-iampikul , Yuxuan Yin , Sung Kyu Lim , Peng Li

Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low…

Neural and Evolutionary Computing · Computer Science 2020-02-05 Mihaela Dimovska , Travis Johnston , Catherine D. Schuman , J. Parker Mitchell , Thomas E. Potok

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

Spiking Neural Networks (SNNs) offer a biologically plausible framework for energy-efficient neuromorphic computing. However, it is a challenge to train SNNs due to their non-differentiability, efficiently. Existing gradient approximation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Changqing Xu , Ziqiang Yang , Yi Liu , Xinfang Liao , Guiqi Mo , Hao Zeng , Yintang Yang

Configurable synaptic delays are a basic feature in many neuromorphic neural network hardware accelerators. However, they have been rarely used in model implementations, despite their promising impact on performance and efficiency in tasks…

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

Inspired by biological processes, neuromorphic computing leverages spiking neural networks (SNNs) to perform inference tasks, offering significant efficiency gains for workloads involving sequential data. Recent advances in hardware and…

Machine Learning · Computer Science 2025-04-30 Dengyu Wu , Jiechen Chen , Bipin Rajendran , H. Vincent Poor , Osvaldo Simeone

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN need to be trained by…

Neural and Evolutionary Computing · Computer Science 2021-10-28 Guangzhi Tang , Neelesh Kumar , Ioannis Polykretis , Konstantinos P. Michmizos

Intracortical brain-machine interfaces demand low-latency, energy-efficient solutions for neural decoding. Spiking Neural Networks (SNNs) deployed on neuromorphic hardware have demonstrated remarkable efficiency in neural decoding by…

Neural and Evolutionary Computing · Computer Science 2025-04-17 Francesca Rivelli , Martin Popov , Charalampos S. Kouzinopoulos , Guangzhi Tang

Spiking Neural Networks (SNNs) have emerged as a hardware efficient architecture for classification tasks. The challenge of spike-based encoding has been the lack of a universal training mechanism performed entirely using spikes. There have…

Neural and Evolutionary Computing · Computer Science 2023-08-25 Anmol Biswas , Vivek Saraswat , Udayan Ganguly

Low-latency deep spiking neural networks (SNNs) have become a promising alternative to conventional artificial neural networks (ANNs) because of their potential for increased energy efficiency on event-driven neuromorphic hardware. Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Souvik Kundu , Massoud Pedram , Peter A. Beerel

Neuromorphic computing aims to replicate the brain's capabilities for energy efficient and parallel information processing, promising a solution to the increasing demand for faster and more efficient computational systems. Efficient…

Neural and Evolutionary Computing · Computer Science 2025-03-20 Gabriel Béna , Timo Wunderlich , Mahmoud Akl , Bernhard Vogginger , Christian Mayr , Hector Andres Gonzalez

Bio-inspired neuromorphic hardware is a research direction to approach brain's computational power and energy efficiency. Spiking neural networks (SNN) encode information as sparsely distributed spike trains and employ…

Emerging Technologies · Computer Science 2018-10-23 Haowem Fang , Amar Shrestha , De Ma , Qinru Qiu