English
Related papers

Related papers: To Spike or Not To Spike: A Digital Hardware Persp…

200 papers

The success of deep learning in the past decade is partially shrouded in the shadow of adversarial attacks. In contrast, the brain is far more robust at complex cognitive tasks. Utilizing the advantage that neurons in the brain communicate…

Neurons and Cognition · Quantitative Biology 2023-06-12 Jianhao Ding , Zhaofei Yu , Tiejun Huang , Jian K. Liu

Deep neural networks (DNNs) have demonstrated remarkable performance across various tasks, including image and speech recognition. However, maximizing the effectiveness of DNNs requires meticulous optimization of numerous hyperparameters…

Cryptography and Security · Computer Science 2024-06-14 Gorka Abad , Oguzhan Ersoy , Stjepan Picek , Aitor Urbieta

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs). Two important…

Neural and Evolutionary Computing · Computer Science 2025-01-15 Daniel Windhager , Lothar Ratschbacher , Bernhard A. Moser , Michael Lunglmayr

Benefiting from the event-driven and sparse spiking characteristics of the brain, spiking neural networks (SNNs) are becoming an energy-efficient alternative to artificial neural networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Man Yao , Guangshe Zhao , Hengyu Zhang , Yifan Hu , Lei Deng , Yonghong Tian , Bo Xu , Guoqi Li

Artificial Neural Network (ANN) based techniques have dominated state-of-the-art results in most problems related to computer vision, audio recognition, and natural language processing in the past few years, resulting in strong industrial…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Khaled F. Hussain , Mohamed Yousef Bassyouni , Erol Gelenbe

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Due to the fundamental limit to reducing power consumption of running deep learning models on von-Neumann architecture, research on neuromorphic computing systems based on low-power spiking neural networks using analog neurons is in the…

Neural and Evolutionary Computing · Computer Science 2022-03-03 Hanseok Kim , Woo-Seok Choi

Spiking neural networks (SNNs) have been widely used due to their strong biological interpretability and high energy efficiency. With the introduction of the backpropagation algorithm and surrogate gradient, the structure of spiking neural…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Neuromorphic engineering (NE) encompasses a diverse range of approaches to information processing that are inspired by neurobiological systems, and this feature distinguishes neuromorphic systems from conventional computing systems. The…

Spiking neural networks (SNNs) are potential competitors to artificial neural networks (ANNs) due to their high energy-efficiency on neuromorphic hardware. However, SNNs are unfolded over simulation time steps during the training process.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hong Zhang , Yu Zhang

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking Neural Networks (SNN) are an emerging type of biologically plausible and efficient Artificial Neural Network (ANN). This work presents the development of a hardware accelerator for a SNN for high-performance inference, targeting a…

Neural and Evolutionary Computing · Computer Science 2022-12-20 Alessio Carpegna , Alessandro Savino , Stefano Di Carlo

Spiking neural networks (SNNs), central to computational neuroscience and neuromorphic machine learning (ML), require efficient simulation and gradient-based training. While AI accelerators offer promising speedups, gradient-based SNNs…

Neural and Evolutionary Computing · Computer Science 2025-12-08 Lennart P. L. Landsmeer , Amirreza Movahedin , Said Hamdioui , Christos Strydis

Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from…

Machine Learning · Computer Science 2025-05-29 Chengting Yu , Xiaochen Zhao , Lei Liu , Shu Yang , Gaoang Wang , Erping Li , Aili Wang

Neuromorphic Computing is a nascent research field in which models and devices are designed to process information by emulating biological neural systems. Thanks to their superior energy efficiency, analog neuromorphic systems are highly…

Machine Learning · Computer Science 2019-05-30 Tianlin Liu

Spiking Neural Networks (SNNs) hold promise for energy-efficient, biologically inspired computing. We identify substantial informatio loss during spike transmission, linked to temporal dependencies in traditional Leaky Integrate-and-Fire…

Neural and Evolutionary Computing · Computer Science 2025-02-04 Guobin Shen , Jindong Li , Tenglong Li , Dongcheng Zhao , Yi Zeng

Spiking neural networks (SNNs) have been recently brought to light due to their promising capabilities. SNNs simulate the brain with higher biological plausibility compared to previous generations of neural networks. Learning with fewer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

The energy consumed by running large deep neural networks (DNNs) on hardware accelerators is dominated by the need for lots of fast memory to store both states and weights. This large required memory is currently only economically viable…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Tobi Delbruck , Shih-Chii Liu