English
Related papers

Related papers: Surrogates, Spikes, and Sparsity: Performance Anal…

200 papers

Event-based cameras have recently shown great potential for high-speed motion estimation owing to their ability to capture temporally rich information asynchronously. Spiking Neural Networks (SNNs), with their neuro-inspired event-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Adarsh Kumar Kosta , Kaushik Roy

Foundational models based on the transformer architecture are currently the state-of-the-art in general language modeling, as well as in scientific areas such as material science and climate. However, training and deploying these models is…

Machine Learning · Computer Science 2025-10-16 Adarsha Balaji , Sandeep Madireddy , Prasanna Balaprakash

Deep Neural Networks (DNNs) are the current state-of-the-art models in many speech related tasks. There is a growing interest, though, for more biologically realistic, hardware friendly and energy efficient models, named Spiking Neural…

Machine Learning · Computer Science 2020-11-16 Thomas Pellegrini , Romain Zimmer , Timothée Masquelier

The computational demands of modern Deep Neural Networks (DNNs) are immense and constantly growing. While training costs usually capture public attention, inference demands are also contributing in significant computational, energy and…

Spiking Neural Networks (SNNs) are efficient computation models to perform spatio-temporal pattern recognition on {resource}- and {power}-constrained platforms. SNNs executed on neuromorphic hardware can further reduce energy consumption of…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Adarsha Balaji , Anup Das

Implantable Brain-machine interfaces (BMIs) are promising for motor rehabilitation and mobility augmentation, and they demand accurate and energy-efficient algorithms. In this paper, we propose a novel spiking neural network (SNN) decoder…

Signal Processing · Electrical Eng. & Systems 2024-05-06 Jiawei Liao , Oscar Toomey , Xiaying Wang , Lars Widmer , Cynthia A. Chestek , Luca Benini , Taekwang Jang

Spiking Neural Networks (SNNs) have gained significant attention due to the energy-efficient and multiplication-free characteristics. Despite these advantages, deploying large-scale SNNs on edge hardware is challenging due to limited…

Neural and Evolutionary Computing · Computer Science 2024-11-22 Shuo Chen , Boxiao Liu , Zeshi Liu , Haihang You

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

The surrogate gradient descent algorithm enabled spiking neural networks to be trained to carry out challenging sensory processing tasks, an important step in understanding how spikes contribute to neural computations. However, it is…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Ziqiao Yu , Pengfei Sun , Danyal Akarca , Dan F. M. Goodman

Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low…

Neural and Evolutionary Computing · Computer Science 2020-02-05 Mihaela Dimovska , Travis Johnston , Catherine D. Schuman , J. Parker Mitchell , Thomas E. Potok

Spiking neural networks (SNNs) have emerged as a class of bio -inspired networks that leverage sparse, event-driven signaling to achieve low-power computation while inherently modeling temporal dynamics. Such characteristics align closely…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Hemanth Sabbella , Archit Mukherjee , Thivya Kandappu , Sounak Dey , Arpan Pal , Archan Misra , Dong Ma

There exists a significant scale gap between photonic neural network integrated chips and neural networks, which hinders the deployment and application of photonic neural network. Here, we propose hardware-aware lightweight spiking neural…

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Spiking neural network (SNN) is a biologically-plausible model and exhibits advantages of high computational capability and low power consumption. While the training of deep SNN is still an open problem, which limits the real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shuiying Xiang , Tao Zhang , Shuqing Jiang , Yanan Han , Yahui Zhang , Chenyang Du , Xingxing Guo , Licun Yu , Yuechun Shi , Yue Hao

Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first,…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Feifan Zhou , Xiang Wei , Yang Liu , Qiang Yu

Neuromorphic Computing (NC) and Spiking Neural Networks (SNNs) in particular are often viewed as the next generation of Neural Networks (NNs). NC is a novel bio-inspired paradigm for energy efficient neural computation, often relying on…

Robotics · Computer Science 2024-09-18 Andreas Ziegler , Karl Vetter , Thomas Gossard , Jonas Tebbe , Sebastian Otte , Andreas Zell

Spike train classification has recently become an important topic in the machine learning community, where each spike train is a binary event sequence with \emph{temporal-sparsity of signals of interest} and \emph{temporal-noise}…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Hang Yin , Yao Su , Liping Liu , Thomas Hartvigsen , Xin Dai , Xiangnan Kong

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon