English
Related papers

Related papers: Revisiting Direct Encoding: Learnable Temporal Dyn…

200 papers

Compared with rate-based artificial neural networks, Spiking Neural Networks (SNN) provide a more biological plausible model for the brain. But how they perform supervised learning remains elusive. Inspired by recent works of Bengio et al.,…

Neural and Evolutionary Computing · Computer Science 2022-03-08 Zhanhao Hu , Tao Wang , Xiaolin Hu

Neuromorphic computing systems are set to revolutionize energy-constrained robotics by achieving orders-of-magnitude efficiency gains, while enabling native temporal processing. Spiking Neural Networks (SNNs) represent a promising…

Artificial Intelligence · Computer Science 2025-10-29 Korneel Van den Berghe , Stein Stroobants , Vijay Janapa Reddi , G. C. H. E. de Croon

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Spiking Neural Networks (SNNs) have incorporated more biologically-plausible structures and learning principles, hence are playing critical roles in bridging the gap between artificial and natural neural networks. The spikes are the sparse…

Neural and Evolutionary Computing · Computer Science 2020-10-08 Xiang Cheng , Tielin Zhang , Shuncheng Jia , Bo Xu

Recent Spiking Neural Networks (SNNs) works focus on an image classification task, therefore various coding techniques have been proposed to convert an image into temporal binary spikes. Among them, rate coding and direct coding are…

Neural and Evolutionary Computing · Computer Science 2022-04-13 Youngeun Kim , Hyoungseob Park , Abhishek Moitra , Abhiroop Bhattacharjee , Yeshwanth Venkatesha , Priyadarshini Panda

A vast majority of spiking neural networks (SNNs) are trained based on inductive biases that are not necessarily a good fit for several critical tasks that require low-latency and power efficiency. Inferring brain behavior based on the…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Xi Chen , Siwei Mai , Konstantinos Michmizos

We introduce a new way of learning to encode position information for non-recurrent models, such as Transformer models. Unlike RNN and LSTM, which contain inductive bias by loading the input tokens sequentially, non-recurrent models are…

Machine Learning · Computer Science 2020-03-23 Xuanqing Liu , Hsiang-Fu Yu , Inderjit Dhillon , Cho-Jui Hsieh

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Kakei Yamamoto , Yusuke Sakemi , Kazuyuki Aihara

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, offer a distinctive approach for capturing the complexities of temporal data. However, their potential for spatial modeling in multivariate time-series…

Machine Learning · Computer Science 2025-08-19 Bang Hu , Changze Lv , Mingjie Li , Yunpeng Liu , Xiaoqing Zheng , Fengzhe Zhang , Wei cao , Fan Zhang

Spiking Neural Networks (SNN) are the so-called third generation of neural networks which attempt to more closely match the functioning of the biological brain. They inherently encode temporal data, allowing for training with less energy…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Chethan M. Parameshwara , Simin Li , Cornelia Fermüller , Nitin J. Sanket , Matthew S. Evanusa , Yiannis Aloimonos

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking neural networks (SNNs), known for their low-power, event-driven computation and intrinsic temporal dynamics, are emerging as promising solutions for processing dynamic, asynchronous signals from event-based sensors. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Rui Zhang , Luziwei Leng , Kaiwei Che , Hu Zhang , Jie Cheng , Qinghai Guo , Jiangxing Liao , Ran Cheng

The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominent energy-efficient…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Seongsik Park , Sungroh Yoon

Video analysis is a major computer vision task that has received a lot of attention in recent years. The current state-of-the-art performance for video analysis is achieved with Deep Neural Networks (DNNs) that have high computational costs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

Hardware-based spiking neural networks (SNNs) are regarded as promising candidates for the cognitive computing system due to low power consumption and highly parallel operation. In this work, we train the SNN in which the firing time…

Neural and Evolutionary Computing · Computer Science 2022-03-17 Seongbin Oh , Dongseok Kwon , Gyuho Yeom , Won-Mook Kang , Soochang Lee , Sung Yun Woo , Jang Saeng Kim , Min Kyu Park , Jong-Ho Lee

Recent years have seen significant progress in developing spiking neural networks (SNNs) as a potential solution to the energy challenges posed by conventional artificial neural networks (ANNs). However, our theoretical understanding of…

Machine Learning · Computer Science 2025-06-16 Duc Anh Nguyen , Ernesto Araya , Adalbert Fono , Gitta Kutyniok

The human brain utilizes spikes for information transmission and dynamically reorganizes its network structure to boost energy efficiency and cognitive capabilities throughout its lifespan. Drawing inspiration from this spike-based…

Human-Computer Interaction · Computer Science 2025-02-20 Jiangrong Shen , Qi Xu , Gang Pan , Badong Chen

We present a Spiking Neural Network (SNN) model that incorporates learnable synaptic delays through two approaches: per-synapse delay learning via Dilated Convolutions with Learnable Spacings (DCLS) and a dynamic pruning strategy that also…

Neural and Evolutionary Computing · Computer Science 2024-11-11 Balázs Mészáros , James Knight , Thomas Nowotny

Spiking neural networks are biologically plausible counterparts of the artificial neural networks, artificial neural networks are usually trained with stochastic gradient descent and spiking neural networks are trained with spike timing…

Neural and Evolutionary Computing · Computer Science 2019-09-26 Ruthvik Vaila , John Chiasson , Vishal Saxena

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin