English
Related papers

Related papers: Enhancing the Performance of Transformer-based Spi…

200 papers

Nowadays deep learning is dominating the field of machine learning with state-of-the-art performance in various application areas. Recently, spiking neural networks (SNNs) have been attracting a great deal of attention, notably owning to…

Machine Learning · Computer Science 2019-02-28 Seongsik Park , Sang-gil Lee , Hyunha Nam , Sungroh Yoon

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

We present a fully memristive spiking neural network (MSNN) consisting of novel memristive neurons trained using the backpropagation through time (BPTT) learning rule. Gradient descent is applied directly to the memristive…

Neural and Evolutionary Computing · Computer Science 2022-03-11 Peng Zhou , Jason K. Eshraghian , Dong-Uk Choi , Sung-Mo Kang

Spiking Neural Networks (SNNs) use spatio-temporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation. Motivated by…

Neural and Evolutionary Computing · Computer Science 2020-11-05 Malu Zhang , Jiadong Wang , Burin Amornpaisannon , Zhixuan Zhang , VPK Miriyala , Ammar Belatreche , Hong Qu , Jibin Wu , Yansong Chua , Trevor E. Carlson , Haizhou Li

Most deep network methods for compressive sensing reconstruction suffer from the black-box characteristic of DNN. In this paper, a deep neural network with interpretable motion estimation named CSMCNet is proposed. The network is able to…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Bowen Huang , Xiao Yan , Jinjia Zhou , Yibo Fan

Spiking Neural Networks (SNNs) are a biologically plausible neural network model with significant advantages in both event-driven processing and spatio-temporal information processing, rendering SNNs an appealing choice for energyefficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jilong Luo , Shanlin Xiao , Yinsheng Chen , Zhiyi Yu

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Spiking neural network (SNN) is a biologically-plausible model and exhibits advantages of high computational capability and low power consumption. While the training of deep SNN is still an open problem, which limits the real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shuiying Xiang , Tao Zhang , Shuqing Jiang , Yanan Han , Yahui Zhang , Chenyang Du , Xingxing Guo , Licun Yu , Yuechun Shi , Yue Hao

Advancements in adapting deep convolution architectures for Spiking Neural Networks (SNNs) have significantly enhanced image classification performance and reduced computational burdens. However, the inability of Multiplication-Free…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Boyan Li , Luziwei Leng , Shuaijie Shen , Kaixuan Zhang , Jianguo Zhang , Jianxing Liao , Ran Cheng

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Yang Li , Yi Zeng

Spiking Neural Networks (SNNs) offer notable advantages in biological plausibility and energy efficiency, making them promising candidates for building low-power Transformers. However, existing Spiking Transformers largely adhere to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zequan Xie , Weiming Zeng , Yunhua Chen , Sichang Ling , Tongyang Chen , Jinsheng Xiao

In recent years, deep learning has been a revolution in the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained in a supervised manner using…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Amirhossein Tavanaei , Masoud Ghodrati , Saeed Reza Kheradpisheh , Timothee Masquelier , Anthony S. Maida

Spiking Neural Networks (SNNs) have attracted the attention of the deep learning community for use in low-latency, low-power neuromorphic hardware, as well as models for understanding neuroscience. In this paper, we introduce Spiking Phasor…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Connor Bybee , E. Paxon Frady , Friedrich T. Sommer

Spiking neural networks (SNNs) have received significant attention for their biological plausibility. SNNs theoretically have at least the same computational power as traditional artificial neural networks (ANNs). They possess potential of…

Neural and Evolutionary Computing · Computer Science 2020-06-04 Yangfan Hu , Huajin Tang , Gang Pan

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but incur substantial computational overhead and energy consumption during inference, limiting deployment in resource-constrained environments. Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Han Xu , Zhiyong Qin , Di Shang , Jiahong Zhang , Xuerui Qiu , Bo Lei , Tiejun Huang , Bo Xu , Guoqi Li

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking neural networks (SNN) have recently emerged as alternatives to traditional neural networks, owing to energy efficiency benefits and capacity to better capture biological neuronal mechanisms. However, the classic backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Jane H. Lee , Saeid Haghighatshoar , Amin Karbasi

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng