English
Related papers

Related papers: SpikCommander: A High-performance Spiking Transfor…

200 papers

Recent advancements in neuroscience research have propelled the development of Spiking Neural Networks (SNNs), which not only have the potential to further advance neuroscience research but also serve as an energy-efficient alternative to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yimeng Shan , Malu Zhang , Rui-jie Zhu , Xuerui Qiu , Jason K. Eshraghian , Haicheng Qu

The combination of Spiking Neural Networks (SNNs) and Vision Transformers (ViTs) holds potential for achieving both energy efficiency and high performance, particularly suitable for edge vision applications. However, a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Shuai Wang , Malu Zhang , Dehao Zhang , Ammar Belatreche , Yichen Xiao , Yu Liang , Yimeng Shan , Qian Sun , Enqi Zhang , Yang Yang

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

Spiking neural networks (SNNs) provide an energy-efficient solution by utilizing the spike-based and sparse nature of biological systems. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on long…

Neural and Evolutionary Computing · Computer Science 2024-10-24 Yan Zhong , Ruoyu Zhao , Chao Wang , Qinghai Guo , Jianguo Zhang , Zhichao Lu , Luziwei Leng

How to effectively and efficiently deal with spatio-temporal event streams, where the events are generally sparse and non-uniform and have the microsecond temporal resolution, is of great value and has various real-life applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Man Yao , Huanhuan Gao , Guangshe Zhao , Dingheng Wang , Yihan Lin , Zhaoxu Yang , Guoqi Li

Efficient parallel computing has become a pivotal element in advancing artificial intelligence. Yet, the deployment of Spiking Neural Networks (SNNs) in this domain is hampered by their inherent sequential computational dependency. This…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Yang Li , Yinqian Sun , Xiang He , Yiting Dong , Dongcheng Zhao , Yi Zeng

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they often come with a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Xiang Hao , Chenxiang Ma , Qu Yang , Jibin Wu , Kay Chen Tan

Spiking neural networks (SNNs) are emerging as a promising alternative to traditional artificial neural networks (ANNs), offering biological plausibility and energy efficiency. Despite these merits, SNNs are frequently hampered by limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Wenke Huang , Qiang Zhang , Tingting Zheng , Chia-Wen Lin , Liangpei Zhang

Event-based vision sensors provide significant advantages for high-speed perception, including microsecond temporal resolution, high dynamic range, and low power consumption. When combined with Spiking Neural Networks (SNNs), they can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Maxime Vaillant , Axel Carlier , Lai Xing Ng , Christophe Hurter , Benoit R. Cottereau

Reinforcement learning agents based on Transformer architectures have achieved impressive performance on sequential decision-making tasks, but their reliance on dense matrix operations makes them ill-suited for energy-constrained,…

Machine Learning · Computer Science 2025-09-01 Vishal Pandey , Debasmita Biswas

Spike-based Transformer presents a compelling and energy-efficient alternative to traditional Artificial Neural Network (ANN)-based Transformers, achieving impressive results through sparse binary computations. However, existing spike-based…

Neural and Evolutionary Computing · Computer Science 2025-03-04 Donghyun Lee , Yuhang Li , Youngeun Kim , Shiting Xiao , Priyadarshini Panda

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and…

Computation and Language · Computer Science 2024-07-12 Rui-Jie Zhu , Qihang Zhao , Guoqi Li , Jason K. Eshraghian

Spiking Neural Networks (SNNs), particularly Spiking Transformers, offer energy-efficient processing of event-based sensor data for healthcare applications. Yet current architectures are rigid: they are trained and deployed as static…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Alberto Ancilotto , Gianluca Amprimo , Stefano Di Carlo , Elisabetta Farella

Spiking neural networks (SNNs) mimic brain computational strategies, and exhibit substantial capabilities in spatiotemporal information processing. As an essential factor for human perception, visual attention refers to the dynamic process…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Wuque Cai , Hongze Sun , Rui Liu , Yan Cui , Jun Wang , Yang Xia , Dezhong Yao , Daqing Guo

Recently, it can be noticed that most models based on spiking neural networks (SNNs) only use a same level temporal resolution to deal with speech classification problems, which makes these models cannot learn the information of input data…

Sound · Computer Science 2025-01-03 Qi Zhang , Huamin Wang , Hangchi Shen , Shukai Duan , Shiping Wen , Tingwen Huang

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Humans interpret and perceive the world by integrating sensory information from multiple modalities, such as vision and hearing. Spiking Neural Networks (SNNs), as brain-inspired computational models, exhibit unique advantages in emulating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Xiang He , Dongcheng Zhao , Yiting Dong , Guobin Shen , Xin Yang , Yi Zeng

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Spiking Neural Networks (SNNs) present a more energy-efficient alternative to Artificial Neural Networks (ANNs) by harnessing spatio-temporal dynamics and event-driven spikes. Effective utilization of temporal information is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Minje Kim , Minjun Kim , Xu Yang