English
Related papers

Related papers: SAFformer:Improving Spiking Transformer via Active…

200 papers

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

Spiking Neural Networks (SNNs) are increasingly studied as energy-efficient alternatives to Convolutional Neural Networks (CNNs), particularly for edge intelligence. However, prior work has largely emphasized large-scale models, leaving the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Radib Bin Kabir , Tawsif Tashwar Dipto , Mehedi Ahamed , Sabbir Ahmed , Md Hasanul Kabir

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Tian , Juan Andrade-Cetto

Artificial neural networks (ANNs) can help camera-based remote photoplethysmography (rPPG) in measuring cardiac activity and physiological signals from facial videos, such as pulse wave, heart rate and respiration rate with better accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Mingxuan Liu , Jiankai Tang , Yongli Chen , Haoxiang Li , Jiahao Qi , Siwei Li , Kegang Wang , Jie Gan , Yuntao Wang , Hong Chen

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Yang Li , Yi Zeng

In recent years, Spiking Neural Networks (SNNs) have achieved remarkable progress, with Spiking Transformers emerging as a promising architecture for energy-efficient sequence modeling. However, existing Spiking Transformers still lack a…

Neural and Evolutionary Computing · Computer Science 2026-01-27 Sicheng Shen , Mingyang Lv , Bing Han , Dongcheng Zhao , Guobin Shen , Feifei Zhao , Yi Zeng

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking Neural Networks (SNNs), inspired by biological neural mechanisms, represent a promising neuromorphic computing paradigm that offers energy-efficient alternatives to traditional Artificial Neural Networks (ANNs). Despite proven…

Multimedia · Computer Science 2025-09-30 Zeyang Song , Shimin Zhang , Yuhong Chou , Jibin Wu , Haizhou Li

Transformer-based Spiking Neural Networks (SNNs) integrate SNNs with global self-attention and have demonstrated impressive performance. However, existing Transformer-based SNNs suffer from two fundamental limitations. First, they typically…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Lingdong Li , Hangming Zhang , Qiang Yu

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led to a growing interest in incorporating the self-attention mechanism and transformer-based architecture into Spiking Neural Networks (SNNs). While…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Xinyu Shi , Zecheng Hao , Zhaofei Yu

The integration of neuromorphic computing and transformers through spiking neural networks (SNNs) offers a promising path to energy-efficient sequence modeling, with the potential to overcome the energy-intensive nature of the artificial…

Hardware Architecture · Computer Science 2025-04-23 Zihang Song , Prabodh Katti , Osvaldo Simeone , Bipin Rajendran

The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their biological properties. Recent advancements in SNN…

Neural and Evolutionary Computing · Computer Science 2023-06-02 Kaiwei Che , Zhaokun Zhou , Zhengyu Ma , Wei Fang , Yanqi Chen , Shuaijie Shen , Li Yuan , Yonghong Tian

Energy-efficient spikformer has been proposed by integrating the biologically plausible spiking neural network (SNN) and artificial Transformer, whereby the Spiking Self-Attention (SSA) is used to achieve both higher accuracy and lower…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Qingyu Wang , Duzhen Zhang , Tilelin Zhang , Bo Xu

Spiking neural networks (SNNs) have ultra-low energy consumption and high biological plausibility due to their binary and bio-driven nature compared with artificial neural networks (ANNs). While previous research has primarily focused on…

Neural and Evolutionary Computing · Computer Science 2023-12-06 Jiahang Cao , Ziqing Wang , Hanzhong Guo , Hao Cheng , Qiang Zhang , Renjing Xu

Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in spiking transformers have focused on improving accuracy with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenjie Wei , Xiaolong Zhou , Malu Zhang , Ammar Belatreche , Qian Sun , Yimeng Shan , Dehao Zhang , Zijian Zhou , Zeyu Ma , Yang Yang , Haizhou Li

Speech enhancement (SE) is crucial for reliable communication devices or robust speech recognition systems. Although conventional artificial neural networks (ANN) have demonstrated remarkable performance in SE, they require significant…

Sound · Computer Science 2023-07-28 Abir Riahi , Éric Plourde

In the training and inference of spiking neural networks (SNNs), direct training and lightweight computation methods have been orthogonally developed, aimed at reducing power consumption. However, only a limited number of approaches have…

Artificial Intelligence · Computer Science 2024-08-23 Donghwa Kang , Youngmoon Lee , Eun-Kyu Lee , Brent Kang , Jinkyu Lee , Hyeongboo Baek

Emerged as a biology-inspired method, Spiking Neural Networks (SNNs) mimic the spiking nature of brain neurons and have received lots of research attention. SNNs deal with binary spikes as their activation and therefore derive extreme…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Yufei Guo , Weihang Peng , Yuanpei Chen , Liwen Zhang , Xiaode Liu , Xuhui Huang , Zhe Ma