English
Related papers

Related papers: Spiking Transformer with Spatial-Temporal Attentio…

200 papers

Traffic forecasting is a cornerstone of smart city management, enabling efficient resource allocation and transportation planning. Deep learning, with its ability to capture complex nonlinear patterns in spatiotemporal (ST) data, has…

Machine Learning · Computer Science 2024-10-16 Hongjun Wang , Jiyuan Chen , Tong Pan , Zheng Dong , Lingyu Zhang , Renhe Jiang , Xuan Song

Self-attention has recently been adopted for a wide range of sequence modeling problems. Despite its effectiveness, self-attention suffers from quadratic compute and memory requirements with respect to sequence length. Successful approaches…

Machine Learning · Computer Science 2020-10-27 Aurko Roy , Mohammad Saffar , Ashish Vaswani , David Grangier

Spiking neural networks are the basis of versatile and power-efficient information processing in the brain. Although we currently lack a detailed understanding of how these networks compute, recently developed optimization techniques allow…

Neural and Evolutionary Computing · Computer Science 2021-01-01 Benjamin Cramer , Yannik Stradmann , Johannes Schemmel , Friedemann Zenke

Spike-based transformer is a novel architecture aiming to enhance the performance of spiking neural networks while mitigating the energy overhead inherent to transformers. However, methods for generating these models suffer from critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yuhao Zhang , Chengjun Zhang , Di Wu , Jie Yang , Mohamad Sawan

Spiking Neural Networks (SNNs) have emerged as a promising substitute for Artificial Neural Networks (ANNs) due to their advantages of fast inference and low power consumption. However, the lack of efficient training algorithms has hindered…

Neural and Evolutionary Computing · Computer Science 2025-03-06 Tong Bu , Maohua Li , Zhaofei Yu

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Mingkun Xu , Yujie Wu , Lei Deng , Faqiang Liu , Guoqi Li , Jing Pei

Spiking neural networks (SNNs) promise ultra-low-power applications by exploiting temporal and spatial sparsity. The number of binary activations, called spikes, is proportional to the power consumed when executed on neuromorphic hardware.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Gregor Lenz , Garrick Orchard , Sadique Sheik

Spiking neural networks (SNNs) communicate via discrete spikes in time rather than continuous activations. Their event-driven nature offers advantages for temporal processing and energy efficiency on resource-constrained hardware, but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Karol C. Jurzec , Tomasz Szydlo , Maciej Wielgosz

Spiking Neural Networks (SNNs) are amenable to deployment on edge devices and neuromorphic hardware due to their lower dissipation. Recently, SNN-based transformers have garnered significant interest, incorporating attention mechanisms akin…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Boxun Xu , Yufei Song , Peng Li

Spiking neural networks (SNNs) have become an interesting alternative to conventional artificial neural networks (ANN) thanks to their temporal processing capabilities and energy efficient implementations in neuromorphic hardware. However…

Machine Learning · Computer Science 2022-09-22 Alex Vicente-Sola , Davide L. Manna , Paul Kirkland , Gaetano Di Caterina , Trevor Bihl

Spiking neural networks (SNN) are able to learn spatiotemporal features while using less energy, especially on neuromorphic hardware. The most widely used spiking neuron in deep learning is the Leaky Integrate and Fire (LIF) neuron. LIF…

Neural and Evolutionary Computing · Computer Science 2023-08-08 Sidi Yaya Arnaud Yarga , Sean U. N. Wood

Spiking Neural Networks (SNNs), as an emerging biologically inspired computational model, demonstrate significant energy efficiency advantages due to their event-driven information processing mechanism. Compared to traditional Artificial…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Changqing Xu , Buxuan Song , Yi Liu , Xinfang Liao , Wenbin Zheng , Yintang Yang

Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from…

Machine Learning · Computer Science 2025-05-29 Chengting Yu , Xiaochen Zhao , Lei Liu , Shu Yang , Gaoang Wang , Erping Li , Aili Wang

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Tian , Juan Andrade-Cetto

This work proposes an end-to-end multi-modal reinforcement learning framework for high-level decision-making in autonomous vehicles. The framework integrates heterogeneous sensory input, including camera images, LiDAR point clouds, and…

Machine Learning · Computer Science 2025-12-02 Aref Ghoreishee , Abhishek Mishra , Lifeng Zhou , John Walsh , Nagarajan Kandasamy

Spiking neural networks (SNNs) are emerging as an energy-efficient alternative to traditional artificial neural networks (ANNs) due to their unique spike-based event-driven nature. Coding is crucial in SNNs as it converts external input…

Neural and Evolutionary Computing · Computer Science 2024-06-05 Xuerui Qiu , Rui-Jie Zhu , Yuhong Chou , Zhaorui Wang , Liang-jian Deng , Guoqi Li

Modern surgical systems increasingly rely on intelligent scene understanding to improve intra-operative safety and situational awareness, with surgical scene segmentation playing a fundamental role in fine-grained surgical perception.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shihao Zou , Jingjing Li , Wei Ji , Jincai Huang , Kai Wang , Guo Dan , Weixin Si , Yi Pan

Spiking Neural Networks (SNNs) are promising energy-efficient models for neuromorphic computing. For training the non-differentiable SNN models, the backpropagation through time (BPTT) with surrogate gradients (SG) method has achieved high…

Neural and Evolutionary Computing · Computer Science 2023-08-08 Qingyan Meng , Mingqing Xiao , Shen Yan , Yisen Wang , Zhouchen Lin , Zhi-Quan Luo

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Changqing Xu , Yijian Pei , Zili Wu , Yi Liu , Yintang Yang

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

Artificial Intelligence · Computer Science 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng
‹ Prev 1 8 9 10 Next ›