English
Related papers

Related papers: Spiking Tucker Fusion Transformer for Audio-Visual…

200 papers

Spiking Neural Networks (SNNs) provide an energy-efficient paradigm for visual recognition. We present SpikingMoE, which integrates a spike-driven Transformer with a Mixture-of-Experts (MoE) framework for dynamic computation. Inspired by…

Neural and Evolutionary Computing · Computer Science 2026-05-25 Yukai Yang , Chenxi Qin , Jungang Li , Xin Zhang , Wenwei Shao , Liqun Chen

Spiking neural networks (SNN) distinguish themselves from artificial neural networks (ANN) because of their inherent temporal processing and spike-based computations, enabling a power-efficient implementation in neuromorphic hardware. In…

Neural and Evolutionary Computing · Computer Science 2023-11-29 Lucas Deckers , Laurens Van Damme , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

The primate visual cortex exhibits topographic organization, where functionally similar neurons are spatially clustered, a structure widely believed to enhance neural processing efficiency. While prior works have demonstrated that…

Neural and Evolutionary Computing · Computer Science 2025-11-24 Deming Zhou , Yuetong Fang , Zhaorui Wang , Renjing Xu

Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Mingyuan Meng , Xingyu Yang , Lei Bi , Jinman Kim , Shanlin Xiao , Zhiyi Yu

How to effectively and efficiently deal with spatio-temporal event streams, where the events are generally sparse and non-uniform and have the microsecond temporal resolution, is of great value and has various real-life applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Man Yao , Huanhuan Gao , Guangshe Zhao , Dingheng Wang , Yihan Lin , Zhaoxu Yang , Guoqi Li

Agent-based Transformers have been widely adopted in recent reinforcement learning advances due to their demonstrated ability to solve complex tasks. However, the high computational complexity of Transformers often results in significant…

Machine Learning · Computer Science 2025-05-21 Mohammad Irfan Uddin , Nishad Tasnim , Md Omor Faruk , Zejian Zhou

Spiking Neural Networks (SNNs) have attracted the attention of the deep learning community for use in low-latency, low-power neuromorphic hardware, as well as models for understanding neuroscience. In this paper, we introduce Spiking Phasor…

Neural and Evolutionary Computing · Computer Science 2022-04-04 Connor Bybee , E. Paxon Frady , Friedrich T. Sommer

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm, enabling energy-efficient data processing through spike-based information transmission. Despite notable advancements in hardware for SNNs, spike encoding…

Signal Processing · Electrical Eng. & Systems 2025-06-03 MHD Anas Alsakkal , Runze Wang , Piotr Dudek , Jayawan Wijekoon

Spiking Neural Networks (SNNs), inspired by biological neural mechanisms, represent a promising neuromorphic computing paradigm that offers energy-efficient alternatives to traditional Artificial Neural Networks (ANNs). Despite proven…

Multimedia · Computer Science 2025-09-30 Zeyang Song , Shimin Zhang , Yuhong Chou , Jibin Wu , Haizhou Li

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Tian , Juan Andrade-Cetto

With the success of self-supervised learning, multimodal foundation models have rapidly adapted a wide range of downstream tasks driven by vision and language (VL) pretraining. State-of-the-art methods achieve impressive performance by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yeming Chen , Siyu Zhang , Yaoru Sun , Weijian Liang , Haoran Wang

Multi-timestep simulation of brain-inspired Spiking Neural Networks (SNNs) boost memory requirements during training and increase inference energy cost. Current training methods cannot simultaneously solve both training and inference…

Neural and Evolutionary Computing · Computer Science 2024-05-28 JiaKui Hu , Man Yao , Xuerui Qiu , Yuhong Chou , Yuxuan Cai , Ning Qiao , Yonghong Tian , Bo XU , Guoqi Li

Brain-inspired spiking neural networks (SNNs) have demonstrated great potential for temporal signal processing. However, their performance in speech processing remains limited due to the lack of an effective auditory front-end. To address…

Sound · Computer Science 2024-03-26 Zeyang Song , Jibin Wu , Malu Zhang , Mike Zheng Shou , Haizhou Li

Spiking neural networks (SNNs) with adaptive synapses reflect core properties of biological neural networks. Speech recognition, as an application involving audio coding and dynamic learning, provides a good test problem to study SNN…

Neural and Evolutionary Computing · Computer Science 2017-03-14 Amirhossein Tavanaei , Anthony S Maida

Spike trains serve as the primary medium for information transmission in Spiking Neural Networks, playing a crucial role in determining system efficiency. Existing encoding schemes based on spike counts or timing often face severe…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Yiwen Gu , Junchuan Gu , Haibin Shen , Kejie Huang

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements…

Neural and Evolutionary Computing · Computer Science 2024-04-25 Lang Qin , Ziming Wang , Runhao Jiang , Rui Yan , Huajin Tang

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but incur substantial computational overhead and energy consumption during inference, limiting deployment in resource-constrained environments. Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Han Xu , Zhiyong Qin , Di Shang , Jiahong Zhang , Xuerui Qiu , Bo Lei , Tiejun Huang , Bo Xu , Guoqi Li

Spiking Neural Networks (SNNs) have emerged as a promising alternative to traditional Deep Neural Networks for low-power computing. However, the effectiveness of SNNs is not solely determined by their performance but also by their energy…

Neural and Evolutionary Computing · Computer Science 2023-05-19 Florian Bacho , Dominique Chu

This paper presents a novel approach for signal reconstruction using Spiking Neural Networks (SNN) based on the principles of Cognitive Informatics and Cognitive Computing. The proposed SNN leverages the Discrete Fourier Transform (DFT) to…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Lei Zhang