English
Related papers

Related papers: TEFormer: Structured Bidirectional Temporal Enhanc…

200 papers

Spiking Transformers, which combine the scalability of Transformers with the sparse, energy-efficient property of Spiking Neural Networks (SNNs), have achieved impressive results in neuromorphic and vision tasks and attracted increasing…

Neural and Evolutionary Computing · Computer Science 2026-04-14 Chenlin Zhou , Sihang Guo , Jiaqi Wang , Dongyang Ma , Kaiwei Che , Baiyu Chen , Qingyan Meng , Zhengyu Ma , Yonghong Tian

In this work, we propose time-integrated spike-timing-dependent plasticity (TI-STDP), a mathematical model of synaptic plasticity that allows spiking neural networks to continuously adapt to sensory input streams in an unsupervised fashion.…

Neurons and Cognition · Quantitative Biology 2024-07-16 William Gebhardt , Alexander G. Ororbia

In recent years, deep learning (DL) models have shown outstanding performance in EEG classification tasks, particularly in Steady-State Visually Evoked Potential(SSVEP)-based Brain-Computer-Interfaces(BCI)systems. DL methods have been…

Signal Processing · Electrical Eng. & Systems 2025-02-21 Yan Huang , Yongru Chen , Lei Cao , Yongnian Cao , Xuechun Yang , Yilin Dong , Tianyu Liu

Time series analysis and modelling constitute a crucial research area. Traditional artificial neural networks struggle with complex, non-stationary time series data due to high computational complexity, limited ability to capture temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chengzhi Liu , Zheng Tao , Zihong Luo , Chenghao Liu

Vision Transformers face a fundamental limitation: standard self-attention jointly processes spatial and channel dimensions, leading to entangled representations that prevent independent modeling of structural and semantic dependencies.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jiashu Liao , Pietro Liò , Marc de Kamps , Duygu Sarikaya

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

Machine Learning · Computer Science 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

Spiking neural networks (SNNs) represent a promising approach to developing artificial neural networks that are both energy-efficient and biologically plausible. However, applying SNNs to sequential tasks, such as text classification and…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Changze Lv , Dongqi Han , Yansen Wang , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patterns. In recent…

Machine Learning · Computer Science 2023-10-10 Hangchen Liu , Zheng Dong , Renhe Jiang , Jiewen Deng , Jinliang Deng , Quanjun Chen , Xuan Song

Spiking neural networks, also often referred to as the third generation of neural networks, carry the potential for a massive reduction in memory and energy consumption over traditional, second-generation neural networks. Inspired by the…

Neural and Evolutionary Computing · Computer Science 2022-10-27 Alexander Henkes , Jason K. Eshraghian , Henning Wessels

Spiking Neural Networks (SNNs), inspired by the brain, are characterized by minimal power consumption and swift inference capabilities on neuromorphic hardware, and have been widely applied to various visual perception tasks. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Chengjun Zhang , Yuhao Zhang , Jie Yang , Mohamad Sawan

Event camera-based pattern recognition is a newly arising research topic in recent years. Current researchers usually transform the event streams into images, graphs, or voxels, and adopt deep neural networks for event-based classification.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xiao Wang , Yao Rong , Zongzhen Wu , Lin Zhu , Bo Jiang , Jin Tang , Yonghong Tian

In this work, we introduce SPFormer, a novel Vision Transformer enhanced by superpixel representation. Addressing the limitations of traditional Vision Transformers' fixed-size, non-adaptive patch partitioning, SPFormer employs superpixels…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jieru Mei , Liang-Chieh Chen , Alan Yuille , Cihang Xie

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Mingkun Xu , Yujie Wu , Lei Deng , Faqiang Liu , Guoqi Li , Jing Pei

Spiking Neural Networks (SNNs), with their event-driven and biologically inspired operation, are well-suited for energy-efficient neuromorphic hardware. Neural coding, critical to SNNs, determines how information is represented via spikes.…

Neural and Evolutionary Computing · Computer Science 2025-03-11 Kaiwei Che , Wei Fang , Zhengyu Ma , Yifan Huang , Peng Xue , Li Yuan , Timothée Masquelier , Yonghong Tian

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

Spiking Neural Networks (SNNs) offer a biologically inspired alternative to conventional artificial neural networks, with potential advantages in power efficiency due to their event-driven computation. Despite their promise, SNNs have yet…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Wangdan Liao , Weidong Wang

Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal…

Hardware Architecture · Computer Science 2021-05-10 Haowen Fang , Brady Taylor , Ziru Li , Zaidao Mei , Hai Li , Qinru Qiu

Tracking any point (TAP) is a fundamental yet challenging task in computer vision, requiring high precision and long-term motion reasoning. Recent attempts to combine RGB frames and event streams have shown promise, yet they typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiaxiong Liu , Zhen Tan , Jinpu Zhang , Yi Zhou , Hui Shen , Xieyuanli Chen , Dewen Hu

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng