English

E2ATST: A Temporal-Spatial Optimized Energy-Efficient Architecture for Training Spiking Transformer

Hardware Architecture 2025-08-04 v1 Neural and Evolutionary Computing
Authors: Yunhao Ma , Yanyu Lin , Mingjing Li , Puli Quan , Chenlin Zhou , Wenyue Zhang , Zhiwei Zhong , Wanyi Jia , Xueke Zhu , Qingyan Meng , Huihui Zhou , Fengwei An
View on arXiv ↗ PDF ↗

Abstract

(1) Pengcheng Laboratory, (2) Southern University of Science and Technology, (3) Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, (4) University of Chinese Academy of Sciences

Cite

@article{arxiv.2508.00475,
  title  = {E2ATST: A Temporal-Spatial Optimized Energy-Efficient Architecture for Training Spiking Transformer},
  author = {Yunhao Ma and Yanyu Lin and Mingjing Li and Puli Quan and Chenlin Zhou and Wenyue Zhang and Zhiwei Zhong and Wanyi Jia and Xueke Zhu and Qingyan Meng and Huihui Zhou and Fengwei An},
  journal= {arXiv preprint arXiv:2508.00475},
  year   = {2025}
}

Related papers

View all related →
Neural and Evolutionary Computing · Computer Science
AutoST: Training-free Neural Architecture Search for Spiking Transformers
Ziqing Wang, Qidong Zhao, Jinku Cui, Xu Liu +1
2023-12-15
Neural and Evolutionary Computing · Computer Science
Spiking Transformer with Spatial-Temporal Attention
Donghyun Lee, Yuhang Li, Youngeun Kim, Shiting Xiao +1
2025-03-04
Machine Learning · Computer Science
STAS: Spatio-Temporal Adaptive Computation Time for Spiking Transformers
Donghwa Kang, Doohyun Kim, Sang-Ki Ko, Jinkyu Lee +2
2025-08-21
Machine Learning · Computer Science
Energy-Efficient Deep Reinforcement Learning with Spiking Transformers
Mohammad Irfan Uddin, Nishad Tasnim, Md Omor Faruk, Zejian Zhou
2025-05-21
Neural and Evolutionary Computing · Computer Science
STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
Sicheng Shen, Dongcheng Zhao, Linghao Feng, Zeyang Yue +4
2025-12-24
Hardware Architecture · Computer Science
Hardware Efficient Accelerator for Spiking Transformer With Reconfigurable Parallel Time Step Computing
Bo-Yu Chen, Tian-Sheuan Chang
2025-03-26
Accelerator Physics · Physics
Design and test of frequency tuner for CAEP high power THz free-electron laser
Zhenghui Mi, Yi Sun, Weimin Pan, Haiying Lin +11
2015-06-19
Hardware Architecture · Computer Science
ASTER: Attention-based Spiking Transformer Engine for Event-driven Reasoning
Tamoghno Das, Khanh Phan Vu, Hanning Chen, Hyunwoo Oh +1
2025-11-11
Neural and Evolutionary Computing · Computer Science
Spiking Transformer Hardware Accelerators in 3D Integration
Boxun Xu, Junyoung Hwang, Pruek Vanna-iampikul, Sung Kyu Lim +1
2024-11-13
Machine Learning · Computer Science
Echo State Transformer: Attention Over Finite Memories
Yannis Bendi-Ouis, Xavier Hinaut
2026-02-09
Machine Learning · Computer Science
Closing the Theory-Practice Gap in Spiking Transformers via Effective Dimension
Dongxin Guo, Jikun Wu, Siu Ming Yiu
2026-04-20
Instrumentation and Detectors · Physics
CMS Resistive Plate Chamber overview, from the present system to the upgrade phase I
P. Paolucci, R. Hadjiiska, L. Litov, B. Pavlov +59
2015-06-11
Accelerator Physics · Physics
Cost consideration and a possible construction timeline of the CEPC-SPPC
W. Chou
2015-11-02
Neural and Evolutionary Computing · Computer Science
DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention
Boxun Xu, Hejia Geng, Yuxuan Yin, Peng Li
2024-09-25
Hardware Architecture · Computer Science
EXTENT: Enabling Approximation-Oriented Energy Efficient STT-RAM Write Circuit
Saeed Seyedfaraji, Javad Talafy Daryani, Mohamed M. Sabry Aly, Semeen Rehman
2022-08-17
Neural and Evolutionary Computing · Computer Science
Auto-Spikformer: Spikformer Architecture Search
Kaiwei Che, Zhaokun Zhou, Zhengyu Ma, Wei Fang +4
2023-06-02
Computation and Language · Computer Science
Efficient Adaptive Transformer: An Empirical Study and Reproducible Framework
Jan Miller
2025-10-16
Computer Vision and Pattern Recognition · Computer Science
S3T-Former: A Purely Spike-Driven State-Space Topology Transformer for Skeleton Action Recognition
Naichuan Zheng, Hailun Xia, Zepeng Sun, Weiyi Li +1
2026-03-23
Accelerator Physics · Physics
ASTA at Fermilab: Accelerator Physics and Accelerator Education Programs at the Modern Accelerator R&D Users Facility for HEP and Accelerator Applications
V. Shiltsev, P. Piot
2014-09-22
High Energy Physics - Experiment · Physics
Design of High-energy Proton-beam Experiment Station at CSNS
Yu-Hang Guo, Han-Tao Jing, Ming-Yi Dong, Zhi-Ping Li +22
2026-04-21
Hardware Architecture · Computer Science
FireFly-T: High-Throughput Sparsity Exploitation for Spiking Transformer Acceleration with Dual-Engine Overlay Architecture
Tenglong Li, Jindong Li, Guobin Shen, Dongcheng Zhao +2
2025-05-20
Machine Learning · Computer Science
Energy-Based Transformers are Scalable Learners and Thinkers
Alexi Gladstone, Ganesh Nanduru, Md Mofijul Islam, Peixuan Han +6
2025-07-04
Neural and Evolutionary Computing · Computer Science
Masked Spiking Transformer
Ziqing Wang, Yuetong Fang, Jiahang Cao, Qiang Zhang +2
2023-07-18
Accelerator Physics · Physics
The Advanced Superconducting Test Accelerator (ASTA) at Fermilab: A User-Driven Facility Dedicated to Accelerator Science \& Technology
P. Piot, V. Shiltsev, S. Nagaitsev, M. Church +3
2013-04-02
Accelerator Physics · Physics
The E302 instability-versus-efficiency experiment at FACET-II
O. G. Finnerud, C. A. Lindstrøm, J. B. B. Chen, E. Adli
2024-02-19
R2 v1 2026-07-01T04:29:09.917Z