English

SpikGPT: A High-Accuracy and Interpretable Spiking Attention Framework for Single-Cell Annotation

Quantitative Methods 2025-12-04 v1 Genomics

Abstract

Accurate and scalable cell type annotation remains a challenge in single-cell transcriptomics, especially when datasets exhibit strong batch effects or contain previously unseen cell populations. Here we introduce SpikGPT, a hybrid deep learning framework that integrates scGPT-derived cell embeddings with a spiking Transformer architecture to achieve efficient and robust annotation. scGPT provides biologically informed dense representations of each cell, which are further processed by a multi-head Spiking Self-Attention mechanism for energy-efficient feature extraction. Across multiple benchmark datasets, SpikGPT consistently matches or exceeds the performance of leading annotation tools. Notably, SpikGPT uniquely identifies unseen cell types by assigning low-confidence predictions to an "Unknown" category, allowing accurate rejection of cell states absent from the training reference. Together, these results demonstrate that SpikGPT is a versatile and reliable annotation tool capable of generalizing across datasets, resolving complex cellular heterogeneity, and facilitating discovery of novel or disease-associated cell populations.

Keywords

Cite

@article{arxiv.2512.03286,
  title  = {SpikGPT: A High-Accuracy and Interpretable Spiking Attention Framework for Single-Cell Annotation},
  author = {Min Huang and Rishikesan Kamaleswaran},
  journal= {arXiv preprint arXiv:2512.03286},
  year   = {2025}
}
R2 v1 2026-07-01T08:06:45.584Z