English

QL-LSTM: A Parameter-Efficient LSTM for Stable Long-Sequence Modeling

Machine Learning 2025-12-09 v1 Artificial Intelligence Neural and Evolutionary Computing

Abstract

Recurrent neural architectures such as LSTM and GRU remain widely used in sequence modeling, but they continue to face two core limitations: redundant gate-specific parameters and reduced ability to retain information across long temporal distances. This paper introduces the Quantum-Leap LSTM (QL-LSTM), a recurrent architecture designed to address both challenges through two independent components. The Parameter-Shared Unified Gating mechanism replaces all gate-specific transformations with a single shared weight matrix, reducing parameters by approximately 48 percent while preserving full gating behavior. The Hierarchical Gated Recurrence with Additive Skip Connections component adds a multiplication-free pathway that improves long-range information flow and reduces forget-gate degradation. We evaluate QL-LSTM on sentiment classification using the IMDB dataset with extended document lengths, comparing it to LSTM, GRU, and BiLSTM reference models. QL-LSTM achieves competitive accuracy while using substantially fewer parameters. Although the PSUG and HGR-ASC components are more efficient per time step, the current prototype remains limited by the inherent sequential nature of recurrent models and therefore does not yet yield wall-clock speed improvements without further kernel-level optimization.

Keywords

Cite

@article{arxiv.2512.06582,
  title  = {QL-LSTM: A Parameter-Efficient LSTM for Stable Long-Sequence Modeling},
  author = {Isaac Kofi Nti},
  journal= {arXiv preprint arXiv:2512.06582},
  year   = {2025}
}
R2 v1 2026-07-01T08:13:14.812Z