English

Lag Operator SSMs: A Geometric Framework for Structured State Space Modeling

Machine Learning 2025-12-23 v1

Abstract

Structured State Space Models (SSMs), which are at the heart of the recently popular Mamba architecture, are powerful tools for sequence modeling. However, their theoretical foundation relies on a complex, multi-stage process of continuous-time modeling and subsequent discretization, which can obscure intuition. We introduce a direct, first-principles framework for constructing discrete-time SSMs that is both flexible and modular. Our approach is based on a novel lag operator, which geometrically derives the discrete-time recurrence by measuring how the system's basis functions "slide" and change from one timestep to the next. The resulting state matrices are computed via a single inner product involving this operator, offering a modular design space for creating novel SSMs by flexibly combining different basis functions and time-warping schemes. To validate our approach, we demonstrate that a specific instance exactly recovers the recurrence of the influential HiPPO model. Numerical simulations confirm our derivation, providing new theoretical tools for designing flexible and robust sequence models.

Keywords

Cite

@article{arxiv.2512.18965,
  title  = {Lag Operator SSMs: A Geometric Framework for Structured State Space Modeling},
  author = {Sutashu Tomonaga and Kenji Doya and Noboru Murata},
  journal= {arXiv preprint arXiv:2512.18965},
  year   = {2025}
}
R2 v1 2026-07-01T08:36:01.333Z