English

$\texttt{lrnnx}$: A library for Linear RNNs

Machine Learning 2026-02-10 v1 Artificial Intelligence

Abstract

Linear recurrent neural networks (LRNNs) provide a structured approach to sequence modeling that bridges classical linear dynamical systems and modern deep learning, offering both expressive power and theoretical guarantees on stability and trainability. In recent years, multiple LRNN-based architectures have been proposed, each introducing distinct parameterizations, discretization schemes, and implementation constraints. However, existing implementations are fragmented across different software frameworks, often rely on framework-specific optimizations, and in some cases require custom CUDA kernels or lack publicly available code altogether. As a result, using, comparing, or extending LRNNs requires substantial implementation effort. To address this, we introduce lrnnx\texttt{lrnnx}, a unified software library that implements several modern LRNN architectures under a common interface. The library exposes multiple levels of control, allowing users to work directly with core components or higher-level model abstractions. lrnnx\texttt{lrnnx} aims to improve accessibility, reproducibility, and extensibility of LRNN research and applications. We make our code available under a permissive MIT license.

Keywords

Cite

@article{arxiv.2602.08810,
  title  = {$\texttt{lrnnx}$: A library for Linear RNNs},
  author = {Karan Bania and Soham Kalburgi and Manit Tanwar and Dhruthi and Aditya Nagarsekar and Harshvardhan Mestha and Naman Chibber and Raj Deshmukh and Anish Sathyanarayanan and Aarush Rathore and Pratham Chheda},
  journal= {arXiv preprint arXiv:2602.08810},
  year   = {2026}
}

Comments

EACL Student Research Workshop 2026

R2 v1 2026-07-01T10:28:09.594Z