English

Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning

Machine Learning 2026-05-11 v1 Artificial Intelligence Quantum Physics

Abstract

Fast Weight Programmers (FWPs) encode temporal dependencies through dynamically updated parameters rather than recurrent hidden states. Quantum FWPs (QFWPs) extend this idea with variational quantum circuits (VQCs), but existing implementations rely on multi-qubit architectures that are difficult to scale on noisy intermediate-scale quantum (NISQ) devices and expensive to simulate classically. We propose gated QKAN-FWP, a fast-weight framework that integrates FWP with Quantum-inspired Kolmogorov-Arnold Network (QKAN) using single-qubit data re-uploading circuits as learnable nonlinear activation, known as DatA Re-Uploading ActivatioN (DARUAN). We further introduce a scalar-gated fast-weight update rule that stabilizes parameter evolution, supported by a theoretical analysis of its adaptive memory kernel, geometric boundedness, and parallelizable gradient paths. We evaluate the framework across time-series benchmarks, MiniGrid reinforcement learning, and highlight real-world solar cycle forecasting as our main practical result. In the long-horizon setting with 528-month input window and 132-month forecast horizon, our 12.5k-parameter model achieves lower scaled Mean Square Error (MSE), peak amplitude error, and peak timing error than a suite of classical recurrent baselines with up to 13x more parameters, including Long Short-Term Memory (LSTM) networks (25.9k-89.1k parameters), WaveNet-LSTM (167k), Vanilla recurrent neural network (11.5k), and a Modified Echo State Network (132k). To validate NISQ compatibility, we further deploy the trained fast programmer on IonQ and IBM Quantum processors, recovering forecasting accuracy within 0.1% relative MSE of the noiseless simulator at 1024 shots. These results position gated QKAN-FWP as a scalable, parameter-efficient, and NISQ-compatible approach to quantum-inspired sequence modeling.

Keywords

Cite

@article{arxiv.2605.06734,
  title  = {Gated QKAN-FWP: Scalable Quantum-inspired Sequence Learning},
  author = {Kuo-Chung Peng and Samuel Yen-Chi Chen and Jiun-Cheng Jiang and Chen-Yu Liu and En-Jui Kuo and Yun-Yuan Wang and Prayag Tiwari and Andrea Ceschini and Chi-Sheng Chen and Yu-Chao Hsu and Chun-Hua Lin and Tai-Yue Li and Antonello Rosato and Massimo Panella and Simon See and Saif Al-Kuwari and Kuan-Cheng Chen and Nan-Yow Chen and Hsi-Sheng Goan},
  journal= {arXiv preprint arXiv:2605.06734},
  year   = {2026}
}

Comments

46 pages, 13 figures, 10 tables

R2 v1 2026-07-01T12:55:51.579Z