English

Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Series

Machine Learning 2025-12-02 v2 Artificial Intelligence Dynamical Systems

Abstract

Nonlinear vector autoregression (NVAR) and reservoir computing (RC) have shown promise in forecasting chaotic dynamical systems, such as the Lorenz-63 model and El Nino-Southern Oscillation. However, their reliance on fixed nonlinear transformations - polynomial expansions in NVAR or random feature maps in RC - limits their adaptability to high noise or complex real-world data. Furthermore, these methods also exhibit poor scalability in high-dimensional settings due to costly matrix inversion during optimization. We propose a data-adaptive NVAR model that combines delay-embedded linear inputs with features generated by a shallow, trainable multilayer perceptron (MLP). Unlike standard NVAR and RC models, the MLP and linear readout are jointly trained using gradient-based optimization, enabling the model to learn data-driven nonlinearities, while preserving a simple readout structure and improving scalability. Initial experiments across multiple chaotic systems, tested under noise-free and synthetically noisy conditions, showed that the adaptive model outperformed in predictive accuracy the standard NVAR, a leaky echo state network (ESN) - the most common RC model - and a hybrid ESN, thereby showing robust forecasting under noisy conditions.

Keywords

Cite

@article{arxiv.2507.08738,
  title  = {Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Series},
  author = {Azimov Sherkhon and Susana Lopez-Moreno and Eric Dolores-Cuenca and Sieun Lee and Sangil Kim},
  journal= {arXiv preprint arXiv:2507.08738},
  year   = {2025}
}

Comments

17 pages, 5 figures, 5 tables. New comparisons added: ESN and HESN. New datasets added to experiments: Mackey-Glass and Lorenz 96 with 100 variables

R2 v1 2026-07-01T03:56:52.436Z