English

Attention Mechanisms in Dynamical Systems: A Case Study with Predator-Prey Models

Dynamical Systems 2025-05-13 v1 Artificial Intelligence

Abstract

Attention mechanisms are widely used in artificial intelligence to enhance performance and interpretability. In this paper, we investigate their utility in modeling classical dynamical systems -- specifically, a noisy predator-prey (Lotka-Volterra) system. We train a simple linear attention model on perturbed time-series data to reconstruct system trajectories. Remarkably, the learned attention weights align with the geometric structure of the Lyapunov function: high attention corresponds to flat regions (where perturbations have small effect), and low attention aligns with steep regions (where perturbations have large effect). We further demonstrate that attention-based weighting can serve as a proxy for sensitivity analysis, capturing key phase-space properties without explicit knowledge of the system equations. These results suggest a novel use of AI-derived attention for interpretable, data-driven analysis and control of nonlinear systems. For example our framework could support future work in biological modeling of circadian rhythms, and interpretable machine learning for dynamical environments.

Keywords

Cite

@article{arxiv.2505.06503,
  title  = {Attention Mechanisms in Dynamical Systems: A Case Study with Predator-Prey Models},
  author = {David Balaban},
  journal= {arXiv preprint arXiv:2505.06503},
  year   = {2025}
}

Comments

5 figures, 12 pages, python code included

R2 v1 2026-06-28T23:27:56.692Z