English

Understanding Lookahead Dynamics Through Laplace Transform

Optimization and Control 2025-06-17 v1 Machine Learning Machine Learning

Abstract

We introduce a frequency-domain framework for convergence analysis of hyperparameters in game optimization, leveraging High-Resolution Differential Equations (HRDEs) and Laplace transforms. Focusing on the Lookahead algorithm--characterized by gradient steps kk and averaging coefficient α\alpha--we transform the discrete-time oscillatory dynamics of bilinear games into the frequency domain to derive precise convergence criteria. Our higher-precision O(γ2)O(\gamma^2)-HRDE models yield tighter criteria, while our first-order O(γ)O(\gamma)-HRDE models offer practical guidance by prioritizing actionable hyperparameter tuning over complex closed-form solutions. Empirical validation in discrete-time settings demonstrates the effectiveness of our approach, which may further extend to locally linear operators, offering a scalable framework for selecting hyperparameters for learning in games.

Keywords

Cite

@article{arxiv.2506.13712,
  title  = {Understanding Lookahead Dynamics Through Laplace Transform},
  author = {Aniket Sanyal and Tatjana Chavdarova},
  journal= {arXiv preprint arXiv:2506.13712},
  year   = {2025}
}
R2 v1 2026-07-01T03:20:08.296Z