English

Generative Modeling through Koopman Spectral Analysis: An Operator-Theoretic Perspective

Machine Learning 2026-02-10 v3 Dynamical Systems

Abstract

We propose Koopman Spectral Wasserstein Gradient Descent (KSWGD), a particle-based generative modeling framework that learns the Langevin generator via Koopman theory and integrates it with Wasserstein gradient descent. Our key insight is that this spectral structure of the underlying distribution can be directly estimated from trajectory data via the Koopman operator, eliminating the need for explicit knowledge of the target potential. Additionally, we prove that KSWGD maintains an approximately constant dissipation rate, thereby establishing linear convergence and overcoming the vanishing-gradient phenomenon that hinders existing kernel-based particle methods. We further provide a Feynman--Kac interpretation that clarifies the method's probabilistic foundation. Experiments on compact manifolds, metastable multi-well systems, and high-dimensional stochastic partial differential equations demonstrate that KSWGD consistently outperforms baselines in both convergence speed and sample quality.

Cite

@article{arxiv.2512.18837,
  title  = {Generative Modeling through Koopman Spectral Analysis: An Operator-Theoretic Perspective},
  author = {Yuanchao Xu and Fengyi Li and Masahiro Fujisawa and Xiaoyuan Cheng and Youssef Marzouk and Isao Ishikawa},
  journal= {arXiv preprint arXiv:2512.18837},
  year   = {2026}
}
R2 v1 2026-07-01T08:35:43.346Z