English

Action-Inspired Generative Models

Machine Learning 2026-05-15 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

We introduce Action-Inspired Generative Models (AGMs), a dual-network generative framework motivated by the observation that existing bridge-matching methods assign uniform regression weight to every stochastic transition in the transport landscape, regardless of whether a given bridge sample lies along a structurally coherent trajectory or a degenerate one. We address this by introducing a lightweight learned scalar potential VϕV_\phi that scores bridge samples online and modulates the drift objective via importance weights derived through a stop-gradient barrier -- preventing adversarial feedback between the two networks whilst preserving VϕV_\phi's guiding signal. Crucially, VϕV_\phi comprises only \sim1.4% of the primary drift network's parameter count, adds no overhead to the inference graph, and requires no iterative half-bridge fitting or auxiliary stochastic differential equation (SDE) solvers: it is a plug-and-play enhancement to any bridge-matching training loop. At inference, VϕV_\phi is discarded entirely, leaving standard Euler-Maruyama integration of the exponential moving average (EMA) drift. We demonstrate that selectively penalising uninformative transport paths through the learned potential yields consistent improvements in generation quality across fidelity and coverage metrics.

Keywords

Cite

@article{arxiv.2605.14631,
  title  = {Action-Inspired Generative Models},
  author = {Eshwar R. A. and Debnath Pal},
  journal= {arXiv preprint arXiv:2605.14631},
  year   = {2026}
}

Comments

11 pages, 5 figures, and 4 tables