English

Causality--\Delta: Jacobian-Based Dependency Analysis in Flow Matching Models

Machine Learning 2026-02-04 v1 Artificial Intelligence

Abstract

Flow matching learns a velocity field that transports a base distribution to data. We study how small latent perturbations propagate through these flows and show that Jacobian-vector products (JVPs) provide a practical lens on dependency structure in the generated features. We derive closed-form expressions for the optimal drift and its Jacobian in Gaussian and mixture-of-Gaussian settings, revealing that even globally nonlinear flows admit local affine structure. In low-dimensional synthetic benchmarks, numerical JVPs recover the analytical Jacobians. In image domains, composing the flow with an attribute classifier yields an attribute-level JVP estimator that recovers empirical correlations on MNIST and CelebA. Conditioning on small classifier-Jacobian norms reduces correlations in a way consistent with a hypothesized common-cause structure, while we emphasize that this conditioning is not a formal do intervention.

Cite

@article{arxiv.2602.02793,
  title  = {Causality--\Delta: Jacobian-Based Dependency Analysis in Flow Matching Models},
  author = {Reza Rezvan and Gustav Gille and Moritz Schauer and Richard Torkar},
  journal= {arXiv preprint arXiv:2602.02793},
  year   = {2026}
}

Comments

11 pages, 5 figures. Code: https://github.com/rezaarezvan/causdiff

R2 v1 2026-07-01T09:33:00.670Z