English

Hybrid-Domain Posterior Sampling for Inverse Problems via Latent Flow Matching

Computer Vision and Pattern Recognition 2026-08-01 v1

Abstract

Latent Flow Models have revolutionized compressed-space image synthesis, yet their application to high-fidelity inverse problems remains bottlenecked. In this paper, we trace this dilemma to a fundamental geometric limitation of pre-trained autoencoders, which we term \emph{First-Order Manifold Blindness}. Severe decoder compression (e.g., retaining only  ⁣2%\sim\!2\% of the original degrees of freedom) produces a rank-deficient Jacobian, rendering high-frequency measurement residuals in its orthogonal complement invisible to latent gradients even when the decoder can represent the target image. To overcome this bottleneck, we propose Hybrid-Domain Posterior Sampling (HDPS), a decoupled inference framework that disentangles physical measurement consistency from semantic prior modeling. HDPS diverges into the pixel space, leveraging Langevin dynamics to absorb precise orthogonal measurement gradients, and subsequently projects these structural corrections back onto the generative manifold. An optimization-based latent alignment is introduced to filter pixel-space artifacts while avoiding the semantic drift of direct encoding. Extensive experiments on diverse inverse problems demonstrate that HDPS establishes a new state-of-the-art, successfully recovering the high-frequency structural precision that latent-only solvers inherently discard. The code is available at \href{https://github.com/74587887/HDPS}{https://github.com/74587887/HDPS}.

Cite

@article{arxiv.2608.00537,
  title  = {Hybrid-Domain Posterior Sampling for Inverse Problems via Latent Flow Matching},
  author = {Hongjie Wu and Yiping Xie and Jiancheng Lv},
  journal= {arXiv preprint arXiv:2608.00537},
  year   = {2026}
}

Comments

Accepted to ACM Multimedia 2026