English

Predict-Project-Renoise: Sampling Diffusion Models under Hard Constraints

Machine Learning 2026-05-14 v2

Abstract

Diffusion models cannot enforce hard constraints, yet applications in the physical sciences demand exact satisfaction of conservation laws, boundary conditions, and observational consistency. In this work, we identify a corrector kernel whose unique stationary distribution is the constrained marginal at each noise level, and approximate it by iteratively projecting through the denoiser and renoising via the forward kernel. The resulting Predict-Project-Renoise (PPR) algorithm enables sampling from pretrained diffusion models under hard constraints. Its three components are each necessary: projecting through the denoiser keeps samples close to the data manifold, while renoising and iterating drive samples toward the constrained marginal. On 2D distributions, the Kuramoto-Sivashinsky equation, and global weather forecasting with a 10810^8-dimensional atmospheric model, PPR simultaneously achieves low constraint violations and high distributional fidelity, a combination that existing methods fail to deliver.

Keywords

Cite

@article{arxiv.2601.21033,
  title  = {Predict-Project-Renoise: Sampling Diffusion Models under Hard Constraints},
  author = {Omer Rochman-Sharabi and Gilles Louppe},
  journal= {arXiv preprint arXiv:2601.21033},
  year   = {2026}
}

Comments

Code coming soon

R2 v1 2026-07-01T09:24:39.296Z