English

Non-equilibrium Annealed Adjoint Sampler

Machine Learning 2025-11-26 v3 Artificial Intelligence

Abstract

Recently, there has been significant progress in learning-based diffusion samplers, which aim to sample from a given unnormalized density. Many of these approaches formulate the sampling task as a stochastic optimal control (SOC) problem using a canonical uninformative reference process, which limits their ability to efficiently guide trajectories toward the target distribution. In this work, we propose the Non-Equilibrium Annealed Adjoint Sampler (NAAS), a novel SOC-based diffusion framework that employs annealed reference dynamics as a non-stationary base SDE. This annealing structure provides a natural progression toward the target distribution and generates informative reference trajectories, thereby enhancing the stability and efficiency of learning the control. Owing to our SOC formulation, our framework can incorporate a variety of SOC solvers, thereby offering high flexibility in algorithmic design. As one instantiation, we employ a lean adjoint system inspired by adjoint matching, enabling efficient and scalable training. We demonstrate the effectiveness of NAAS across a range of tasks, including sampling from classical energy landscapes and molecular Boltzmann distributions.

Keywords

Cite

@article{arxiv.2506.18165,
  title  = {Non-equilibrium Annealed Adjoint Sampler},
  author = {Jaemoo Choi and Yongxin Chen and Molei Tao and Guan-Horng Liu},
  journal= {arXiv preprint arXiv:2506.18165},
  year   = {2025}
}

Comments

26 pages, 8 figures

R2 v1 2026-07-01T03:28:37.527Z