English

OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Models

Machine Learning 2026-06-30 v1 Artificial Intelligence

Abstract

We propose OTCache, a training-free framework for accelerating diffusion sampling via caching schedule prediction. Existing graph-based caching methods reduce redundant computation by optimizing shortest-path objectives, but rely on an additive independence assumption, which often breaks down in the low NFE regime. To address this issue, OTCache models caching schedules across inference budgets as a smooth evolution in policy space, inspired by Optimal Transport (OT). The framework consists of three stages: (1) obtaining a high-fidelity \textbf{reference schedule} using a graph-based caching method under a conservative budget; (2) performing a lightweight anchor search under an extreme low-budget setting via Optuna optimization with an end-to-end perceptual objective; and (3) predicting schedules for target budgets via quantile interpolation between the reference and anchor policies using continuous warping representations. Experiments on FLUX.1 [dev], Qwen-Image, and HunyuanVideo show that OTCache achieves 4.5x, 4.7x, and 3.66x acceleration, respectively, while consistently improving generation fidelity over state-of-the-art caching baselines. This work provides a new perspective on accelerating diffusion models through Optimal-Transport-inspired schedule modeling. Code:https://github.com/UnicomAI/OTCache

Cite

@article{arxiv.2606.31026,
  title  = {OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Models},
  author = {Huanlin Gao and Fang Zhao and Qiang Hui and Fuyuan Shi and Shaoan Zhao and Yantao Li and Chao Tan and Ting Lu and Yuren You and Kai Wang and Shiguo Lian},
  journal= {arXiv preprint arXiv:2606.31026},
  year   = {2026}
}

Comments

ECCV 2026