English

Spectrally-Guided Diffusion Noise Schedules

Computer Vision and Pattern Recognition 2026-05-12 v2 Machine Learning

Abstract

Denoising diffusion models are widely used for high-quality image and video generation. Their performance depends on noise schedules, which define the distribution of noise levels applied during training and the sequence of noise levels traversed during sampling. Noise schedules are typically handcrafted and require manual tuning across different resolutions. In this work, we propose a principled way to design per-instance noise schedules for pixel diffusion, based on the image's spectral properties. By deriving theoretical bounds on the efficacy of minimum and maximum noise levels, we design ``tight'' noise schedules that eliminate redundant steps. During inference, we propose to conditionally sample such noise schedules. Experiments show that our noise schedules improve generative quality of single-stage pixel diffusion models, particularly in the low-step regime.

Keywords

Cite

@article{arxiv.2603.19222,
  title  = {Spectrally-Guided Diffusion Noise Schedules},
  author = {Carlos Esteves and Ameesh Makadia},
  journal= {arXiv preprint arXiv:2603.19222},
  year   = {2026}
}

Comments

Accepted to ICML'26

R2 v1 2026-07-01T11:28:39.498Z