English

DiffFNO: Diffusion Fourier Neural Operator

Computer Vision and Pattern Recognition 2025-04-08 v2

Abstract

We introduce DiffFNO, a novel diffusion framework for arbitrary-scale super-resolution strengthened by a Weighted Fourier Neural Operator (WFNO). Mode Rebalancing in WFNO effectively captures critical frequency components, significantly improving the reconstruction of high-frequency image details that are crucial for super-resolution tasks. Gated Fusion Mechanism (GFM) adaptively complements WFNO's spectral features with spatial features from an Attention-based Neural Operator (AttnNO). This enhances the network's capability to capture both global structures and local details. Adaptive Time-Step (ATS) ODE solver, a deterministic sampling strategy, accelerates inference without sacrificing output quality by dynamically adjusting integration step sizes ATS. Extensive experiments demonstrate that DiffFNO achieves state-of-the-art (SOTA) results, outperforming existing methods across various scaling factors by a margin of 2-4 dB in PSNR, including those beyond the training distribution. It also achieves this at lower inference time. Our approach sets a new standard in super-resolution, delivering both superior accuracy and computational efficiency.

Keywords

Cite

@article{arxiv.2411.09911,
  title  = {DiffFNO: Diffusion Fourier Neural Operator},
  author = {Xiaoyi Liu and Hao Tang},
  journal= {arXiv preprint arXiv:2411.09911},
  year   = {2025}
}
R2 v1 2026-06-28T20:00:43.584Z