English

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution

Computer Vision and Pattern Recognition 2026-03-24 v4

Abstract

Generative models for Image Super-Resolution (SR) are increasingly powerful, yet their reliance on self-attention's quadratic complexity (O(N^2)) creates a major computational bottleneck. Linear Attention offers an O(N) solution, but its promise for photorealistic SR has remained largely untapped, historically hindered by a cascade of interrelated and previously unsolved challenges. This paper introduces LinearSR, a holistic framework that, for the first time, systematically overcomes these critical hurdles. Specifically, we resolve a fundamental, training instability that causes catastrophic model divergence using our novel "knee point"-based Early-Stopping Guided Fine-tuning (ESGF) strategy. Furthermore, we mitigate the classic perception-distortion trade-off with a dedicated SNR-based Mixture of Experts (MoE) architecture. Finally, we establish an effective and lightweight guidance paradigm, TAG, derived from our "precision-over-volume" principle. Our resulting LinearSR model simultaneously delivers state-of-the-art perceptual quality with exceptional efficiency. Its core diffusion forward pass (1-NFE) achieves SOTA-level speed, while its overall multi-step inference time remains highly competitive. This work provides the first robust methodology for applying Linear Attention in the photorealistic SR domain, establishing a foundational paradigm for future research in efficient generative super-resolution.

Keywords

Cite

@article{arxiv.2510.08771,
  title  = {LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution},
  author = {Xiaohui Li and Shaobin Zhuang and Shuo Cao and Yang Yang and Yuandong Pu and Qi Qin and Siqi Luo and Bin Fu and Yihao Liu},
  journal= {arXiv preprint arXiv:2510.08771},
  year   = {2026}
}

Comments

Camera Ready of ICLR2026

R2 v1 2026-07-01T06:28:03.941Z